Requirements

Expected technologies

Terraform

GCP

Azure

Snowflake

Databricks

Hadoop

Jenkins

Kubernetes

Docker

Our requirements

• 8+ years of experience in data architecture, platform engineering, or related fields, with a strong focus on designing and managing end-to-end platform solutions.
• Proven expertise in Terraform scripting, Infrastructure as Code (IaC), and cloud-based platforms (GCP, Azure).
• Solid experience in DevOps fundamentals and CI/CD pipeline implementation.
• Strong understanding of fundamental networking concepts (e.g., TCP/IP, DNS, VPNs, firewalls) for secure data transmission.
• Expertise in Terraform scripting for automating infrastructure management.
• Strong knowledge of cloud platforms and services (e.g., GCP, Azure) and data technologies like Snowflake, Databricks, and Hadoop.
• Proficiency in DevOps tools such as Jenkins, Kubernetes, Docker, and CI/CD frameworks.

Your responsibilities

• Design, implement, and manage the entire lifecycle of the data platform, from infrastructure setup to the deployment of data services.
• Oversee platform integration with enterprise applications, tools, and services while ensuring a seamless user experience.
• Architect a robust and scalable data platform that supports data lakes, data warehouses, and real-time analytics solutions.
• Leverage Terraform for Infrastructure as Code (IaC) to automate infrastructure deployment and management processes.
• Lead the implementation of data security best practices, including data encryption, access control, and auditing across the platform.
• Design and deploy secure landing zones in cloud environments (GCP, Azure) to ensure compliance with regulatory requirements and safeguard sensitive data.
• Implement security controls that monitor and protect data assets across both cloud and on-premise environments.
• Monitor and enhance the performance and scalability of the data platform, ensuring minimal downtime and optimized resource utilization.
• Utilize Terraform scripting to automate infrastructure management and deployment, ensuring scalability and agility.
• Use fundamental networking skills to ensure secure and reliable data communication across on-premise and cloud environments.
• Implement security mechanisms such as encryption, network isolation, and access controls to protect data throughout its lifecycle.