Principal Engineer- Google Cloud Data Platform

Job Description

Come and join a thriving company and become part of a diverse global collective of free-thinkers, entrepreneurs and industry experts who are all driven to use technology to reimagine what’s possible. Capgemini. Get the future you want.For more about why Capgemini, visit here .Let’s talk about the roles and responsibilities The Principal Engineer will be responsible for understanding and designing end-to-end platform architecture, primarily utilizing Google Cloud Platform (GCP) as the data platform. This role requires a deep technical background, expertise in the specified technology stack, and the ability to lead a small team of architects. The successful candidate will represent the engineering team in various governance forums and ensure the timely delivery of high-quality solutions.Key Responsibilities: Platform Architecture Design: Understand and design end-to-end platform architecture, ensuring scalability, reliability, and performance across all systems. Develop new engineering patterns that align with best practices and organizational standards. GCP Implementation: Oversee creating and managing virtual machines (VMs) and VM clusters on GCP. Manage integrations to clusters, ensuring smooth data flow and accessibility. Lead the creation of Directed Acyclic Graphs (DAGs) using DAG factory tools, and set up Apache Airflow Composer for workflow management. Implement Terraform for infrastructure as code, integrating it with GCP, GitHub, and Codefresh for CI/CD processes. Drive containerization initiatives using Google Kubernetes Engine (GKE) and Google Compute Engine (GCE). DevOps and CI/CD: Utilize GitHub for version control and DevOps practices, ensuring efficient code management and deployment pipelines. Implement DAGs via Data Build Tool (DBT) CI for streamlined data transformation processes. Leverage DBTctl CLI tool for managing data workflows and ensuring data quality. Leadership and Governance: Lead a small team of architects, providing guidance and support throughout the project lifecycle to ensure timely delivery of solutions. Represent the engineering team in Enterprise Architecture Governance, Infrastructure Architecture Forums, and Security Design and Governance forums, advocating for the engineering perspective. Collaboration and Communication: Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. Communicate complex technical concepts effectively to both technical and non-technical stakeholders. Qualifications: Bachelor’s or Master’s degree in Engineering, Computer Science, or a related field. 10+ years of experience in engineering roles, with a strong focus on platform architecture and cloud technologies, especially GCP. Proficiency in the following technologies and practices:GCP services (VMs, clusters, Composer, GKE, GCE) Infrastructure as Code (Terraform) CI/CD with GitHub and Codefresh Data transformation using DBT and Apache Flink Demonstrated experience in leading teams and managing architectural projects. Strong understanding of enterprise architecture concepts and governance frameworks. Excellent problem-solving and analytical skills. Exceptional communication skills, capable of engaging with diverse stakeholders and representing the engineering team in formal settings. #J-18808-Ljbffr