Senior Databricks Engineer

Job Description

About the role: At Cognizant, we're at the forefront of technological innovation, and we're on the hunt for top talent to join our growing Databricks practice at a variety of levels. As an advisor and implementor for leading Australian organisations, you will play a pivotal role in designing and implementing cutting-edge solutions that leverage the power of Databricks to solve complex business data problems. Your job will be to not only implement Databricks solutions but to help our customers optimise their cloud environments and the business value they derive from them. In the Senior Databricks Engineer role, you can expect to: Lead the design and implementation of sophisticated and intricate Databricks-based solutions. Champion the adoption and implementation of advanced and cutting-edge data engineering techniques. Ensure the consistent delivery of data engineering solutions that not only meet but exceed the expectations of our customers. Provide comprehensive technical guidance and mentorship to junior engineering team members. Be a trusted advisor through a deep understanding of customers' business and technical challenges, actively participating in the creation and refinement of compelling proposals, delivering persuasive presentations, and conducting engaging client demonstrations. Maintain industry visibility and thought leadership by actively presenting at prestigious industry events, conferences, and meetups. Work collaboratively with the Data & AI leadership team to nurture and grow the practice. About you: Technology Consulting involves exciting, fast-paced work, dealing with a variety of stakeholders, clients, and consultants. You need to be someone that can deal with ambiguity, thrive on change, and manage your own time effectively. We want someone that genuinely focuses on client outcomes, with a high degree of integrity. At Cognizant, we value consultants that have a high IQ, enjoy problem-solving, and have a willingness to serve. You will need to be confident presenting to both business and technology stakeholders, leading cross-functional geographically dispersed teams, and have strong negotiation and collaboration skills for outcomes. Above all, you should have a positive attitude and enjoy working with consultants from a diverse range of backgrounds on a variety of fast-paced engagements. The ideal candidate will have a passion for helping customers solve problems, a strong foundation in data engineering, and a deep understanding of the Databricks platform. Your past experience should include: 10+ years of data engineering experience using a mix of cloud and on-premise technologies. 3+ years’ experience using Databricks. Proven mastery of Databricks core components, including DataFrames, Datasets, Spark SQL, Delta Lake, Databricks Notebooks, DBFS, and Databricks Connect. Deep understanding of cloud platforms (Azure, AWS) and their integration with Databricks, including deployment, optimization, and security best practices. Strong understanding of data architecture principles, including data modelling, ETL processes, data governance, data quality, privacy, and security controls. Strong foundation in data engineering principles, ETL/ELT processes, data modeling, and data warehousing techniques. Proficiency in SQL, data analysis tools, and familiarity with programming languages such as Python, PySpark, Scala, and others. Excellent communication skills: Strong written and verbal communication skills to effectively collaborate with team members and stakeholders. Additional skills which would be highly desirable: Expertise in machine learning pipelines, Spark Streaming, Databricks AutoML, Delta Live Tables, Databricks Unity Catalog, and Databricks Serverless Computing. Designing and implementing DataOps & Data Mesh aligned frameworks to optimise data platforms for cost, value, flexibility, and efficiency. About Us: At Cognizant, we engineer modern businesses to improve everyday life because we're dedicated to making a lasting impact. Cognizant (Nasdaq: CTSH) engineers modern businesses. We help our clients modernize technology, reimagine processes, and transform experiences so they can stay ahead in our fast-changing world. Together, we're improving everyday life. See how at or @cognizant. #J-18808-Ljbffr