Senior Team Lead | Data Lead | Bengaluru | Sustainability & Emerging Assurance

• Job requisition ID : 108080 

• Location: Hyderabad

• Entity: Deloitte South Asia LLP 

The team 

Assurance is seeking an looking for a Databricks / Data Engineer Lead to design and build scalable data pipelines and analytics solutions on Azure for the Edward Jones engagement. The candidate will bring expert-level Databricks and Spark experience, combined with strong Python and Azure data engineering skills. Learn more about Assurance

Your work profile 

Design, develop, and maintain Databricks-based data pipelines and transformation workflows

Build scalable Spark applications for large-scale data processing and analytics

Develop Python-based data engineering solutions for batch and streaming workloads

Architect and implement data solutions on Azure Data Factory, Azure Synapse, or related Azure services

Ensure data quality, lineage, and governance across data products

Implement DevOps practices for data pipeline deployment, monitoring, and automation

Collaborate with data scientists, ML engineers, and business stakeholders

Mentor junior data engineers and contribute to technical standards

Key skills required:  

6+ years of data engineering experience

Advanced proficiency in Databricks — notebooks, Delta Lake, Unity Catalog

Advanced proficiency in Databricks Spark development — PySpark, Spark SQL

Advanced proficiency in Python for data engineering

Advanced proficiency in Azure data services — Azure Data Factory, Synapse, ADLS

Intermediate or above proficiency in DevOps tools and CI/CD practices

Experience with data modelling, data warehousing concepts, and ETL/ELT patterns

Financial Services domain experience is a plus.