At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. 

EY GDS – AI and Data – Databricks Data Engineer

We’re looking for candidates with strong technology and data understanding in the big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team.

Your key responsibilities

Develop & deploy Databricks in a cloud environment

ETL design, development, and deployment to Cloud Service

Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams

Design and optimize model codes for faster execution

Collaborate with cross-functional teams to manage project timelines and deliverables

Skills and attributes for success

3-5 years of experience in developing data ingestion, data processing, and data migration, relational databases, and data warehouse solutions

Hands-on experience with Databricks

Proficiency in PySpark

Knowledge of ETL/ELT processes and data pipeline orchestration.

Experience with Delta Lake, Lakehouse architecture.

Proficiency in Python

Knowledge of using Unity Catalog and security best practices.

Develop data ingestion workflows from multiple sources (SQL Server, APIs, flat files, cloud storage).

Optimize SQL queries and Spark jobs for performance and scalability.

Experience with Azure components especially ADF, ADLS etc.

Experience in implementing complex data transformations

Knowledge in Data Streaming

Knowledge in DevOps and CI/CD deployments

Must have hands-on experience in SQL and procedural SQL languages

Strong analytical skills and enjoys solving complex technical problems

Proven ability to lead teams, manage resources, and drive projects to successful completion

To qualify for the role, you must have

Be a computer science graduate or equivalent with 3-5 years of industry experience

Have working experience in an Agile-based delivery methodology (preferable)

Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution

Strong analytical skills and enjoys solving complex technical problems

Proficiency in software development best practices

Excellent debugging and optimization skills

Experience in enterprise-grade solution implementations & in converting business problems/challenges to technical solutions considering security, performance, scalability, etc.

Excellent communicator (written and verbal, formal and informal)

Participate in all aspects of solution delivery life cycle including analysis, design, development, testing, production deployment, and support

Client management skills

Demonstrated leadership experience with the ability to manage and mentor team members effectively

Knowledge of run/change operations

EY | Building a better working world 

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.  

Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.  

Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.