Lead Databricks Developer

  • Australia
  • Sydney
  • Contract
  • Negotiable

We are seeking a highly skilled Lead Databricks Engineer to join our client’s growing team. This is a hands-on leadership role where you will set the technical direction, mentor engineers, and drive best practices while delivering robust, high-performing data solutions.

Responsibilities of the role include:

  • Provide technical leadership to a team of engineers, establishing best practices for coding, performance, and CI/CD pipelines.

  • Design and implement end-to-end data pipelines (ETL/ELT) to support scalable, high-quality data solutions.

  • Remain hands-on in development to optimise performance and maintain data quality across all pipelines.

  • Implement robust data validation, cleansing, and governance processes, including security controls such as Data-bricks Unity Catalog.

Experience required:

  • 5+ years in Data Engineering Lead position with proven experience managing a team.

  • Strong experience with Databricks (Azure).

  • Must have hands-on experience with DBT Core

  • Advanced proficiency in Python and SQL, with in-depth knowledge of the Apache Spark ecosystem.

  • Strong track record working with at least one major cloud platform (Azure, AWS, or GCP).

  • Exceptional problem-solving ability, with expertise in diagnosing and resolving complex data engineering challenges.

If you are interested, please apply now. For a confidential discussion, please reach out to Josh.costigan@talentinternational.com

Apply now

Submit your details and attach your resume below. Hint: make sure all relevant experience is included in your CV and keep your message to the hiring team short and sweet - 2000 characters or less is perfect.