Databricks SME

  • Australia
  • Sydney
  • Permanent
  • AU$200000 - AU$210000 per annum

Our client is seeking an experienced AWS Databricks Subject Matter Expert (SME) to support the delivery, optimisation, and ongoing enhancement of enterprise-scale data solutions on AWS. This is a hands-on role, focused on building and improving Databricks workloads, supporting data pipelines, and working within established platform and architectural standards.

You will work closely with data engineers, analytics teams, and stakeholders to deliver reliable, secure, and high-performing data solutions, rather than owning end-to-end architecture. Ideally, the successful candidate can start ASAP or with a 2-week notice period.

Responsibilities

  • Build, maintain, and optimise Databricks solutions on AWS to support analytics and data engineering use cases

  • Develop and support batch and streaming data pipelines using PySpark, SQL, and Databricks workflows

  • Contribute to solution design and technical decisions within existing architectural frameworks

  • Implement performance tuning, cost optimisation, and operational improvements across Databricks workloads

  • Integrate Databricks with AWS services including S3, IAM, Glue, Redshift, Athena, Lambda, and Kinesis

  • Apply established security, governance, and access controls using Unity Catalog, IAM, and encryption

  • Support data ingestion, transformation, and consumption layers across the platform

  • Collaborate with cloud, security, and platform teams to ensure solutions meet enterprise standards

  • Participate in code reviews, documentation, and knowledge sharing

  • Support CI/CD pipelines and automation for Databricks deployments

Requirements

  • Proven hands-on experience as an AWS Databricks SME in enterprise environments

  • Strong working knowledge of Databricks, Apache Spark, Delta Lake, and Unity Catalog

  • Advanced skills in PySpark and SQL, including performance tuning

  • Solid experience with AWS services such as S3, IAM, Glue, Redshift, EMR, and streaming services

  • Understanding of data security, governance, and compliance in regulated environments

  • Experience working within predefined architecture and platform standards

  • Familiarity with REST integrations, data APIs, and downstream analytics / BI tools

  • Experience with CI/CD pipelines, Git-based workflows, and automated deployments

  • Strong communication skills and ability to collaborate with both technical and non-technical stakeholders

If you think you have the above skills and experiences, click the ‘Apply’ button or send your resume to alex.nguyen@talentinternational.com

Please Notes: Visa sponsorship is not available. Only shortlisted applicants will be contacted for this role.

Apply now

Submit your details and attach your resume below. Hint: make sure all relevant experience is included in your CV and keep your message to the hiring team short and sweet - 2000 characters or less is perfect.