Lead DataOps Engineer

  • Australia
  • Melbourne
  • Contract
  • Negotiable

Lead DataOps Engineer
12-month contract + 12-month extension option
Melbourne, Sydney, Brisbane, Canberra or Adelaide
Hybrid
Baseline Clearance with ability to obtain NV1

A major Federal Government agency is seeking an experienced EL2-level Lead DataOps Engineer to design, build, test and maintain secure, scalable cloud data pipelines. Working within the new mobilising Digital Enrolments, Access and Payments (DEAP) program, you will collaborate with data scientists, analysts, data engineers and technical specialists to deliver reliable data movement and processing capabilities across a complex 100% cloud AWS environment.

The Role

  • Design, build, test, deploy and maintain scalable cloud-based data pipelines.
  • Develop data pipeline solutions across APIs, Managed File Transfer, file extracts and other integration patterns.
  • Create and support data processing streams using technologies such as AWS Kinesis.
  • Build ETL and ELT processes using AWS Glue, Informatica, dbt, Talend or similar tools.
  • Automate infrastructure and repeatable engineering tasks using Terraform and scripting.
  • Optimise pipelines for performance, reliability and scalability.
  • Implement appropriate security, access controls and data-protection measures.
  • Monitor data pipelines, troubleshoot issues and maintain technical documentation.
  • Collaborate with data scientists and analysts to understand data requirements.
  • Provide technical design advice and communicate effectively with both business and technical stakeholders.
  • Contribute to delivery within Agile development environments.

About You

  • At least five years’ experience working as a Data Engineer, DataOps, or Data Pipeline Engineer in 100% cloud environments (AWS preferred or multi-cloud AWS and Azure).
  • Strong hands-on experience designing, building, testing and deploying different types of data pipelines.
  • Advanced knowledge of AWS data storage, extraction, transformation and processing services.
  • Practical experience with AWS Glue and streaming technologies such as AWS Kinesis.
  • Strong SQL skills and experience with ETL tools.
  • Experience implementing security and access controls around cloud data pipelines.
  • Infrastructure-as-Code (IaaC) experience, ideally using HashiCorp and Terraform.
  • Experience working with Agile methodologies such as Scrum, Kanban, Lean or Extreme Programming.
  • Strong analytical, troubleshooting, and problem-solving capabilities.
  • Excellent communication skills across technical and business audiences.
  • Relevant tertiary ICT qualifications or applicable industry certifications.

Nice to Have

  • Experience with GoAnywhere Managed File Transfer.
  • Control-M orchestration experience.
  • CI/CD automation experience using GitHub or Bitbucket.
  • Experience using generative AI to improve software engineering efficiency.
  • Knowledge of specification-driven development and design-first engineering practices.
  • Experience implementing architectural patterns for the safe integration of generative AI tools into the software development lifecycle.
  • Current NV1 or Baseline with ability to obtain NV1.

Apply
Applicants will be required to submit a Key Selection Criteria response addressing the formal selection criteria (to be provided) before submission closing date 16th September. Proof of Australian Citizenship and ability to pass federal background checks and national criminal history checks will be required. Baseline AGSVA Clearance required at a minimum.

For further information, contact Kylie McManus at kylie.mcmanus@talentinternational.com.

For over 30 years Talent has been redefining the contracting experience with industry leading support, exclusive contractor benefits & a world-class digital platform ENGAGE to access it all. Apply today to see how we can elevate your career

Apply now

Submit your details and attach your resume below. Hint: make sure all relevant experience is included in your CV and keep your message to the hiring team short and sweet - 2000 characters or less is perfect.