Data Engineer

Data Engineer | AWS Cloud, AI Data Pipelines & Enterprise Integration

• Location: Canberra/ Brisbane (Hybrid)
• Security Clearance: Baseline (Mandatory)
• Contract Length: 12 months + 2 × (12-month extensions – Department’s discretion)

About the position:

This is a senior Data Engineer role operating within our client’s AWS Cloud ecosystem, contributing to enterprise-scale AI capability uplift.

The focus is on designing and delivering scalable, secure, and cost-efficient data pipelines that ingest, transform, and operationalise structured and unstructured data for AI-enabled tools.

This role sits beyond traditional ETL delivery. It requires strong cloud-native engineering capability, automation maturity, and experience building end-to-end pipelines that support AI processing workflows.

What you’ll do:

• Build and optimise batch and streaming data pipelines using AWS services including S3, Glue, Lambda, Step Functions, Kinesis, Redshift, and Athena
• Develop and manage ETL/ELT workflows integrating multiple source systems (APIs, databases, file ingestion, streaming sources)
• Design AI-ready data pipelines including unstructured data processing (chunking, embedding, vector storage using OpenSearch)
• Implement infrastructure automation and CI/CD practices aligned with DevOps and GitOps standards

What we’re looking for:

• 5+ years’ experience delivering enterprise data integration and pipeline solutions in AWS environments
• Strong proficiency in Python and SQL with demonstrable hands-on cloud engineering experience
• Experience building scalable pipelines for AI data processing workflow
• Practical knowledge of Kubernetes, Infrastructure as Code (Terraform/Ansible), and CI/CD automation

Technology & environment:

• AWS Cloud ecosystem (S3, Glue, Lambda, Step Functions, Kinesis, Redshift, Athena)
• AI data processing patterns including embedding pipelines and vector storage
• DevOps/GitOps workflows, CI/CD, automation, and scripting
• Secure enterprise cloud environments with governance, compliance, and privacy controls

Important to know:

• This is not a reporting-only or SQL-only role, it requires hands-on AWS cloud data engineering capability
• You will struggle if your experience is limited to maintaining legacy data warehouses without modern cloud-native pipeline delivery
• Baseline clearance must already be held
• Experience supporting AI-driven data workloads is highly regarded

To showcase your interest for the position, click on ‘APPLY’ on our website or for any further information, please contact Sanat Anmadwar on Sanat.Anmadwar@talentinternational.com We look forward to seeing how your expertise can help us achieve excellence!