Data Engineer - AWS Cloud
Data Engineer
Sydney, NSW | Federal Government Program
12-Month Contract + Extension Options
Active Baseline Security Clearance Required
We are seeking an experienced Data Engineer to join a major Federal Government program delivering foundational AI capabilities within a secure AWS cloud environment.
This is an opportunity to work on a greenfield AI platform that will support multiple Generative AI use cases across the organisation. As part of a highly skilled cloud and AI delivery team, you will be responsible for building and managing the data integration capabilities that power AI-enabled solutions.
The initial focus is supporting an AI-powered Case Assistant solution designed to ingest and analyse large volumes of documents, enable natural language querying, identify duplicate content, generate timelines, and improve operational efficiency through intelligent automation.
The Opportunity
As a Data Engineer, you will play a key role in designing and delivering scalable data ingestion and integration pipelines that connect enterprise source systems with the organisation’s AI platform. You will work across cloud-native technologies, helping establish the foundational data capabilities required to support current and future AI initiatives.
This role will suit someone who enjoys building modern cloud-based data solutions, working with emerging AI technologies, and contributing to a highly collaborative delivery environment.
Key Responsibilities
-
Design, build, and maintain scalable data integration pipelines within AWS
-
Develop batch and streaming data workflows to ingest, process, and transform data from multiple source systems
-
Build and optimise data pipelines supporting AI and Generative AI workloads
-
Develop end-to-end data processing solutions for structured and unstructured content
-
Integrate enterprise applications, APIs, databases, and file-based systems into cloud-based AI platforms
-
Ensure data quality, integrity, reliability, and performance through testing, validation, and monitoring
-
Implement Infrastructure as Code and automation practices to support repeatable deployments
-
Monitor and troubleshoot pipeline performance and operational issues
-
Collaborate with cloud engineers, platform teams, security specialists, and business stakeholders to deliver secure and scalable solutions
-
Contribute to technical documentation, solution design, and operational support processes
-
Participate in Agile delivery activities including sprint planning, estimation, and continuous improvement
Skills & Experience
Essential
-
Strong Python development experience
-
Proven experience delivering cloud-based data engineering solutions
-
Hands-on AWS experience across data integration and processing services
-
Experience designing and building scalable data pipelines and integration workflows
-
Kubernetes experience in enterprise environments
-
Experience with Infrastructure as Code tools and practices
-
Strong understanding of cloud-native architectures and engineering principles
-
Experience with DevOps/GitOps, CI/CD pipelines, automation, and version control
-
Strong communication and stakeholder engagement skills
-
Relevant tertiary qualifications in Computer Science, Information Technology, Engineering, or related disciplines
Highly Desirable
-
Experience working with Generative AI solutions or AI platforms
-
Experience supporting AI-enabled products and services
-
Experience processing unstructured content for AI use cases
-
AWS certifications (e.g. AWS Certified Data Engineer – Associate)
-
Experience working within large-scale enterprise or government cloud environments
-
Experience working within Agile delivery teams
Technical Environment
-
AWS Cloud
-
Python
-
Kubernetes
-
Infrastructure as Code
-
Data Integration & Processing Pipelines
-
Cloud-Native Architecture
-
AI & Generative AI Platforms
Why Join?
-
Contribute to a high-profile Federal Government AI transformation initiative
-
Work within a greenfield AWS environment building foundational AI capabilities
-
Exposure to cutting-edge Generative AI technologies and cloud-native engineering practices
-
Collaborate with highly skilled cloud, data, security, and AI specialists
-
Long-term contract opportunity with extension potential
If you’re passionate about cloud data engineering and want to help build the data foundations that power next-generation AI solutions, we’d love to hear from you.