
Data Engineer
Join a Government Department working at the forefront of digital transformation in the education and training sector. As a Data Engineer, you’ll play a key role in supporting critical systems and delivering robust data solutions that bridge both operational and project environments.
You’ll work alongside a skilled Data Engineer to design, implement, and maintain scalable data architectures using Microsoft Fabric, Azure Synapse, and other Azure-based tools.
Key Responsibilities
As the Data Engineer, you will:
-
Build, manage, and maintain secure, scalable data pipelines and architectures in hybrid cloud environments using Microsoft Fabric, Synapse, and related tools.
-
Utilise PySpark, PySQL, and Delta Lake formats for data transformation and storage in Fabric Lakehouses.
-
Develop and optimise complex SQL queries and performance-tuned data solutions for analytics and reporting.
-
Collaborate with program and operational teams to ensure seamless transition of data systems to BAU.
-
Monitor and troubleshoot data flows to maintain system availability and data integrity.
-
Align operational data engineering work with broader analytics objectives across the business.
-
Document architectural designs, processes, and troubleshooting procedures.
-
Apply DevOps practices including CI/CD for streamlined deployment and support.
Technical Skills & Experience
-
3+ years in data engineering roles, ideally in hybrid cloud environments.
-
Strong knowledge of Azure Synapse, data lakes, and Microsoft Fabric.
-
Skilled in SQL, SSIS, SSRS, and data transformation using tools like PySpark and PySQL.
-
Proven ability to build and manage robust data pipelines and ensure data quality.
-
Understanding of data modelling (conceptual, logical, and physical).
-
Exposure to machine learning pipelines and data preparation is a plus.
-
Azure Data Engineer Associate certification highly desirable.
To be considered, please click apply now, or contact David Reynolds on 07 3221 3333.