
Data Engineer
The Data Engineer will have a broad understanding of data profiling, data modelling and data governance to assist senior team members and stakeholders to improve regulatory processes and outcomes.
The Data Engineer will be required to:
Key Responsibilities/Accountabilities
* Participate and collaborate in a high performing SCRUM team to deliver on key BAU activities and milestones from the Project Roadmap, and Data Science and Analytics Strategy.
* Demonstrate excellent judgement skills at interpreting business requirements, estimating workloads, prioritizing tasks, and managing time in the delivery of quality solutions to meet deadlines.
* Communicate well and respectfully through all written and verbal interactions.
* Conduct or facilitate feasibility, requirements gathering, user acceptance, demonstration, or other meetings with team and with customers.
* Provide technical guidance and be a role model to BI Developers, Data Scientists, and junior engineers.
* Develop highly performant, efficiently administered, cost considerate, and fully secure data pipeline solutions.
* Support, maintain, and upgrade existing data workflows, deployment pipelines, and infrastructure environments through all stages of application life cycle management.
* Participate in rotating incident management duties which includes troubleshooting and resolving incidents, performing RCAs, configuring monitoring, and writing troubleshooting guides.
* Operate using modern CI/CD methods with automated testing, code reviews, and CAB approved releases.
Skills and Capabilities
* Proven skills with ETL/ELT packages, pipelines, or integrations
* Proven skills with RMDBS systems and concepts including normalization, data modelling, schemas, etc
* Proven skills with object-oriented programming, design patterns, unit testing, CI/CD, and debugging
* Demonstrated knowledge of Microsoft BI Stack, SQL Server, Integration Services, Analysis Services, Azure Data Factory, Databricks, DevOps
* Demonstrated knowledge of Java, Python, R, Power Query M, or DAX languages
* Demonstrated knowledge of Big Data concepts: structure, unstructured, streaming, data lake, governance, lineage, etc
* Strong critical thinking abilities enabling one to problem solve, analyse complex systems, an optimize solutions
* Strong self-motivation enabling one to upskill oneself, improve one’s knowledge, and investigate issues
* Strong attention to detail
Qualifications and Experience
Essential to the Role
* Bachelor’s degree in Information Technology, Computer Science or equivalent IT work experience
* Minimum of three years Data Engineering experience with proven skills using analytic software
* Experienced member of SCRUM and agile teams
* Experienced with project management, SDLC, and data life cycle processes
If you would like to find out more about this opportunity, Talent and everything in-between, don’t hesitate to call Brid Coughlan on 0439 213 636 for a confidential discussion.
brid.coughlan@talentinternational.com
https://www.linkedin.com/in/brid-coughlan/