Educational requirements: Bachelor
English requirements: Competent English
Requirements for skilled employment experience for years: 3-5 years
Required residence status: Temporary visa, Permanent resident, Citizen
Accept remote work: unacceptable
Reporting into the Head of Digital Technology, the Senior Data Engineer is responsible for the preparation, maintenance and operation of pipelines that deliver large, complex datasets, that form the basis of analysis, dashboards, statistical analysis & modelling as well as data quality analysis. You will also deliver standards and practices for data architecture and engineering; data system design, development, and operation; conceptual, logical, and physical data modelling. In this role you will work closely with numerous SCA stakeholder groups to deliver data-driven solutions.
Day to day: • Prepare, maintain and operate SCA data pipeline infrastructure • Work closely with numerous SCA stakeholder groups to capitalise on useful data to drive better insights • Act as a Data custodian responsible for the sourcing, and preparation of quality and trusted data for the use of the extended team • Builds and deploys machine learning and analytics models into production. • Facilitate faster Data collection process by improving technology/infrastructure over time • Efficient data discovery with new CDP infrastructure • Implement improvement working models, adopting best practices working with AI/ML partners • Acquiring, ingesting, and processing data from multiple sources and systems into our data platforms • Aid in the adoption of best practices design for SCA databases in order to cater to downstream reporting, AI/ML solutions
Qualifications & Experience • Degree qualified in Business Analytics, Engineering, Data Science (Desirable) • Strong understanding of distributed systems, especially Hadoop, Spark, Airflow, BigQuery • Understanding of ETL, Big data pipeline • Strong programming skills Python, Java/Scala • High level understanding of design patterns • Expertise with a diverse range data modelling technique’s • Superior communication skills and ability to work as part of cross functional teams.
