Educational requirements: Bachelor
English requirements: Competent English
Requirements for skilled employment experience for years: 1-3 years
Accept remote work: unacceptable
Your role - Senior Data Engineer
The Senior Data Engineer will be primarily responsible for designing, developing and maintaining data pipelines and contributing to the design and build of the Hireup Data Platform on AWS. This includes enabling our data scientists to develop and productionise machine learning models; and contributing to our data architecture to ensure all teams have the data tools and capabilities they need to achieve their objectives.
Reporting into the Data Platform Engineering Lead, the role will require an experienced engineer who can bring an enablement mindset and modern dataops work practices like CI/CD and containerisation.
Uplift our AWS data capabilities and build out reliable, repeatable ETL/ELT data pipelines and streaming processes to meet consumer needs. Schedule pipelines and tasks using orchestration tools like Apache Airflow or AWS Step Functions. Implement operational monitoring and alerting for data flows. Contribute to dataops engineering frameworks and standards for CI/CD and code standards. Build and maintain our model deployment platform, supporting data scientists with their development workflows and ensuring models can be easily deployed and safely consumed by engineering teams. Help implement new technologies to ensure we have a data stack that is fit-for-purpose.
Your Background
Highly experienced Data Engineer Strong programming skills in Python and SQL Experience in designing, running and optimising data and ML pipelines Experience in data platform (warehouse/lake, deployment platform) design, build and governance Familiarity with AWS, ideally Glue, Athena and CDK Experience with batch data processing using Spark Experience in supporting data scientists to productionise models for simple consumption Experience working with CI/CD and containers Experience with Node.js and Typescript is desirable but not required Approach work with high-energy, drive and internal motivation Exhibit adaptability, resilience, transparency, trustworthiness, passion and innate curiosity Strong connection to, or interest in building an understanding of the Australian disability sector and community
