Educational requirements: Bachelor
English requirements: Competent English
Requirements for skilled employment experience for years: 1-3 years
Required residence status: Temporary visa, Permanent resident, Citizen
Accept remote work: unacceptable
We are seeking a skilled and experienced Data Platform Engineer/Administrator to join our team. As a Data Platform Engineer/Administrator, you will be responsible for deploying and managing various data analytics tools on AWS infrastructure in line with performance, availability, compliance, and security requirements.
Responsibilities:
Deploy and manage various data analytics tools on AWS infrastructure in line with performance, availability, compliance, and security requirements
Utilize CI/CD pipelines to ensure seamless delivery of changes
Keep up Hadoop clusters and other resources in the Hadoop ecosystem running smoothly in production
Articulate technical problems and ideas, and help build better processes and practices
Qualifications:
In-depth understanding of Spark and good knowledge of at least one or more of the following technologies: Airflow, Trino/Presto, Ranger
Experience with managing AWS, including the entire platform
Experience in keeping up Hadoop clusters and other resources in the Hadoop ecosystem running smoothly in production
Familiarity with CI/CD pipelines
Bonus Qualifications:
Experience with Python development
Experience managing Cloudera clusters
We offer a competitive salary, excellent benefits, and the opportunity to work with a dynamic and passionate team. If you have a passion for big data and a desire to learn and develop your skills, then we want to hear from you.
