Cloud Data Engineer

  • Full Time
  • Cape Town, City Centre, South Africa

AGA Recruitment Specialists


Our client is looking for a Data Engineer to be situated at their office in Cape Town, developing their major data infrastructure components and data products. You will be working on the team that owns the data warehouse and analytics products. This includes predictive models for various aspects of the business. You will be working primarily within the Google Cloud Environment using a variety of the tools that Google offers from Biquery and Dataproc to Kubernettes and AI Hub. You should ideally dream in Python and speak SQL. You should not be afraid to dive into dirty data and help the team make sense of it. Our client believes in healthy work life balance, offers 2 duvet days a week, and provides free courses for consistent training and development.

Duties & Responsibilities

Contribute to low level solution design workshops with fellow team members during whiteboard sessions

Work closely with peers in the business to fully understand the business process and requirements

Work closely with other teams when necessary to create software that is cohesive

Build and maintain scalable data products

Take ownership at all stages of the product development life cycle

Deliver well-tested and reviewed solutions

Desired Experience & Qualification


BSc or B-Tech in Computer Science or IT preferred
5+ years development experience working with Python
Data skills (Traditional SQL and No-SQL)
Large scale ETL
High scale Restful Services
Cloud experience (Google Cloud Platform, Azure, or AWS)
Git Bonus skills
Scheduling and Orchestration (Airflow/Composer)
Containerisation (Kubernetes, Docker)
Elastic search or Solr
Data Warehousing concepts
Data governance Concepts.
Apache beam (Cloud Dataflow)
Apache Spark (Dataproc)
Department wide tech stack includes: Android, iOS, and React native to .NET Core, Redis, ElasticSearch, SQL Server, Azure, and GCP.

Leave us your email address and we'll send you all of the new jobs and details