
iSanqa
Introduction
Our client requires the services of a Data Engineer/Scientist (Expert)
- Amazing brand with cutting edge technology
- Excellent teams in Global team collaboration
- High work-life balance with Flexible hours
- Agile working environment
POSITION: Contract until December 2024
COMMENCEMENT: As soon as possible
Duties & Responsibilities
ROLE:
Team background:
- We are currently a team of 25 people, mostly very experienced Data Engineers as well as a dedicated Agile Master, Operations Manager, 2 Test Analysts, and a Project Manager. We have grown from being only 4 in 2020 to 25 people in 2021 and for 2022 we have even more growth planned. We have a very diverse team and work very closely with our German GROUP counterparts in Munich. We have more than 25 AWS certifications in our team and multiple professionally certified individuals.
- Certifications are only a nice to have, what we are looking for is someone that can back up their theoretical knowledge with practical data engineering experience.
- Our main goal is to assist GROUP to transform into a data-driven organization by ingesting data into our GROUP Cloud Data Hub and to build data assets on the semantic layer that serve specific business use cases. There is a big backlog of work to do, and we require strong data engineers that can work with great quality without compromising velocity. Great attention to detail is very important. We work with the AWS cloud tech stack as well as Palantir (https://www.palantir.com/).
- Palantir is fairly unfamiliar, and we do not expect that you are familiar with the tool. Our team’s collaborative culture is our biggest asset in this complex place. We are looking for strong team players that can take ownership and initiative.
- Applies advanced knowledge of the area
- Ability to develop within a specific sought-after programming language
- Strong working knowledge with software development tools, techniques, and approaches used to build data engineering solutions
- Cloud computing technologies, Business drivers, and emerging computing trends
- Understanding of integration between different technologies
- Planning and monitoring
- Eliciting requirements
- Requirements organisation
- Translating and simplifying requirements
- Document requirements in appropriate format depending on methodology followed
- Assist with identification and management of risks
Desired Experience & Qualification
QUALIFICATIONS:
- Relevant IT / Business / Engineering Degree
ESSENTIAL SKILLS:
Above-average experience/understanding (in order of importance):
- Terraform
- Python 3x
- SQL – Oracle/PostgreSQL
- Py Spark
- Boto3
- ETL
- Docker
- Linux / Unix
- Big Data
- Powershell / Bash
Basic experience/understanding of AWS Components (in order of importance):
- Glue
- CloudWatch
- SNS
- Athena
- S3
- Kinesis Streams
- Lambda
- DynamoDB
- Step Function
- Param Store
- Secrets Manager
- Code Build/Pipeline
- CloudFormation
ADVANTAGEOUS SKILLS:
- Business Intelligence (BI) Experience
- Technical data modelling and schema design (“not drag and drop”)
- Kafka
- AWS certified developer/architect