Senior Data Engineer with AWS-jobs in Gauteng | Imizizi jobs 2022

  • Full Time Part time
  • Gauteng
  • Posted 2 months ago
  • Negotiable USD / Year

Imizizi

Introduction

The services of a Senior Data Engineer are needed for one of our prestigious clients. Suitable candidates are invited to apply.

Duties & Responsibilities

Applies advanced knowledge of area

• Managing projects / processes

• Ability to develop within a specific sought-after programming language

• Strong working knowledge with software development tools, techniques and approaches used to build application solutions

• Working knowledge with software development tools, techniques and approaches used to build application solutions

• Cloud computing technologies, Business drivers and emerging computing trends

Desired Experience & Qualification

At least 10-12 years Cloud architecture and reporting technology experience

• Extensive experience in implementing and monitoring solutions

• Experience in testing (manual or automated testing)

• Web and digital project experience advantageous • Agile working experience advantageous

Relevant IT / Business Degree

Functional Skills:

Understanding of integration between different technologies

• Coordination between development and support environments

• Assisting with the business case

• Planning and monitoring

• Eliciting requirements

• Requirements organisation

• Translating and simplifying requirements

• Requirements management and communication

• Requirements analysis

• Document requirements in appropriate format depending on methodology followed

• Assist with identification and management of risks

Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark.

• Experience with building data pipelines and applications to stream and process datasets at low latencies.

• Show efficiency in handling data – tracking data lineage, ensuring data quality, and improving discoverability of data.

• Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning of high-level data structures.

• Experience designing and supporting large-scale distributed systems in a production environment AWS Solid understanding of Components – VPC | IAM.

Above average experience/understanding of AWS Components:

• Lambda

• DynamoDB

• Param Store

• Secrets Manager

• Athena

• Glue

• CloudWatch

• Step Function

• SNS

• Code Build/Pipeline

• CloudFormation

• S3 Strong experience/understanding of:

• Python 3x

• SQL

• Py Spark

• Boto3

• Terraform

• ETL

• Docker

• Linux / Unix

• Big Data

• Oracle/PostgreSQL

• Powershell / Bash

• Experience working in Agile SDLC methodology.

How to apply?

Apply:  https://www.pnet.co.za/jobs–Senior-Data-Engineer-with-AWS-Gauteng-Imizizi–3336258-inline.html

Job Type: Full Time Part time

Location: Gauteng

Salary: Negotiable

To apply for this job please visit www.pnet.co.za.

Job Overview
Job Location