- Johannesburg
- Salary: Market Related
- Job Type: Permanent
- Sectors: Technology
- Reference: BIT004162/Rein
Vacancy Details
Employer: Network Recruitment
- Architect and build highly scalable distributed systems using open-source tools.
- Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations.
- Work with big data batch and streaming tools to process and analyze data at scale.
- Develop and optimize Extract, Transform, Load (ETL) processes for data pipelines.
- Utilize AWS technologies (EMR, EC2, and S3) for data storage and processing.
- Write and maintain clean, efficient code in Python, PySpark, or Spark.
- Collaborate with cross-functional teams to define data engineering requirements and deliver technical solutions.
- Ensure the smooth operation, performance, and scalability of data infrastructures.
- Continuously improve the reliability and security of data systems.
Requirements:
- Bachelor’s Degree in Computer Science, Computer Engineering, or a related field, or equivalent experience.
- AWS Certification (e.g., AWS Certified Solutions Architect, and AWS Certified Data Analytics).
- Extensive knowledge of programming or scripting languages (Python, Spark, etc.).
- Expert knowledge of data modelling and strong understanding of various data structures.
- Proven ability to architect highly scalable distributed systems using open-source tools.
- 5+ years of experience in data engineering or software engineering.
- 2+ years of experience with big data technologies.
- 2+ years of experience with ETL processes.
- 2+ years of experience working with AWS services (EMR, EC2, and S3).
- 5+ years of experience with object-oriented design, coding, and testing patterns.
- Hands-on experience with Talend for data integration.
- Strong experience with big data batch and streaming tools.
- Solid background in developing commercial or open-source software platforms and large-scale data infrastructure.
Apply now!
For more IT jobs, please visit www.networkrecruitment.co.za
If you have not had any response in two weeks, please consider the vacancy application unsuccessful. Your profile will be kept on our database for any other suitable roles/positions.
For more information contact:
Reinie Du Preez
Senior Specialist Recruitment Consultant
E-mail: rdpreez@networkrecruitment.co.za
70 people have viewed this job.
About Network Recruitment
Network Recruitment
Network Recruitment is a leading specialist recruitment company in the fields of IT, Finance and Engineering.
Since our establishment in 1987, we have been at the forefront of the specialist recruitment industry. Network Recruitment’s key to success is the focus on delivering superior quality service by developing and maintaining an exclusive focus on sourcing high-calibre skills for medium-sized to JSE-listed companies operating in these three niche sectors across South Africa.
Our experience in permanent and contract-based recruitment enables us to provide you with recruitment solutions that meet your long- and short-term needs.
Network Recruitment is a division of ADvTECH Resourcing, the recruitment arm of the national JSE-listed ADvTECH Limited Group a leader in quality education, training, skills development and placement services.
Similar Jobs
Senior Data Engineer
- Pretoria
- Job Type: Permanent
- Posted 04 Feb 2025 | 5 Days left
Intermediate/Senior Data Engineer
- Johannesburg
- Job Type: Permanent
- Posted 14 Mar 2025 | 43 Days left
Senior Data Engineer
- Pretoria
- Job Type: Permanent
- Posted 19 Mar 2025 | 3 Hours left
Data Engineer at Planet42
- Gauteng
- Job Type: Permanent
- Posted 19 Mar 2025 | 48 Days left
More Jobs at Network Recruitment
Intermediate Full Stack Developer
- Centurion
- Job Type: Permanent
- Posted 01 Apr 2025 | 30 Days left
Full Stack Developer
- Johannesburg
- Job Type: Permanent
- Posted 01 Apr 2025 | 30 Days left
Financial manager
- Johannesburg
- Job Type: Permanent
- Posted 01 Apr 2025 | 30 Days left
Junior Financial Manager
- Johannesburg South
- Job Type: Permanent
- Posted 01 Apr 2025 | 30 Days left