- Cape Town
- Salary: Market Related
- Job Type: Permanent
- Sectors: Technology
- Reference: BIT003456/Muld
Vacancy Details
Employer: Network Recruitment
- Design and implement scalable data pipelines using Apache Spark, Scala, and Java
- Develop and maintain data architectures for batch and real-time processing
- Collaborate with cross-functional teams to identify and prioritize project requirements
- Optimize data processing performance, scalability, and reliability
- Ensure data quality, security, and compliance
- Mentor junior data engineers and contribute to knowledge sharing
- Stay up-to-date with industry trends and emerging technologies
- Relevant Degree
- 6+ years of experience in data engineering (Spark, Scala, Java)
- Apache Spark (Core, SQL, Streaming)
- Scala programming language
- Java (Java 8 and above)
- Gradle build tool
- Data architectures (batch, real-time, lambda)
- Data storage solutions
- Big Data technologies (Hadoop, Hive, Impala)
- Cloud platforms (AWS, Azure, Google Cloud)
- Agile development methodologies
- Version control systems (Git)
- Excellent problem-solving, analytical, and communication skills
- Apache Kafka, Apache Flink, or other streaming technologies
- NoSQL databases (MongoDB, Couchbase)
- Data science concepts (machine learning, R, Python)
- Containerization (Docker)
- Orchestration tools (Apache Airflow, Kubernetes)
- Certification in Spark, Scala, or Java development
- Familiarity with DevOps practices
For more IT jobs, please visit www.networkrecruitment.co.za
If you have not had any response in two weeks, please consider the vacancy application unsuccessful. Your profile will be kept on our database for any other suitable roles / positions
For more information contact:
LaReine Mulder
Specialist Recruitment Consultant
larmulder@networkrecruitment.co.za
011 622 9526
42 people have viewed this job.
About Network Recruitment
Network Recruitment
Network Recruitment is a leading specialist recruitment company in the fields of IT, Finance and Engineering.
Since our establishment in 1987, we have been at the forefront of the specialist recruitment industry. Network Recruitment’s key to success is the focus on delivering superior quality service by developing and maintaining an exclusive focus on sourcing high-calibre skills for medium-sized to JSE-listed companies operating in these three niche sectors across South Africa.
Our experience in permanent and contract-based recruitment enables us to provide you with recruitment solutions that meet your long- and short-term needs.
Network Recruitment is a division of ADvTECH Resourcing, the recruitment arm of the national JSE-listed ADvTECH Limited Group a leader in quality education, training, skills development and placement services.
Similar Jobs
Senior Data Engineer
- Western Cape
- Job Type: Permanent
- Posted 04 Sep 2024 | 45 Days left
Senior Data Solutions Engineer
- Cape Town
- Job Type: Permanent
- Posted 30 Jul 2024 | 9 Days left
Data Engineer
- Western Cape
- Job Type: Permanent
- Posted 04 Sep 2024 | 45 Days left
Senior Data Engineer (Western Cape)
- Cape Town
- Job Type: Contract
- Posted 09 Sep 2024 | 50 Days left
More Jobs at Network Recruitment
Full Stack Developer
- Johannesburg
- Job Type: Permanent
- Posted 20 Sep 2024 | 30 Days left
Finance Business Partner
- Cape Town
- Job Type: Permanent
- Posted 20 Sep 2024 | 30 Days left
Java Developer
- Johannesburg
- Job Type: Permanent
- Posted 20 Sep 2024 | 30 Days left
Junior Devops Engineer
- Johannesburg
- Job Type: Permanent
- Posted 20 Sep 2024 | 30 Days left