ENVIRONMENT:

OPTIMIZE data pipelines for performance, scalability, and reliability as the next Data Engineer sought by a dynamic Retail and Consumer Finance Concern in Joburg. The ideal candidate will use their passion for Big Data & Analytics to provide insights to the business covering a range of topics. You will play a critical role in the development and maintenance of data infrastructure while ensuring data availability, quality, and accessibility for analysis. You must possess a Bachelor’s Degree in Computer Science/IT or similar discipline, have relevant Certifications such as AWS Certified Data Analytics, Google Cloud Professional Data Engineer and have 5-10 years’ experience and understanding in designing and developing data warehouses according to the Kimball methodology. You will also need proficiency with SQL, Python/R, Scala, Java, Snowflake, Redshift, AWS, SAS Data Studio & ETL tools.

DUTIES:

• Collaborate with Data Scientists, Analysts, and business stakeholders to understand data requirements.
• Design, develop, and maintain data pipelines and ETL processes.
• Implement and maintain data warehousing and data storage solutions.
• Optimize data pipelines for performance, scalability, and reliability.
• Ensure data quality and integrity through data validation and cleansing processes.
• Monitor and troubleshoot data infrastructure issues.
• Stay current with emerging technologies and best practices in Data Engineering.
• Systematic solution design of the ETL and data pipeline in line with business user specifications.
• Develop and implement ETL pipelines aligned to the approved solution design.
• Ensure data governance and data quality assurance standards are upheld.
• Deal with customers in a customer centric manner.

REQUIREMENTS:

Qualifications –

• Bachelor's Degree in Computer Science, Information Technology, or a related field.
• Relevant Certifications (e.g., AWS Certified Data Analytics, Google Cloud Professional Data Engineer).

Experience/Skills –

• 5-10 Years’ experience and understanding in designing and developing data warehouses according to the Kimball methodology.
• Proven experience as a Data Engineer in a professional setting.
• Proficiency in Data Engineering technologies and Programming languages (e.g., SQL, Python, Scala, Java).
• Strong knowledge of data storage, database design, and data modelling concepts
• Experience with ETL tools, data integration, and data pipeline orchestration.
• Familiarity with data warehousing solutions (e.g., Snowflake, Redshift).
• Excellent problem-solving and troubleshooting skills.
• Adept at design and development of ETL processes.
• SQL development experience, preferably SAS Data Studio and AWS experience. Have the ability to ingest/output CSV, JSON and other flat file types and any related data sources.
• Proficient in Python or R or willingness to learn. Experience within Retail, Financial Services and Logistics environments.
• Redshift Technologies.
• Understanding of data security and compliance best practices.

ATTRIBUTES:

• Effective self-management and teamwork.
• Strong communication and collaboration skills.

While we would really like to respond to every application, should you not be contacted for this position within 10 working days please consider your application unsuccessful.

COMMENTS:

When applying for jobs, ensure that you have the minimum job requirements. OnlySA Citizens will be considered for this role. If you are not in the mentioned location of any of the jobs, please note your relocation plans in all applications for jobs and correspondence. Apply here https://www.datafin.com/job/data-engineer-jhb-2/

OR e-mail a Word copy of your CV to michelle@datafin.com and mention the reference number of the job.