Data Engineer

Johannesburg South
Salary: Market Related
Job Type: Permanent
Sectors: IT
Reference: JHB006488/Ruan

Apply before Nov 28 2024 | 29 Days left

Apply

External Application

Vacancy Details

Employer: Datacentrix (Pty) Ltd

Datacentrix's Insurance client is seeking a skilled Data Engineer to join their team on a 12 month contracting basis to be based onsite in Parktown. As a Data Engineer, you will be responsible for developing and maintaining data warehouse solutions, ETL processes, and data modeling. You should have expertise in Advanced TSQL scripting, building SSIS pipelines, and working with various data formats such as CSV, TXT, XML, JSON, XLS, XLSX. The ideal candidate must have 8+ years experience in design, build and support of data engineering pipelines.

Core requirements

Advanced TSQL scripting: stored procedures, views, functions
Building and maintaining SSIS pipeline
Data warehousing & modelling
Working with CSV, TXT, XML, JSON, XLS, XLSX. Etc
Data Analysis
Working with relational databases
Building and maintaining SSRS reports
Using GIT
CI/CD pipelines
Performance monitoring and tuning

Responsibilities

Maintain, support, and monitor existing production SSIS packages and SQL Queries and Stored Procedures, CICD pipelines to make sure all data loads on data warehouse meet data quality standards and business SLA requirements.
Build, maintain, support, and monitor Synapse data engineering pipelines on data platform if required.
Participate and contribute to data architecture design, data modelling, gathering and analysis of data requirements; understand document, communicate, and build appropriate solutions.
Participate, design, build, deliver, and document data related projects with various environment specific data analytics technologies.
Promote data engineering best practices with CICD pipelines and automation.
Collaborate and work closely with team members and contribute significantly to building a high performing, collaborative, transparent, and result-driven data engineering team.
Support the Data Engineering Practice Team Manager with best fit-to-purpose data engineering solutions, quality engineering artifacts and high standard documentation.
Follow Data Ethics standards to protect personal information and do the right thing to meet our customers’, partners’, and community’s expectations.

Skills and Experience

8+ year demonstrable experience in design, build and support of data engineering pipelines in the data warehousing, data ingestion, cleansing, manipulation, modelling and Reporting.
Experience in ETL using Microsoft technologies.
Strong experience in writing MS SQL server queries, stored procedures, and SSIS Packages.
Experience with SSRS would be an advantage.
Experience of manipulating semi-structured data (XML, JSON)
Strong knowledge and extensive experience in working in an Agile framework with CI/CD using modern DevOps / Data Ops integrated processes with YAML pipelines.
Bachelor’s degree in computer/data science technical or related field is a must. Post-graduate is highly regarded.
Knowledge of Azure Synapse data engineering pipelines, PySpark notebooks, data platform lake house architecture and Azure SQL ODS storage is desirable.

Apply

287 people have viewed this job.

About Datacentrix (Pty) Ltd

At a Glance

Our Business:

Datacentrix is a leading, empowered ICT integrator that provides high performing and secure ICT solutions to corporate South Africa and the country’s public services sector.

Our Footprint:

Datacentrix operates from regional branch offices in Pretoria, Samrand, Johannesburg, Cape Town, Port Elizabeth, East London and Durban, with a network of small medium enterprises (SMEs) and service personnel around South Africa that are responsible for servicing remote areas.
Our Partners: Datacentrix’ global partnerships with its technology partners remain critical to the company’s success. The company is accredited by its vendors at the highest possible level both in the technical and sales arenas, which enhances the company’s strategic value as a single source service provider.

To achieve this, Datacentrix invests in its people through training and education, embracing broad based black economic empowerment (BBBEE), while actively partnering and representing leading technology partners with distinction.

Vision

Datacentrix intends to become the preferred ICT partner to the majority of South Africa's top commercial and public sector organisations over the next five years.