Senior Data Engineer & Technical Lead

Senior Data Engineer & Technical Lead

5Th Dimension Consulting

Senior Data Engineer & Technical Lead

Details of the offer

Job Role Be part of a highly dynamic and analytical team working in an agile environment.
Responsible for Designing and Developing solutions to meet business outcomes; sourcing and transforming a wide range of data across our business into formats that can be used by analysts and end users to develop differentiating business insights.
Design and develop analytical modules using the specified toolsets to enable the analytical teams and business to create and analyze complex analytical models.
Build knowledge of data and information and use the technology to make use of the features therein to deliver value to the business.
Not only design and develop, but also investigate data issues, troubleshoot technical issues and devise solutions in line with best practice.
Design, document and communicate technical solutions that deliver on business requirements.
Fulfil the role of subject matter expert on all technical aspects of BI Solution Development.
Ensure and validate Quality of all BI development / modelling activity incl. code reviews, issue resolution and general support.
Assemble large, complex data sets to meet functional / non-functional business requirements.
Build the infrastructure required for optimal Extraction, Transformation, and Loading (ETL) of data from a wide variety of data sources using various ‘big data’ technologies.
Resolve critical data modelling issues impacting the functionality of BI products in production.
Help streamline a better data supply chain for advanced analytics that goes from experimentation into production.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing models for greater scalability.
Develop technical standards and best practices.
Identify opportunities to enhance and automate technical processes and solutions across BI projects and support operations.
Engage with a wide range of technical stakeholders including Data scientists, Business analysts, other Data engineers and Solutions architects.
Work with data and analytics experts to strive for greater functionality in our data systems.
Support data stewards to establish and enforce guidelines for data collection, quality improvements, integration and processes.
IT Degree/Diploma and/or certification
5 to 8 years related experience
4+ years' experience as a data engineer / modeller in a BI environment.
2+ years' experience as an Architect in a BI environment.
Skills/ Knowledge
Ability to comply to and manage reusable assets under the governance framework of the DSUA and MOU.
Excellent SQL skills.
Ability to code in Java, Python, R plus other languages - advances, including understanding of SDLC, GIT, Code management / standards / re use and API integration (Expert).
Ability to do cost estimations for new workloads.
Strong data modelling / engineering background with the ability to interpret business requirements and technical solutions to develop components of or complete data models.
A solid background in SQL, application and information architecture and ETL procedures.
Experience working on SAP Hana & Cloudera is preferred and highly advantageous.
Experience with object-oriented/object functional scripting languages: Python, Java, C++, Scala or related is preferred but not essential.
Data warehousing principles based on Kimball and Data Vault patterns.
Development experience in BI.
Agile Development.
Development using Java, SQL, etc.
Development of data warehousing blueprints.
Data warehouse management.
Translation of business needs into long-term architecture solutions.
Define, design and builds dimensional databases.
Object and data models.


Head of supply chain management

Job OverviewLocation: GautengPosition Overview:The Head of Unit, Supply Chain Management leads the supply chain management function, including development and...

From Professional Sourcing - Gauteng

Published a month ago

Chief executive:transnet pipelines

This advert is open for application by external applicants. Equity Statement :Preference will be given to suitably qualified applicants in line with Transnet’s...

From Transnet - KwaZulu-Natal

Published a month ago

Ncr logistics technician

Req ID:71473 We create smart innovations to meet the mobility challenges of now and the future. We design and manufacture a complete range of transportation...

From Alstom - Gauteng

Published a month ago

Source to pay coe planning and performance lead

Role Summary: Baker Hughes has an opportunity for a Source to Pay Center of Excellence (CoE) Planning and Performance Lead based in Johannesburg, South Africa...

From Baker Hughes - Gauteng

Published 21 days ago