Senior Data Engineer & Technical Lead

Senior Data Engineer & Technical Lead
Company:

5Th Dimension Consulting


Senior Data Engineer & Technical Lead

Details of the offer

Job Role Be part of a highly dynamic and analytical team working in an agile environment.
Responsible for Designing and Developing solutions to meet business outcomes; sourcing and transforming a wide range of data across our business into formats that can be used by analysts and end users to develop differentiating business insights.
Design and develop analytical modules using the specified toolsets to enable the analytical teams and business to create and analyze complex analytical models.
Build knowledge of data and information and use the technology to make use of the features therein to deliver value to the business.
Not only design and develop, but also investigate data issues, troubleshoot technical issues and devise solutions in line with best practice.
Responsibilities
Design, document and communicate technical solutions that deliver on business requirements.
Fulfil the role of subject matter expert on all technical aspects of BI Solution Development.
Ensure and validate Quality of all BI development / modelling activity incl. code reviews, issue resolution and general support.
Assemble large, complex data sets to meet functional / non-functional business requirements.
Build the infrastructure required for optimal Extraction, Transformation, and Loading (ETL) of data from a wide variety of data sources using various ‘big data’ technologies.
Resolve critical data modelling issues impacting the functionality of BI products in production.
Help streamline a better data supply chain for advanced analytics that goes from experimentation into production.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing models for greater scalability.
Develop technical standards and best practices.
Identify opportunities to enhance and automate technical processes and solutions across BI projects and support operations.
Engage with a wide range of technical stakeholders including Data scientists, Business analysts, other Data engineers and Solutions architects.
Work with data and analytics experts to strive for greater functionality in our data systems.
Support data stewards to establish and enforce guidelines for data collection, quality improvements, integration and processes.
Requirements
Qualifications
IT Degree/Diploma and/or certification
Experience
5 to 8 years related experience
4+ years' experience as a data engineer / modeller in a BI environment.
2+ years' experience as an Architect in a BI environment.
Skills/ Knowledge
Ability to comply to and manage reusable assets under the governance framework of the DSUA and MOU.
Excellent SQL skills.
Ability to code in Java, Python, R plus other languages - advances, including understanding of SDLC, GIT, Code management / standards / re use and API integration (Expert).
Ability to do cost estimations for new workloads.
Strong data modelling / engineering background with the ability to interpret business requirements and technical solutions to develop components of or complete data models.
A solid background in SQL, application and information architecture and ETL procedures.
Experience working on SAP Hana & Cloudera is preferred and highly advantageous.
Experience with object-oriented/object functional scripting languages: Python, Java, C++, Scala or related is preferred but not essential.
Data warehousing principles based on Kimball and Data Vault patterns.
Development experience in BI.
Agile Development.
Development using Java, SQL, etc.
Development of data warehousing blueprints.
Data warehouse management.
Translation of business needs into long-term architecture solutions.
Define, design and builds dimensional databases.
Object and data models.


Source: Jobs4It


Area:

  • Purchase – Logistics – Transportation / Purchasing - Suppliers

Requirements