It Data Engineer: Azure Data Engineer (Data Migration) – Fixed Term Contractor Two Years Global Grade 11

Core purpose of the role Data Engineers are responsible for designing, maintaining, and optimizing data infrastructure for data collection, management, transformation, and access.
They are responsible for creating data pipelines that convert raw data into usable formats for data consumers to utilize.
The role will involve collaborating with Business and IT stakeholders at all levels to ensure that our data management initiatives add value to the business.
Key deliverables and outputs • Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity.
• Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Writes unit/integration tests, contributes to data engineering wiki, and documents work.
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Works closely with a team of frontend and backend engineers, product managers, and analysts.
• Defines company data assets (data models), data pipelines to populate data models.
• Design data integration solutions and data quality approaches for solutions.
• Designs and evaluates open source and vendor tools for data lineage.
• Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.
• Maintains technical and operational metadata during data solution development.
• Has experience in advanced query performance and query optimisation.
• Can develop complex SQL to implement complex business logic.
• Translate the functional requirements to high level design and build technical specifications document.
• Work with internal and external stakeholders to assist with data-related technical issues and support data infrastructure needs.
Internal customers • Business functional teams • IT and digital leadership teams External stakeholders • External customers • IT Service providers Qualification, Experience and Competencies CANDIDATE REQUIREMENTS Academic qualifications Essential: • Diploma in IT related field or equivalent qualification; or • BTech in IT related field or equivalent qualification Advantageous: • Certification in Data Integration technologies • CDMP • Postgraduate degree in IT or related field Work experience Essential: • Four to Ten years practical experience as a Data Engineer/ ETL Developer • Experience in the following technologies – o Three years' experience in Data Factory o Two years' experience in Azure Synapse o Three years' experience in Azure SQL o Two years' experience in PowerBI o One years' experience in Databricks o Five years' experience in SQL • Experience in developing and building data pipelines • Experience in troubleshooting and debugging of data pipelines Advantageous: • Experience in Agile and DevOps squads • Experience in Informatica • Experience in Teradata • Experience in SAP Data Services Knowledge Essential: Skills Essential: • Knowledge of Data Warehousing principles • Working knowledge of Data Integration technologies • Knowledge of scripting languages • Working knowledge of data visualisation libraries • Solid understanding of all the underlying infrastructure, including data integration tools, ETL/ELT processes, data formatting and warehouse architecture • Good knowledge of databases Advantageous: • Understanding of ITIL • Exposure to Agile practices • Strong communication skills • Well-developed interpersonal skills to build relationships.
• Well-developed critical, conceptual, and creative thinking and problem-solving skills to perform in-depth analysis of data and design new Business Intelligence solutions • Excellent mathematical reasoning, analytical and solutioning skills • Strong computer, technology, and systems skills • Ability to work cooperatively with other teams Personal Attributes Essential: • Strong attention to detail • Passion for optimising business performance • Orientation to growing and nurturing relationships • Strong customer centricity • Problem solver • Remaining resilient under stress and pressure • Focus on analysing and solving problems • Preference for thinking practically and laterally Advantageous: • Preference for thinking practically and laterally • Strong inclination for change agility • Preference for team working • Commitment to behaving ethically and correctly • Concern for working within parameters • Concern for communicating clearly • Commitment to maintaining business awareness