Loading

Connecting Linkedin...

Banner Default Image

Data Engineering Manager

  • Location

    Malta

  • Sector:

  • Job Reference:

    MDT-1927

  • Published:

    29 days ago

  • Expiry:

    28 May 00:00

  • Client Details:

    MeDirect

Data Engineering Manager

Reporting to the Head of IT, the selected candidate will be responsible for managing existing data resources, implementing new technologies and tooling to further enable data science and analytics, The selected candidate will also be responsible for driving scalable data sharing practices and possessing a strong vision on how the central data hub can support multiple business and regulatory objectives.

Duties and responsibilities

  • Driving the vision for Data Warehousing across the products vertical and defining and executing on a plan to achieve that vision;

    • Designing, building and launching efficient and reliable data pipelines to move and transform data

    • Building a platform to run micro ETL batches to process data-sets in near real time

    • Defining the processes needed to achieve operational excellence in all areas, including project management and system reliability

  • Building a high quality Data Warehousing team and organising the team to scale;

    • Establishing the technical direction for the Data Engineering team, driving the necessary changes and making appropriate technology choices by working collaboratively with IT Architects, BI Developers and System Engineers

  • Building cross-functional relationships with Product Managers, BI Developers, Software Engineers and IT Architects to understand data needs whilst delivering on those needs;

    • Collaborating with the Change Management team to define technical requirements and design clarity based on the business requirements

  • Driving the design, building and launching of new data models and data pipelines in production

  • Managing the development of data resources and support new product launches

  • Driving data quality across the product vertical and related business areas

  • Ensuring necessary data quality assurance processes are implemented and followed

  • Defining and managing SLAs for all data sets and processes running in production

Required knowledge, skills and experience

  • Degree or Masters in Computer Science or any other related technical field

  • A minimum of 7 years' experience in data engineering and data management with an excellent understanding of data flows, data architecture, ETL and processing of structured and unstructured data

  • A minimum of 7 years' experience designing data warehouse/data lake and ETL architectures

  • A least 3 years of leading modern development approaches (containerisation, cloud, continuous delivery, micro-services)

  • Experience with SQL or NOSQL systems such as PostgreSQL, MongoDB or Redshift

  • Experience managing or leading small to medium sized data engineering teams in a dynamic environment

  • Knowledge of Information Security, Data Privacy laws, and GDPR regulation

  • Experience with the Talend eco-system, toolsets and deployment architecture coupled with banking data experience and knowledge of financial products will be considered an asset