Head of Data Engineering

Posted 23 September 2024
Salary £110000 - £125000 per annum
LocationCity of London
Job type Permanent
Discipline Change & Project Management
ReferenceDB1986_1727111001
Contact NameDean Burns

Job description

Summary

We are partnered with a leading data consultancy firm specialising in delivering end-to-end data engineering, analytics, and cloud-based solutions to their clients. They are looking for a remote (UK based) Head of Data Engineering to lead on technical decision making and architecture.

Responsibilities



Strategic Leadership

  • Provide trusted leadership for the company's data engineering and technology strategy, aligning it with business objectives and client needs.
  • Collaborate with the executive team to define the technology roadmap, setting priorities for data architecture, cloud infrastructure, and analytics solutions.
  • Act as a trusted advisor for clients, guiding their data strategy and helping them maximise their investments in AWS cloud infrastructure and data engineering solutions.


Technical Leadership & Architecture

  • Own the end-to-end architecture of data platforms on Amazon Web Services (AWS) (S3, Redshift, Glue, Lambda, etc.).
  • Architect and design scalable, secure, and cost-efficient data solutions, focusing on data pipelines, storage, transformation, and analytics platforms.
  • Oversee and provide guidance on AWS-native services
  • Define best practices for data governance, data quality, metadata management, and security within the AWS environment.


Hands-On Implementation & Delivery

  • Actively participate in building, coding, and optimising data engineering solutions. Ensure solutions are delivered with high quality and performance.
  • Develop, deploy, and manage complex ETL/ELT pipelines using AWS Glue, Lambda, Redshift, and other AWS services.
  • Implement and manage data modelling, database optimisation, and data warehousing practices in Amazon Redshift or other SQL-based environments.


Data Engineering:

  • Expertise in building robust ETL/ELT pipelines.
  • Proficiency with SQL, Python, Spark, and/or Scala for data transformation and processing.
  • Solid experience with data modelling, data warehousing, and big data architectures.
  • Experience with AWS CodePipeline, CodeDeploy, and CloudFormation for CI/CD pipelines, infrastructure as code, and automated testing.
  • Knowledge of Kubernetes, Docker, or other container orchestration tools is beneficial.

Experience:

  • 3+ years of experience in a leadership or strategic role, ideally within a consulting or client services environment.
  • Deep familiarity with Amazon Web Services (AWS) and its data services.
  • Experience leading multi-disciplinary teams and delivering data projects.

Compensation:

  • Remote working
  • £110k - £125k
  • Budget for training courses and upskilling