Lead Data Engineer

Added 26th March 2025

We are on the lookout for an experienced Lead Data Engineer to take on a leadership role within our client’s Data Engineering team, driving technical excellence and transforming data ingestion processes. You will be responsible for implementing the Data Engineering strategy, working closely with the Head of Data Engineering to define best practices, and collaborating with Project teams to ensure technical specifications and tasks are clear and achievable for all team members.

 

Responsibilities

- Lead data engineering projects and mentor junior team members

- Implement the data engineering strategy in collaboration with the Head of Data Engineering

- Define testing frameworks for validating and transforming synthetic data

- Set best practices for containerisation and deployment to Kubernetes clusters

- Conduct monthly AWS cost reviews with DevOps to identify savings and optimise resources

 

Essential Skills

- Experience in lead data engineering or similar senior role, with strong leadership and architecture design experience

- Advanced Python and SQL skills

- Hands-on experience with Apache Kafka, Apache Spark, and Delta tables

- Proficient in Airflow and message brokers (e.g. RabbitMQ, AWS SQS)

- Expert-level knowledge of Docker and Kubernetes

Apply now

Location

South East

Salary

Up to £80,000 pa

Industry

Retail

Contract Type

Permanent

More roles that might suit you

Job title Location Type Salary

Remote

Contract

Please contact us

Remote

Contract

Please contact us

West Midlands

Permanent

Up to £80,000 pa

Can’t find the role for you?

Upload CV