Lead Data Engineer

Location London
Job type: SEED - Permanent
Salary: £60000 to £110000
Contact name: Will Hurrell

Contact email: will@becksfordgroup.com
Job ref: Engineer
Published: 10 days ago
Startdate: ASAP

Becksford Group have partnered exclusively with a top digital transformation consultancy (FTSE 250) that are looking for an ambitious Lead Data Engineer. The Lead Data Engineer will be hands on for part of the job but be able to manage a team of Data engineers.

The Package

  • Up to £110k

  • 1/2 days a month in office, remote rest

  • 35 days flexi leave (can buy 5 more or sell 10)

  • health cover

  • discretionary annual shares (300)

  • 5% matched pension

  • twice yearly promotion opportunity

  • annual pay review

  • Flexi-Time

The Role

As a Lead Data Engineer (Consultant) at a FTSE 250, you will be responsible for designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Lead Data Engineers provide strong development leadership for team members and take responsibility for the quality of the codebase as well as the match to user needs.

You will manage, coach and develop a small number of staff, with a focus on managing employee performance and assisting in their career development. You’ll also provide direction and leadership for your team as you solve challenging problems together.

Key Skills

  • Experience of leading a team of engineers in the implementation of data-intensive system components

  • Experience of applying standards for design (patterns), development, (style guides) and operational readiness (automation, deployment)

  • Proficient software development experience in one of Java, Scala, or Python

  • Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks.

  • Expert in SQL or SQL extensions for analytical use case

  • Expert understanding of distributed data stores and data processing frameworks

  • Ability to simply and clearly communicate technical design both written and verbally

  • Proficient in designing analytical and operational data models

  • Comfortable with Data Warehouse methods and techniques

  • Actively shares their thoughts and views on data practices

  • AWS/Azure/GCP Certified in Data Services

  • Expertise in continuous improvement and sharing input on data best practice

  • Participation in development and/or technology communities


  • Taking responsibility for the development of whole components or subsystems within a team. Development incorporates design, code, test and defect resolution.

  • Focusing on hands-on design and development, using open source and commercial platforms.

  • Defining and enforcing development best practice and coaching team members to ensure consistency.

  • Working with project architects, taking responsibility for non-functional needs of ETL/ELT data processing pipelines such as robustness and performance.

  • Taking responsibility for standards and execution of unit and integration testing done within the team.

  • Taking responsibility for software product due diligence and integration.

  • Leading troubleshooting and tuning of activities.

  • Working with Operations teams to ensure the application software is operationally ready.

  • Working with Security Architects and accreditors to ensure compliance with relevant legal and security requirements

  • Advising customers and managers and other team members of the estimated effort and technical implications of user stories and user journeys.

  • Contributing to technical proposals as part of the sales process.

  • Managing, coaching and developing a small number of staff, with a focus on managing employee performance and assisting in their career development. You’ll also provide direction for your team as you solve problems together