Data Engineer Full Time NEW

City, London
Taylor Hopkinson Limited

Data Engineer for a major offshore wind project in The United Kingdom

Responsibilities

• Design and implement scalable ingestion pipelines from multiple source systems including and internal business data sources.
  Ensure reliable, automated, and monitored data flows into the Bronze layer of the Medallion architecture.
  Work within clients existing security framework to establish compliant connectivity to operational data sources.
  Build and maintain Silver and Gold layer transformations in Databricks using Python and SQL.
  Onboard datasets into Unity Catalog, ensuring proper governance, lineage, and discoverability. Platform Collaboration & Delivery
  Support the ML/Data Scientist in preparing clean, structured datasets for anomaly detection and asset performance modelling.
  Contribute to technical documentation and ensure pipelines are maintainable and transferable.
  Stay current on Databricks and Azure platform developments relevant to the stack.
  Support the Digital & AI Strategy Manager in assessing feasibility of new data source integrations as the roadmap evolves.

  Experience
  Master’s degree in Computer Science, Data Engineering, Software Engineering, or a related technical field.
  Professional certifications in Azure, Databricks preferred
  Training or background in energy systems, renewable energy, offshore wind or BESS technologies is a strong plus.
  4-7 years of hands-on data engineering experience in a cloud environment.
  Demonstrated experience delivering production pipelines on Databricks and Azure (ADLS Gen2, ADF or equivalent).
  Proven ability to implement Medallion architecture or equivalent layered data modelling patterns.
  Experience with REST API ingestion and integration of business systems (ERP, finance tools).
  Experience in a contractor or project-based delivery model preferred.
  Exposure to OT/SCADA environments or energy sector data.
  Exposure to MLOps workflows or collaboration with data science teams.