Data Engineer
Hybrid (3 days onsite, London, Newcastle or Coventry)
£358 p/d (Inside IR35)
My client is looking for a Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data processes and techniques used in the Advanced Data Analytics Portfolio (DAP). In this role, you will collaborate with project managers, data scientists, fraud prevention experts, stakeholders, and senior management across a wide range of projects.
Your primary responsibilities will include developing and maintaining data pipelines, processing data, and preparing data for analysis. You will also evaluate, maintain, and manage these data pipelines, develop and refine data models, and support the design of analytical services, products, and models tailored to stakeholder needs.
Additionally, you will guide the development, documentation, and maintenance of data pipelines and storage solutions used in the analytics environment, ensuring the infrastructure is secure, optimised, and scalable within the cloud computing ecosystem.
Key Essential Skills:
- Practical implementation of data solutions using Azure tech stack (Data Factory, Data Lakes, Notebooks, Synapse Warehouse)
- Experience with varied data sources (On-Prem databases, Data Lakes, ERP systems)
- API integration
- Complex data transformation using PySpark, SQL, and optimisation techniques
- Strong understanding of data modelling and warehousing concepts
- Data documentation and reporting
- Basic machine learning experience
It would be advantageous if you had any knowledge of Fabric
Please
