Job description
DATA ENGINEER - DATA - INSURANCE
We are recruiting a Data Engineer for our client, a large UK insurance group. Working alongside other Data Engineers and Data Architects you will be responsible for collecting, storing, processing, and analysing huge sets of data in a cloud-based data lake on Azure. We're looking for someone with ideally a couple of years' experience as a Data Engineer who can design, develop, implement, monitor & maintain key deliverables to support the business's growing need for data consumption.
If you have 'Big Data' experience and able to conduct Enterprise Data modelling for Analytics, and are passionate about data and how impactful it can be then this may be the role for you…
About our client
A leading provider of private insurance in the UK, and the name behind several other big household insurers. Our client are going through an exciting time of digital transformation, and this role is integral to a number of business-wide changes both now and in the long-term.
Location: hybrid working, with visits at least twice a week to our client's office in Tunbridge Wells, Kent, or Chesterfield, Derbyshire.
Competitive Salary and Benefits, based on experience
Key tasks will include but not limited to:
- Build ingestion pipelines in the cloud-based Data Lake to accommodate multiple data sources
- Interrogate and model data from multiple sources, translating into an Enterprise useable logical data model fit for Analyst consumption.
- Thorough data and understanding of business processes, advise on Analytical uses in Insight
- Provide guidance and translation to Analysts on how to interpret and navigate the data for specific use case.
- Help the Data Architect to create an overview of the Data Lineage (from data flows, data transformations inside applications to Analytical output)
- Apply Machine Learning and Automation techniques to processes within Lake helping to detect Quality issues with data.
Essential requirements:
- 2+ years working experience as a Data Engineer on Azure
- Working knowledge of Azure Data Factory, Data Lake, DataBricks and Synapse Analytics
- Working Knowledge of Power BI and providing optimised data sets that can be fully utilised by the product.
- Experience with integration of data from multiple data sources
- Machine Learning, AI and Automation techniques for Data Management & Analytics
- Awareness of Data Management best practice, including Data Lifecycle Management across Core IT & Big Data ecosystems as well as Data Privacy & Security constraints
- Experience in the following would be of benefit: Python, Spark, R , SQL, .net, Java, C++
