Job description
Data Engineer
Inside IR35
Remote with some attendance to client site in Surrey as required
Working for a market leading insurance company, you will work in a team of data & AI Engineers, data scientists, developers, analysts and architects and work on the design and build out of cutting-edge machine learning and AI services, supporting analytics and product iteration across a wide range of business areas.
Key tasks:
Build and support data products within their industry leading platform
Work with product managers, data & AI engineers to deliver technical solutions for our most pressing data problems including GenAIapplications
Design, build, and maintain the data and analytics platform’s components to enable seamless data consumption and usage, including orchestration, monitoring, and performance optimization.
Integrate data from a variety of sources, assuring that they adhere to data quality and technical standards
Creating frameworks and processes for data pipelines across the data and analytics platform
Establish and uphold coding and data process standards across the platform, actively promoting and enforcing best practices.
Key skills:
A passion for designing and building a robust data platform
Strong hands-on experience with modern cloud data warehouses such asDatabricks/Snowflake, ideally on AWS
Strong Python experience, including deep knowledge of the Python data ecosystem, with hands-on expertise in Spark and Airflow
Hands-on experience in all phases of data modelling from conceptualization to database optimization supported by advanced SQL skills
Hands-on Experience with implementing CICD, using Git, Jenkins or similar technologies.
Solid hands-on experience implementing batch and real-time data integration frameworks including assessing performance, debugging, and fine-tuning those systems
Demonstrated ability to perform the engineering necessary to acquire, ingest, cleanse, integrate, and structure massive volumes of data from multiple sources
Experience with Terraform or similar Infrastructure as Code (IaC) tools is a plus
Experience with Docker and Kubernetes for containerization and orchestration of data workflows is a plus
Exposure to Generative AI in production is a plus.
GWV Talent Solutions Limited (trading as Gerrard White Consulting and Vermelo RPO) acts as an employment agency for permanent recruitment and an employment business for the supply of temporary and contract workers. By applying for this job you accept the terms of our Privacy Policy and Terms of Service Agreement which can be found at www.gerrrardwhite.com