Back to Job Search

Data Engineer

Job description


Gerrard White is currently seeking a Data Engineer to create, maintain and manage software components, data stores and pipelines that support advanced data analytics for better use and wider consumption of the Company's and its Clients' data. The Data Engineer will work with members of a team to analyse business requirements, design and deliver solutions with a focus on cloud data technologies.

The Data Engineer will be responsible for understanding the Company's and its Clients' requirements so that the appropriate solutions can be de designed and delivered. They are responsible for articulating and documenting those requirements and developing solutions that meet those requirements.


This will include:

  • Work with members the Company's and its Clients' teams to assist in the definition and development of processes and technologies that support secure and efficient data ETL, and provide software solutions for advancing the use of data analytics.
  • Design, write and test code modules that add value to data for reporting and other uses.
  • Integrate applications with other data solutions to improve functionality.
  • Develop solutions that connect to a variety of on- and off- premise Company and Client data sources, ensuring data is cleansed, mapped, transformed and otherwise optimised for storage and to meet requirements for business and technical use cases.

Suitable candidates will have;

  • Microsoft Certified Data Analyst qualification is desirable
  • Azure Certification is desirable
  • A minimum of five years' experience in Data Engineering using Python or SQL or other mainstream language in a data analysis environment
  • A background in software engineering and software development lifecycle is desirable
  • Experience of working with large data sets in an enterprise environment
  • Working with business and technical users to understand, document and agree requirements
  • Logical and physical model design and implementation
  • Create and populate staging areas and data pipelines to perform a range of transformations
  • Experience in Azure data components is desirable, including
    • Azure Data Lake (Gen 1 and 2)
    • Azure Analysis Services
    • Azure SQL Data Warehouse (Synapse Analytics)
    • Azure Data Factory
    • Databricks or similar Spark environment
  • Tools and techniques for ensuring code and data quality, security, validation and recovery
  • Experience of testing tools and performance monitoring is desirable
  • Data reporting and visualisation using Power BI is desirable
  • Understanding of the Insurance industry is desirable


Skills

  • Strong analytical skills, with the ability to adopt a logical approach to solving problems
  • Data exploration, cleansing and preparation
  • Expert Python or SQL coding skills and the ability to apply these to data engineering and analytics
  • Strong data modelling skills
  • Good SQL scripting skills are desirable
  • Good time management and organisation skills
  • Identification and management of risk
  • Ability to create and maintain sets of reference architecture documentation


Knowledge

  • Microsoft Azure cloud data architectures
  • Azure Databricks / Spark knowledge is desirable
  • Microsoft Power BI knowledge is desirable
  • Knowledge of Data Warehousing principles is desirable
  • Knowledge of a structured yet agile approach to delivery
  • Knowledge of analysis, design and modelling techniques
  • Knowledge of system and use case modelling and requirements gathering techniques
  • Knowledge of Architectural patterns

Similar Jobs

View All Jobs
Commercial Legal Assistant Part-Time
Seaford£24000 - £30000 per annumPermanent

Commercial Legal Assistant Our client, a well-respected law firm specialising in a wide range of legal services, is known for its commitment to delivering exceptional client care and expertise. In ...

7.5 Tonne Driver
Leeds£25462 - £32600 per annumPermanent

7.5 Tonne Driver Wanted – Join Our Fast-Moving Team! We're looking for a reliable and professional 7.5T Driver to join our growing team. If you’ve got a valid CPC, Digi Tacho card, and love being o...

7.5 Tonne Driver
Bristol£25462 - £32600 per annumPermanent

7.5 Tonne Driver Wanted – Join Our Fast-Moving Team! We're looking for a reliable and professional 7.5T Driver to join our growing team. If you’ve got a valid CPC, Digi Tacho card, and love being o...

Private Client Legal Assistant
Peacehaven£24000 - £30000 per annumPermanent

Private Client Legal Assistant A long-established and well-respected high-street law firm is seeking a Private Client Legal Assistant to join their friendly and supportive team in Peacehaven. This ...

Service Support Temp- ASAP start
Royal Tunbridge Wells£24000 per annumTemporary

Fantastic opportunity to join a great Tunbridge Wells business as a Temporary service support coordinator. This role has the potential to become permanent for the right person!   Our client is an o...

IT Support
Dorset£23000 - £25000 per annumPermanent

Join a highly respected Legal 500 firm as an IT Support specialist where your skills will keep the team connected and running smoothly. We’re looking for a proactive and driven IT Support professio...

Legal Administrator
Dorchester£22750 per annumPermanent

Legal Administrator Kick-start your legal career with a hands-on Legal Administrator role supporting a busy, friendly property team at a highly respected Legal 500 firm. We’re looking for a motivat...

Commerical TMT Solicitor
KentCompetitivePermanent

Commercial TMT Solicitors (5-10 PQE) Our client, a leading boutique law firm recognised with multiple industry awards and experiencing rapid growth, is seeking two talented Commercial TMT Lawyers t...

Trainee Litigation Paralegal
Brighton and Hove£25000 - £30000 per annumPermanent

A prestigious specialist Litigation Solicitors are seeking a Litigation Paralegal who they will train over time. You will join a forward thinking organisation with a diverse workforce, focusing on ...

Commerical TMT Solicitor
LondonCompetitivePermanent

Commerical Solicitor & TMT Our client is a highly respected commercial law firm with a rich heritage in real estate, hospitality, leisure, media, and sport. Known for its long-standing client relat...

Commercial Property Legal Assistant
London£28000 - £35000 per annumPermanent

Commercial Property Legal Assistant Are you a proactive and commercially minded Commercial Property Legal Assistant looking to develop your career within a leading law firm? We’re proud to be worki...

Conveyancing Assistant
Royal Tunbridge Wells£26000 - £30000 per annumPermanent

Conveyancing Assistant  Are you an experienced Conveyancing Assistant looking to take the next step in your legal career? We’re working in partnership with a well-regarded, private practice based i...