Azure Data Engineer

Data Engineer  - Commodities - London

TurleyWay are partnering with a leading Financial Services company based in central London. They are a global spanning company which provide platforms to gain access to energy, commodities and financial markets around the world.

They are looking for an experienced Data Engineer to come in and help define their new multi-cloud central data centre.

Are you looking for a role that offers working with an exciting trading company and on cutting edge technologies?

Salary & Benefits:

• Up to £100k plus a bonus
• Hybrid working – 2 days per week working from home.

Your Role:

This role will be working within a new centralised Data Team, supporting all business functions. In your role as Data Engineer will be responsible for the development and delivery of performant data pipelines. This is withing the firm’s data platform delivering data from diverse sources for use in Business Intelligence and Machine Learning solutions.

Office & WFH Policy:

The company offer a hybrid model. This is going to be working three day a week in their office.

Requirements:
• Experience of working with Azure Data tooling  including: Azure Data Factory, Data Lake, Azure Databricks, Synapse Analytics
• Advanced SQL skills (SQL, T-SQL, PL/SQL)
• Spark (Databricks)
• Scripting skills (Python, PowerShell)
• Data Lake Design - optimal layout for performance, security etc
• Experience in managing and migrating large volumes of data. Compression, partitioning and ETL/ELT
• Understanding of both batch and stream processing.

• Experience of other data cloud technologies – AWS, Azure, Oracle Cloud.
• Power BI
• MongoDB
• Data platform automation tools (Azure Devops, Redgate Flyway, Liquibase)