Connect44

Our team

Data Engineer (Lakehouse)

Connect44

Data Engineer (Lakehouse)

Job Location

Zurich

Available Positions

1 positions

Job Type

Contract

Job Ref. Number

0581504953722

Data Engineer (Lakehouse)
Contract Role - 8 Months
Switzerland
Remote work is possible

Data Engineer (Lakehouse)

Contract Role - 8 Months

Switzerland

Remote work is possible

Our client, a well known Finance company, is currently looking for a Data Engineer (Lakehouse)to work on remote basis supporting its business in Switzerland.

Role:

The responsibility of the Data Engineer is to build a Lakehouse setup on Azure for two strategic projects in Finance IT and Risk Management IT.

Tasks:

  • Review existing solutions and their stages in the different data zones (bronze, silver, gold)
  • Suggest the architecture and implement the lakehouse according to the requirements of the two projects
  • Benchmark which load to do with either Databricks or Synapse
  • Evaluate optimal VM infrastructure for the respective Databricks workload
  • Implement productive data pipelines with the logic of existing Databricks notebooks
  • Implement optimal setup and tuning of Delta files and its handling using Python and SQL
  • Define and implement the interplay of ADF, Datalake, Databricks, Synapse up to Power BI

Required Skills:

  • Ability to work as part of a team, as well as work independently or with minimal direction
  • Hands-on experience in building a Lakehouse using Datalake, Databricks and Synapse on Azure is very important
  • +3 years in Data Engineering
  • Excellent written, presentation, and verbal communication skills
  • Collaborate with data architects, modelers and IT team members on project goals
  • Strong knowledge of Lakehouse components such as ADF, Datalake, Databricks, Synapse
  • Good knowledge of Power BI, SQL, Python

Key Skills

Microsoft Azure / Synapse / Python/ SQL/ Data Engineering /DataBricks / Datalake