Must have

• Python

• Spark

• SQL

• ETL

• PySpark

• Analytical skills

• Data pipelines

• Cloud

• GCP

• English (C1)

Requirements description

What you need to have to succeed in this role

• 5+ years of experience in developing data propagation pipeline with Python spark, conversion of SQLs into spark scripts.
• Good understanding on SQL, ETL concepts, writing complex queries using multiple joins, unions etc.
• Be able to breakdown complex SQL logic and translate it for implementation in Pyspark.
• Good development experience in PySpark
• Strong analytical skills and proficient in creating efficient data pipelines is key
• Understanding of configuration management, orchestration, containerization, and deployment automation.  Deployment automation of cloud projects (GCP preferred)
• Good experience in GCP Data Proc, Big query, GKE will be an advantage

Offer description

Risk & Compliance technology design and deploy cutting edge technology to defend the bank and its customers from Sanctions Risk, Financial Crime Risk, Identity Threat, Unauthorised Trading and Market Abuse & Regulatory Sanctions, as well as supporting Enterprise Risk Management.  We provide the systems that enable our global businesses to grow through data-driven, pro-active risk management.

We are seeking Data Engineer who will be understanding data structures, end to end data flow and working on delivering data pipelines within Risk & Compliance area. The Data Engineer works closely with Business Stakeholders to understand their requirements & propose solution for their problems. In this role you will collaborate with engineering teams from Poland, India & UK, supporting project delivery activities but also BAU post system Go Live.

WHAT WE OFFER

• Competitive salary
• Annual performance-based bonus
• Additional bonuses for recognition awards
• Multisport card
• Private medical care
• Life insurance
• One-time reimbursement of home office set-up (up to 800 PLN).
• Corporate parties & events
• CSR initiatives
• Nursery discounts
• Financial support with trainings and education
• Social fund
• Flexible working hours
• Free parking

Your responsibilities

1. Work closely with Business & IT partners to understand data requirements.
2. Together with Architecture & Engineering Team propose technical solution.
3. Participate in data pipeline delivery, testing & validation up to production.
4. Support and maintain solution after Go Live.