Requirements

Expected technologies

Python

Apache Spark

Databricks

Git

Our requirements

• Has 5+ years of commercial experience in implementing, developing, or maintaining data load systems (ETL/ELT).
• Demonstrates strong programming skills in Python, with a deep understanding of data-related challenges.
• Has hands-on experience with Apache Spark and Databricks.
• Is familiar with MSSQL databases.
• Has experience working with distributed systems on a cloud platform.
• Has worked on large-scale systems and understands performance optimization.
• Is comfortable with Git and CI/CD practices, and can design or implement deployment processes for data pipelines.
• Is proactive, solution-oriented, and has a strong can-do attitude.
• Communicates fluently in English and Polish, both written and spoken.
• Is a team player with excellent collaboration and communication skills.

Optional

• Experience with Azure
• Experience working with SSIS
• Familiarity with Azure PostgreSQL
• Knowledge of Docker and Kubernetes
• Exposure to Kafka or other message brokers and event-driven architecture
• Experience working in Agile/Scrum environments

Your responsibilities

• Develop and maintain data delivery pipelines for a leading IT solution in the energy market, leveraging Apache Spark, Databricks, Delta Lake, and Python.
• Have end-to-end responsibility for the full lifecycle of features you develop.
• Design technical solutions for business requirements from the product roadmap.
• Ensure optimal performance.
• Refactor existing code and enhance system architecture to improve maintainability and scalability.
• Design and evolve the test automation strategy, including technology stack and solution architecture.
• Prepare reviews, participate in retrospectives, estimate user stories, and refine features ensuring their readiness for development.