Must have

• Python

• PySpark

• Databricks

• UNITY

• Hive

• Audit

• Communication skills

• English

Nice to have

• Degree

Requirements description

• Expert-level Python skills and 2+ years of production PySpark experience.
• 1+ years of hands-on architecture experience on Databricks, with deep expertise in Unity Catalog and Hive metastore.
• 3+ years of technical leadership experience driving engineering strategy and delivery.
• Proven experience leading enterprise-scale data platform migrations.
• Strong background in distributed systems operating at petabyte scale.
• Solid understanding of data governance, compliance, and audit requirements.
• Experience designing robust APIs and integration patterns for enterprise environments.
• Passion for defensive programming and developing scalable, reliable software.
• Excellent written and verbal communication skills, with the ability to lead cross-functional collaboration.
• Strong problem-solving skills, strategic mindset, and comfort working in ambiguous environments.
• Good command of English (minimum B2).

Nice to Have

• Experience as a Staff or Principal Engineer in a major technology company.
• Contributions to open-source data platforms.
• Experience collaborating with enterprise customers in a sales engineering or customer-facing technical role.
• Degree in Computer Science, Engineering, or a related field (or equivalent practical experience).

Offer description

🌐 Senior Python Backend Principal

Location: Remote Cooperation: B2B contracting via Antal

Rate: 160–180 PLN/h (net, B2B)

Client: USA

Project Type: New project (long-term collaboration

About the Client

Our client is launching a new cloud-based data and AI initiative designed to help organizations store, process, and analyze large-scale datasets. The platform combines data engineering, data science, and machine learning within one collaborative environment, enabling teams to build scalable analytics and AI solutions.

Your responsibilities

1. Defining and evolving the technical roadmap for UCX migration workflows and platform architecture.
2. Driving key architectural decisions and ensuring alignment across storage, compute, and governance layers.
3. Leading the design and implementation of complex migration features and large-scale data workflows.
4. Optimizing Spark workloads to ensure performance, reliability, and scalability.
5. Mentoring engineers, establishing coding standards, and promoting best engineering practices.
6. Researching and prototyping new migration capabilities and integrations with Unity Catalog.