Senior Data Engineer (PySpark)

We are looking for a Senior Data Engineer with expertise in AI-enabled data platforms and PySpark. This role involves designing, building and optimizing modern data pipelines and analytics solutions, collaborating with architects, lead engineers and business stakeholders to deliver robust, scalable and AI-integrated data solutions.ResponsibilitiesImplement data processing and transformation with Python, PySpark and SparkSQLWork with OneLake (Delta / OpenLake) for efficient data storage and analyticsDevelop and support solutions using Cosmos DB (NoSQL API)Contribute to Fabric workloads including Data Engineering, Data Factory Gen2 and LakehouseDesign, develop and maintain scalable data pipelines using Azure FabricImplement and maintain CI/CD pipelines and follow DevOps best practicesIntegrate data solutions with Power BI for reporting and analyticsCollaborate with AI, data science and product teams to support AI-driven use casesEnsure data quality, performance, security and reliabilityParticipate in Agile ceremonies and contribute to sprint deliverySupport production issues and continuous improvementsRequirements5+ years of experience in Data Software Engineering or related engineering rolesSolid experience with PySpark and SparkSQLExperience with Cosmos DB (NoSQL API)Hands-on experience with OneLake or Delta Lake and OpenLake conceptsKnowledge of DF Gen2 and M-codeExperience with CI/CD pipelines using Azure DevOps or equivalentGood understanding of Azure servicesExperience integrating data solutions with Power BIExperience with Azure Fabric would be an assetStrong problem-solving and analytical skillsAbility to work independently on complex tasksExperience working in Agile or Scrum environmentsUpper-intermediate proficiency in English (B2+)We offer/BenefitsWe gather like-minded people:Engineering community of industry professionalsFriendly team and enjoyable working environmentFlexible schedule and opportunity to work remotely within PolandChance to work abroad for up to 60 days annuallyBusiness-driven relocation opportunitiesWe provide growth opportunities:Outstanding career roadmapLeadership development, career advising, soft skills, and well-being programsCertification (GCP, Azure, AWS)Unlimited access to LinkedIn Learning, Get Abstract, Cloud GuruEnglish classesWe cover it all:Stable income (Employment Contract or B2B)Participation in the Employee Stock Purchase PlanBenefits package (health insurance, multisport, shopping vouchers)Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and moreReferral bonusesCorporate, social and well-being eventsPlease, note:The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview.We will reach out to selected candidates exclusively.EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.