Senior Data Engineer (PySpark, NoSQL)

We are seeking a Senior Data Engineer with strong expertise in Azure and PySpark, skilled in designing, implementing, and maintaining robust data processing solutions. This role focuses on building scalable, production-grade data systems, ensuring reliability, and optimizing performance in distributed environments.ResponsibilitiesDesign and optimize large-scale data pipelines using PySparkBuild and maintain scalable ETL/ELT workflows in AzureTroubleshoot production issues related to performance, latency, and availabilityWork with distributed NoSQL technologies (e.g., Cosmos DB, Cassandra, DynamoDB, MongoDB, or similar)Optimize Spark jobs (partitioning, execution plans, resource usage)Implement best practices for scalability, security, and reliabilityCollaborate with cross-functional teams on data-driven solutionsContribute to automation, CI/CD, and operational improvementsRequirements5+ years of experience as a Data Engineer or similar roleStrong hands-on experience with PySpark in productionProven experience in data modeling, partitioning, indexing, and performance tuning in NoSQL systemsStrong programming skills in PythonExperience building and operating production-grade pipelines in cloud (Azure)Experience with distributed NoSQL databases (e.g., Cosmos DB, Cassandra, DynamoDB, MongoDB)Strong understanding of distributed systems and performance optimizationExperience with CI/CD, monitoring, troubleshooting, and production supportStrong analytical and communication skills (English B2+)Nice to haveExperience with real-time / streaming dataExposure to Data Science workflowsKnowledge of Big Data ecosystemsExperience with financial dataFamiliarity with AI-assisted development or LLM toolsWe offer/BenefitsWe gather like-minded people:Engineering community of industry professionalsFriendly team and enjoyable working environmentFlexible schedule and opportunity to work remotely within PolandChance to work abroad for up to 60 days annuallyBusiness-driven relocation opportunitiesWe provide growth opportunities:Outstanding career roadmapLeadership development, career advising, soft skills, and well-being programsCertification (GCP, Azure, AWS)Unlimited access to LinkedIn Learning, Get Abstract, Cloud GuruEnglish classesWe cover it all:Stable income (Employment Contract or B2B)Participation in the Employee Stock Purchase PlanBenefits package (health insurance, multisport, shopping vouchers)Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and moreReferral bonusesCorporate, social and well-being eventsPlease, note:The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview.We will reach out to selected candidates exclusively.EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.