Must have

• SQL

• Python

• ETL

• Big Data

• Hadoop

• Spark

• Git

• English (B2)

Nice to have

• Machine learning

• Keras

• Torch

• NLP

• scikit-learn

• Kubernetes

• Polish (B2)

Requirements description

Essential requirements:

• Advanced knowledge of SQL and Python
• Experience in designing and implementing Big Data solutions (Hadoop, Spark etc.)
• Practical knowledge of ETL tools and stream processing systems
• Database design and optimization skills
• Experience with distributed data storage and processing systems
• Very good command of English
• Formal requirements:
  • minimum 5 years of experience as a Data Engineer or equivalent, including hands-on work with large and complex datasets.
  • master's or bachelor’s degree in IT, Data Science, or related field
  • the candidate already lives in Poland and can be formally employed here (UoP)

Nice to haves:

• Experience working with medical or scientific data
• Knowledge of Natural Language Processing (NLP) techniques
• Experience with knowledge graphs and ontologies
• Familiarity with agile methodologies
• Industry certifications (e.g., AWS, Azure, GCP)
• Experience with containerization systems (Docker, Kubernetes)
• Good command of Polish

Offer description

We are seeking an experienced Senior Data Engineer to join our innovative projects.

We offer:

• Participation in an innovative project using cutting-edge AI technologies
• The opportunity to work on a project that is demonstratively significant to the general well-being and health of people world-wide
• International work environment
• A fully remote or hybrid work (we have an office in Kraków)
• Flexible working hours
• Opportunity to publish research results
• A small, friendly and close-knit team focused on collaboration, primarily working remotely
• Stability and development opportunities, backed by solid international sales and a grant from PARP
• Team integration events twice-a-year to connect and celebrate together (optional)
• Standard perks: Multisport, Luxmed, company-provided lunch every Thursday and nerdy memes

Who we are:

We are Evidence Prime, an IT/AI company born from collaboration between McMaster University and a group of dedicated, experienced Polish IT professionals. We have over 10 years of experience in the healthcare field.

Recruitment steps:

1. Share your CV and other things that help us see your brilliance
2. Complete a short take-home assignment
3. Meet with the future colleague / manager
4. Meet with the co-founder
5. You're hired :)

Your responsibilities

1. Design and implement scalable data processing architecture for the Laser LLM system
2. Create and optimize ETL processes to handle diverse medical and scientific data sources
3. Manage data quality and integrity throughout the processing pipeline
4. Collaborate with the AI team on creating and managing training datasets for language models
5. Implement solutions for efficient processing and analysis of large-scale textual data
6. Design and maintain data pipelines supporting system multimodality (text + image)

show all (9)