Data Engineer - Real-Time Data

IMG ARENA Poland

Żernica (pow. gliwicki)
24000 zł/mth.
Remote
🐍 Python
Scala
SQL
Spark
Pandas
BigQuery
🌐 Remote

Requirements

Expected technologies

Python

Scala

SQL

Spark

Pandas

BigQuery

Optional technologies

Kubernetes

Docker

Apache Druid

Spark Streaming

Kafka Streams

Superset

Tableau

Our requirements

  • 2 years of experience in data engineering
  • Programming (e.g. Python, Scala)
  • Large-scale data manipulation and processing (e.g. SQL, Spark, Pandas, BigQuery)
  • Analytical mind with problem-solving skills
  • Approachable and a proficient communicator across both technical and non-technical organisational levels.

Optional

  • Experience with Kubernetes and Docker
  • Real-time analytics databases (e.g. Apache Druid)
  • Streaming applications (e.g. Spark Streaming, Kafka Streams)
  • Data analysis, reporting and visualisation (e.g. Superset, Tableau).

Your responsibilities

  • Building data processing pipelines both streaming and batch
  • Feature engineering, combining data sets from internal and external sources
  • Managing and maintaining standards for Data Analysis tools used across the organisation
  • Contributing to future design/architecture solutions that directly
  • impact the business
  • Exploring and innovating with sports data to discover new data products.
Aufrufe: 4
Veröffentlichtvor 8 Tagen
Läuft abin 16 Tagen
ArbeitsmodusRemote
Quelle
Logo
Logo

Ähnliche Jobs, die für Sie von Interesse sein könnten

Basierend auf "Data Engineer - Real-Time Data"