Information about the project: Industry: banking Rate: up to 210 PLN/H net + VAT, B2B Location: remote (Poland/Warsaw) Long-term cooperation Summary:We are seeking a driven Data Engineer/Data Analyst with a solid understanding of the end-to-end ETL pipeline and a foundational knowledge of data engineering principles. The ideal candidate will possess proficiency in Hive SQL (SPARK) and SCALA, alongside relevant skills in shell scripting. This role presents a unique opportunity to work within a dynamic environment, contributing to innovative data solutions.Main Responsibilities Develop and optimize Hive SQL (SPARK) queries to support data processing tasks. Utilize SCALA to enhance data engineering processes. Implement shell scripting for automation purposes. Work with Cloudera distribution tools, including Oozie, for workflow management. Collaborate with team members to integrate Elasticsearch solutions. Support projects involving Quantexa technology. Key Requirements Proficiency in Hive SQL (SPARK). Strong knowledge of SCALA. Experience with shell scripting. Familiarity with Cloudera distribution (Oozie). Basic knowledge of Elasticsearch. Understanding of Quantexa platform. Nice to Have Familiarity with IntelliJ. Experience using Zeppelin. Knowledge of Bamboo, Jenkins, Nexus, and Artifactory. Basic understanding of Kafka.