Requirements

Operating system

Windows

Our requirements

• Orchestration services : Step function, Event-Bridge, Airflow (MWAA), Lamda
• Processing: Glue, EMR, EKS
• Storage Service: S3
• Querying and Analysis services: Athena
• Bigdata ETL development and frameworks using : PySpark with Python or/and Spark with Scala (nice to have).
• Experience with working with Python/Pandas transformation
• Experience with Hadoop Ecosystem (Hive, Impala, Sqoop, HDFS, Oozie),
• Knowledge of CI/CD Pipeline (Jenkins) and Infrastructure as a code (Terraform)

Optional

• ML Flow
• AWS BedRock
• AWS SageMaker
• AWS EC2, Fargate
• AWS Lambda
• HashiCorp Tools
• AWS development
• Hadoop knowledge

Your responsibilities

• The client is embarking on an ambitious program of work to deliver a number of generative and predictive AI models to optimize the work for hundreds of people in Group Financial Crime Prevention. While we are an established and mature IT organization, working in our AI program is going to feel more like a startup! We are experimenting with methods and tooling and are seeking a number of experienced Devops engineers to help facilitate the build and deployment of our Generative AI applications