Über Radhouane
Englisch
Verhandlungssicher
Französisch
Muttersprachlich oder zweisprachig
Projekt- und Berufserfahrung
- Trainline (UK)Senior AWS Data EngineerTRANSPORTWESENDezember 2022 - Heute (3 Jahre und 6 Monate)Londres, Vereinigtes Königreich▪ Front and app events ingestion from dedicated micro-service using Kinesis streams▪ Data processing and normalization of more than 1000 tables in a streaming mode using Clojure KafkaStreams application and an internal DSL library▪ “Glue tables updater” migration from Clojure to Scala in an advanced functional programming way (usingCats, IO monads …) which ensures 40% S3 cost saving by avoiding glue crawler full scans and updates tablesas soon as data is landed in the data lake▪ Batch processing improvement by replacing AWS Batch jobs (written in clojure) by EMR jobs to gain inconcurrency, scalability and cost (~80% cost saving and 50 times faster)▪ Data architecture design to simplify data processing by relying on MSK and kinesis and replacing legacy andinhouse solutions by AWS managed services▪ Tabular PoC implementation to ingest data from kafka topics to the datalake using iceberg format▪ Focus on main data challenges: processing guarantee, data loss, late data load and schema evolution▪ Alerts and data monitoring implementation via Grafana and New Relic dashboards▪ ETL tasks scheduling using Airflow (deployed on MWAA) dags▪ AWS resources deployment via Terraform▪ CICD delivery using Jenkins pipelines
- SNCF ConnectSenior AWS Data EngineerNovember 2021 - Dezember 2022 (1 Jahr und 1 Monat)Paris, France• Data streaming ingestion and processing of users logs on SNCF Connect web site and mobile application using Kinesis Data Streams• Data loss reduction from 20% to less than 1% by designing an appropriate data architecture for streaming processing• Data ingestion from Kinesis Data Stream to the data lake via Kinesis Firehose• Data efficiency and governance improvement by splitting data into 4 different data zones• Customer Journey Analysis using Glue jobs (pyspark) andl KPIs monitoring on Grafana dashboard• ETL tasks scheduling using Airflow (deployed on EKS) dags• Automatic deployment of AWS resources using Terraform (IaC approach)• Job automation and CICD delivery using GitLab pipelinesTechnical Environment : Python, Git, GitLab, script shell, AWS, Kinesis Stream, Kinesis Firehose, Cloud Watch, Log Insight, Athena, Lambda functions, EMR, Sagemaker, Glue, S3, EKS, Airflow, Terraform, Docker, Scala, Kotlin, Gradle, Node JS, Kubernetes, Grafana, Ansible
- VeoliaSenior GCP Data EngineerJuni 2021 - November 2021 (5 Monate)Paris, France• Accounting data ingestion from SAP databases to BigQuery using Dataflow jobs• Exposing functional KPIs on Data Studio dashboards and connected sheets based on BigQuery scheduled queries• Job automation and CICD delivery using GitLab pipelines• Data Transfer using Google Apps Script in the context of fusion with SUEZ to store data in BigQuery Data Lake• Budget aggregation by using predefined functional scenarios and monitoring on Data Studio DashboardsTechnical Environment: Python, Cloud Shell, Git, GitLab, script shell, GCS, BigQuery, Composer, Dataflow, App Engine, Cloud Functions, DataStudio, Connected sheets
Empfehlungen
Sei die erste Person, die Radhouane empfiehlt
Teile Deine Erfahrung aus der Zusammenarbeit mit diesem Freelancer.
Diese Freelancer passen auch zu Ihren Kriterien
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Ausbildung und Abschlüsse
- Université Denis Diderot (Paris VII)Master’s Degree2012
- Grenoble IAEMaster’s Degree2011