Beschreibung

I am a Data Engineer and AWS Certified Solutions Architect. I specialize in designing and implementing data solutions and in functional programming with Scala, Python, and particularly with Spark. I currently work for a company with its own platform, enabling clients to efficiently manage, analyze, and visualize large volumes of data. My daily tasks often include Data Acquisition, Data Orchestration, Data Development, Pipeline Automation, Data Cleaning, Data Migration, and Data Ingestion.

My extensive technical toolkit includes expertise in Scala, Python, Java, Spark, Flink, Kafka, Hive, Git, Docker, Kubernetes, AWS services (S3, EMR, ECS, DynamoDB, IAM), and SQL.

I take a meticulous and results-driven approach, focusing on delivering scalable, high-impact solutions that drive business growth and enhance decision-making capabilities.

Branchenexpertise

Sprachen

Spanisch
Muttersprachlich oder zweisprachig
Englisch
Verhandlungssicher

Arbeitsortpräferenzen

Nur remote

Führt Projekte hauptsächlich remote aus

Big Data Company
Data Engineer
HIGHTECH
September 2022 - Heute (3 Jahre und 9 Monate)
Kingdom of Spain, Spanien
Design and Implementation of the Informational Layer of an MDM (Master Data Management) System Utilizing a three-tier architecture (Frontend, Backend, and Informational) and a Medallion Architecture in a Data Lakehouse. This includes defining the format, structure, partitioning, and modeling of data across the system's layers, as well as managing the data lifecycle. Agile methodology was applied throughout the project.
Data persistence was implemented using Delta tables with versioning based on the SCD Type 2 model. The infrastructure was containerized using Kubernetes.
Data pipeline orchestration was managed with Apache Airflow, encompassing monitoring, incident resolution, and continuous optimization for performance improvements.

Tools and Technologies:
PySpark, Spark SQL, HDFS, AWS Services (S3, IAM), Delta Lake, Kubernetes, Git, Jenkins, Nexus, Jira.
Spark Spark Sql PySpark Scala Airflow AWS S3 EMR
Banking Company
Big Data Developer
BANKEN & VERSICHERUNGEN
März 2020 - September 2022 (2 Jahre und 6 Monate)
Madrid, Spanien
Development and Optimization of Data Ingestion and Transformation Processes
Aligned with the bank's data model, including the modeling of tables with HQL structures. Conducted unit testing and ensured continuous integration across different layers with a code quality validator. Kanban methodology was applied.

Tools and Technologies:
Scala, Spark, Spark SQL, HDFS, Hive, ScalaTest, Git, Jenkins, Nexus, Jira, Sonar.

Real-Time Data Processing Developer in a Banking Sector Project
Focused on processing and transforming operations in real-time. Performed end-to-end (E2E) and unit testing, with continuous integration across different layers, including a code quality validator. Scrum methodology was utilized.

Tools and Technologies:
Java, Flink, Kafka, AWS S3, SQL, Mockito, Cucumber, Jenkins, Sonar, Git, Docker, NiFi, Jira.

Java Flink Kafka Scala Spark HDFS Hive
Banking Company
Big Data Engineer
BANKEN & VERSICHERUNGEN
Juni 2019 - März 2020 (9 Monate)
Madrid, Spanien
Development of Data Ingestion, Transformation, and Quality Validation Processes
Aligned with the bank's architecture, including data structure modeling. Planned and monitored batch processes, ensuring continuous integration across the various layers.

Tools and Technologies:
Scala, Spark, HDFS, PowerDesigner, Kirby, Hammurabi, Control-M, Git, Jenkins, Docker, Artifactory, Jira.
Scala Spark HDFS Control-M Spark SQL