Software Engineer / Data Engineer / Cloud Engineer Expertise in Java, Data Engineering and Cloud Technologies (AWS and GCP)
Aktualisiert am 03.09.2024
Profil
Freiberufler / Selbstständiger
Remote-Arbeit
Verfügbar ab: 01.09.2024
Verfügbar zu: 100%
davon vor Ort: 0%
Java
Apache Spark
AWS
Python
Scala
Spring
Maven
Apache Camel
MySQL
PostgreSQL
Apache Kafka
Nifi
Hudi
Google Cloud
Git
Docker
Airflow
Grafana
Kubernetes
Jenkins
German
Verhandlungssicher
English
Verhandlungssicher
French
Muttersprache
Arabic
Muttersprache

Einsatzorte

Einsatzorte

Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

2 years 10 months
2021-11 - now

Extension and further development

Software-Engineer / Data-Engineer / DevOps-Engineer Java Scala Python ...
Software-Engineer / Data-Engineer / DevOps-Engineer
  • Design and implementation of Lakehouse usecases with Hudi
  • Design and implementation of real-time streaming usecases with Spark Streaming
  • Connecting external systems to Datalake with Apache Camel
  • Migration of CI/CD-Pipelines from Jenkins to GitlabCI/CD
Java Scala Python Spark Hudi Kafka Camel Docker AWS Airflow GitlabCI/CD
Transportation
4 months
2021-06 - 2021-09

Data driven Ads Platform, Extension of a data driven Ads Platform on GCP

Data-Engineer GCP Python Airflow ...
Data-Engineer
  • Extension of existing datalake architecture on GCP.
  • Implementation of Data Quality Control workflows with Great Expectations.
  • Orchestration and Scheduling of Workflows with Airflow.

GCP Python Airflow Great Expectations
Media
1 year 11 months
2019-07 - 2021-05

Design of a Datalake for the sales platform "Vendo"

Software-Engineer / Data-Engineer Java Scala Spark ...
Software-Engineer / Data-Engineer
  • Design of the Datalake architecture
    • Stage 1: Based on Hortonworks Suites HDF and HDP
    • Stage 2: Migration to AWS
  • Development of ETL-Applications with Apache Spark
  • Orchestration and Scheduling of ETL-Worflows with Airflow
  • Development of Data Pipelines with NiFi
  • Design and implementation of a KafkaStreams-based Application to anonymizen personal data
  • Monitoring of workflows, services and infrastructure with Grafana

Java Scala Spark Kafka Kafka-Streams NiFi Hadoop/HDFS YARN Hive Docker AWS (EC2/EMR/S3/Lambda) Python Airflow Grafana Jenkins MongoDB InfluxDB
Transportation
1 year 3 months
2018-05 - 2019-07

Building a BigData Platform to prevent against money laundering and terrorism financing

Software-Engineer / Data-Engineer Java Spark Hive ...
Software-Engineer / Data-Engineer
  • Design and development of an ETL-Framework with Java und Apache Spark
  • Development of a DSL to help with data modeling and automatic generation of test scripts


Java Spark Hive Xtext
Banking
9 months
2017-09 - 2018-05

Implementation of new Backend-Features for the Online Banking System

Java-Developer Java Spring Spring-Batch ...
Java-Developer
Digital Strategy - Cross Channel Banking, Implementation of new Backend-Features for the Online Banking System
  • Implementation of a SpringBatch-based batch architecture for importing foreign bank accounts and transactions
  • Design of data model on Oracle
Java Spring Spring-Batch Spring-Data Hibernate OracleDB Jenkins
Banking
5 months
2017-04 - 2017-08

Development of an internal management tool

Java-Developer Java Spring Spring-Data ...
Java-Developer
  • Development of a WebApplication with Spring and PrimeFaces
  • Design of data model on MySQL
Java Spring Spring-Data Spring-Security PrimeFaces Hibernate MySQL Jenkins
Timecard

Aus- und Weiterbildung

Aus- und Weiterbildung

1 month
2023-01 - 2023-01

AWS Certified Solutions Architect - Associate

Certificate,
Certificate
1 month
2020-08 - 2020-08

AWS Certified Cloud Practitioner

Certificate,
Certificate
1 month
2020-01 - 2020-01

Google Cloud Certified Professional Data Engineer

Certificate,
Certificate
1 month
2018-08 - 2018-08

Certified Scrum Developer

Certificate,
Certificate
1 month
2017-09 - 2017-09

Certified Scrum Master

Certificate,
Certificate
1 month
2016-03 - 2016-03

Deutsche Sprachprüfung für den Hochschulzugang (DSH 2: 78%)

Certificate,
Certificate
1 month
2014-01 - 2014-01

Test of English for International Communication (TOEIC: 925/990)

Certificate,
Certificate

Kompetenzen

Kompetenzen

Top-Skills

Java Apache Spark AWS Python Scala Spring Maven Apache Camel MySQL PostgreSQL Apache Kafka Nifi Hudi Google Cloud Git Docker Airflow Grafana Kubernetes Jenkins

Produkte / Standards / Erfahrungen / Methoden

Technical Skills:

Java Frameworks & Standards

  • Spring Framework (Spring Boot, Spring-Data, Spring-Security, Spring-Batch)
  • JPA,
  • Hibernate
  • JUnit
  • Maven


Big Data

  • Hadoop-Ecosystem (HDFS, YARN, Spark, Hive)
  • Kafka
  • Nifi
  • Hudi


Cloud

  • Amazon Web Services
    • EC2
    • S3
    • RDS
    • EMR
    • ECS
    • Lambda
    • CloudWatch
    • Glue
    • CloudFormation
    • ?Comprehend
  • Google Cloud Platform
    • ComputeEngine
    • CloudStorage
    • CloudSQL
    • BigQuery
    • PubSub
    • CloudDataproc


Other Frameworks & Tools

  • Git
  • Jenkins
  • Gitlab CI/CD
  • Docker
  • Airflow
  • Grafana
  • Camel


Professional Experience:

10/2021 - today

Place of Work: Frankfurt, Germany

Role: Senior Data Engineer

Customer: DB Systel GmbH


Tasks:

  • Design and development of Big-Data Architectures on AWS


Skills:

Java, Scala, Python, Spark, Kafka, Docker, Airflow AWS


04/2017 - 09/2021

Place of Work: Eschborn, Germany

Role: IT Consultant

Customer: ITinera projects & experts


Tasks:

  • Consulting clients in banking, media and transportation industries


Skills:

Java, SpringBoot, Spark, Kafka, Docker, Airflow, AWS


03/2015 - 12/2015

Place of Work: Passau, Germany

Role: Working Student

Customer: University of Passau


Tasks:

  • Research and implementation of Neural Networks models for NLP usecases


Skills:

Python, Machine Learning/Deep Learning, NLP, Knowledge Graph


06/2014 - 08/2014

Place of Work: Tunis, Tunisia

Role: Trainee

Customer: Prologic Group


Tasks:

  • Implementation and Configuration of the Network&Security Module vShield on a VMware Cloud environment


Skills:

Cloud Computing, Virtualization, VMware Cloud Suite (ESX, vSphere, vShield, vCloud Director)


07/2013 - 08/2013

Place of Work: Tunis, Tunisia

Role: Summer Trainee

Customer: Vermeg


Tasks:

  • Implementation and Configuration of CI/CD-Pipelines


Skills:

Java, Maven, Hudson

Programmiersprachen

Java
Scala
Python

Datenbanken

MySQL
PostgreSQL
MongoDB
InfluxDB

Einsatzorte

Einsatzorte

Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

2 years 10 months
2021-11 - now

Extension and further development

Software-Engineer / Data-Engineer / DevOps-Engineer Java Scala Python ...
Software-Engineer / Data-Engineer / DevOps-Engineer
  • Design and implementation of Lakehouse usecases with Hudi
  • Design and implementation of real-time streaming usecases with Spark Streaming
  • Connecting external systems to Datalake with Apache Camel
  • Migration of CI/CD-Pipelines from Jenkins to GitlabCI/CD
Java Scala Python Spark Hudi Kafka Camel Docker AWS Airflow GitlabCI/CD
Transportation
4 months
2021-06 - 2021-09

Data driven Ads Platform, Extension of a data driven Ads Platform on GCP

Data-Engineer GCP Python Airflow ...
Data-Engineer
  • Extension of existing datalake architecture on GCP.
  • Implementation of Data Quality Control workflows with Great Expectations.
  • Orchestration and Scheduling of Workflows with Airflow.

GCP Python Airflow Great Expectations
Media
1 year 11 months
2019-07 - 2021-05

Design of a Datalake for the sales platform "Vendo"

Software-Engineer / Data-Engineer Java Scala Spark ...
Software-Engineer / Data-Engineer
  • Design of the Datalake architecture
    • Stage 1: Based on Hortonworks Suites HDF and HDP
    • Stage 2: Migration to AWS
  • Development of ETL-Applications with Apache Spark
  • Orchestration and Scheduling of ETL-Worflows with Airflow
  • Development of Data Pipelines with NiFi
  • Design and implementation of a KafkaStreams-based Application to anonymizen personal data
  • Monitoring of workflows, services and infrastructure with Grafana

Java Scala Spark Kafka Kafka-Streams NiFi Hadoop/HDFS YARN Hive Docker AWS (EC2/EMR/S3/Lambda) Python Airflow Grafana Jenkins MongoDB InfluxDB
Transportation
1 year 3 months
2018-05 - 2019-07

Building a BigData Platform to prevent against money laundering and terrorism financing

Software-Engineer / Data-Engineer Java Spark Hive ...
Software-Engineer / Data-Engineer
  • Design and development of an ETL-Framework with Java und Apache Spark
  • Development of a DSL to help with data modeling and automatic generation of test scripts


Java Spark Hive Xtext
Banking
9 months
2017-09 - 2018-05

Implementation of new Backend-Features for the Online Banking System

Java-Developer Java Spring Spring-Batch ...
Java-Developer
Digital Strategy - Cross Channel Banking, Implementation of new Backend-Features for the Online Banking System
  • Implementation of a SpringBatch-based batch architecture for importing foreign bank accounts and transactions
  • Design of data model on Oracle
Java Spring Spring-Batch Spring-Data Hibernate OracleDB Jenkins
Banking
5 months
2017-04 - 2017-08

Development of an internal management tool

Java-Developer Java Spring Spring-Data ...
Java-Developer
  • Development of a WebApplication with Spring and PrimeFaces
  • Design of data model on MySQL
Java Spring Spring-Data Spring-Security PrimeFaces Hibernate MySQL Jenkins
Timecard

Aus- und Weiterbildung

Aus- und Weiterbildung

1 month
2023-01 - 2023-01

AWS Certified Solutions Architect - Associate

Certificate,
Certificate
1 month
2020-08 - 2020-08

AWS Certified Cloud Practitioner

Certificate,
Certificate
1 month
2020-01 - 2020-01

Google Cloud Certified Professional Data Engineer

Certificate,
Certificate
1 month
2018-08 - 2018-08

Certified Scrum Developer

Certificate,
Certificate
1 month
2017-09 - 2017-09

Certified Scrum Master

Certificate,
Certificate
1 month
2016-03 - 2016-03

Deutsche Sprachprüfung für den Hochschulzugang (DSH 2: 78%)

Certificate,
Certificate
1 month
2014-01 - 2014-01

Test of English for International Communication (TOEIC: 925/990)

Certificate,
Certificate

Kompetenzen

Kompetenzen

Top-Skills

Java Apache Spark AWS Python Scala Spring Maven Apache Camel MySQL PostgreSQL Apache Kafka Nifi Hudi Google Cloud Git Docker Airflow Grafana Kubernetes Jenkins

Produkte / Standards / Erfahrungen / Methoden

Technical Skills:

Java Frameworks & Standards

  • Spring Framework (Spring Boot, Spring-Data, Spring-Security, Spring-Batch)
  • JPA,
  • Hibernate
  • JUnit
  • Maven


Big Data

  • Hadoop-Ecosystem (HDFS, YARN, Spark, Hive)
  • Kafka
  • Nifi
  • Hudi


Cloud

  • Amazon Web Services
    • EC2
    • S3
    • RDS
    • EMR
    • ECS
    • Lambda
    • CloudWatch
    • Glue
    • CloudFormation
    • ?Comprehend
  • Google Cloud Platform
    • ComputeEngine
    • CloudStorage
    • CloudSQL
    • BigQuery
    • PubSub
    • CloudDataproc


Other Frameworks & Tools

  • Git
  • Jenkins
  • Gitlab CI/CD
  • Docker
  • Airflow
  • Grafana
  • Camel


Professional Experience:

10/2021 - today

Place of Work: Frankfurt, Germany

Role: Senior Data Engineer

Customer: DB Systel GmbH


Tasks:

  • Design and development of Big-Data Architectures on AWS


Skills:

Java, Scala, Python, Spark, Kafka, Docker, Airflow AWS


04/2017 - 09/2021

Place of Work: Eschborn, Germany

Role: IT Consultant

Customer: ITinera projects & experts


Tasks:

  • Consulting clients in banking, media and transportation industries


Skills:

Java, SpringBoot, Spark, Kafka, Docker, Airflow, AWS


03/2015 - 12/2015

Place of Work: Passau, Germany

Role: Working Student

Customer: University of Passau


Tasks:

  • Research and implementation of Neural Networks models for NLP usecases


Skills:

Python, Machine Learning/Deep Learning, NLP, Knowledge Graph


06/2014 - 08/2014

Place of Work: Tunis, Tunisia

Role: Trainee

Customer: Prologic Group


Tasks:

  • Implementation and Configuration of the Network&Security Module vShield on a VMware Cloud environment


Skills:

Cloud Computing, Virtualization, VMware Cloud Suite (ESX, vSphere, vShield, vCloud Director)


07/2013 - 08/2013

Place of Work: Tunis, Tunisia

Role: Summer Trainee

Customer: Vermeg


Tasks:

  • Implementation and Configuration of CI/CD-Pipelines


Skills:

Java, Maven, Hudson

Programmiersprachen

Java
Scala
Python

Datenbanken

MySQL
PostgreSQL
MongoDB
InfluxDB

Vertrauen Sie auf Randstad

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.