Cloud Architekt, Cloud Engineer, Cloud DevOps, Data Architect, Data Engineer
Aktualisiert am 23.05.2024
Profil
Freiberufler / Selbstständiger
Remote-Arbeit
Verfügbar ab: 23.05.2024
Verfügbar zu: 100%
davon vor Ort: 100%
Datenarchitektur
Cloud Computing
Apache Spark
AWS
Azure
Kafka
Java
Python
DevOps
Git
Scala
.NET Framework
Databricks
C#
German
C2
French
C2
English
C1
Chinese
C1
Italian
Grundkenntnisse
Dutch
A1 - A2

Einsatzorte

Einsatzorte

egal (+500km)
Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

9 months
2023-04 - 2023-12

development and implementation of data warehouses

Cloud DevOps and DataOps - Lead Data Engineer Jira Trello Miro ...
Cloud DevOps and DataOps - Lead Data Engineer
  • In my role as Lead Data Engineer, I led a team of specialists in the development and implementation of data warehouses and streaming services on the Google Cloud Platform (GCP) and AWS, as part of a strategic multi-cloud initiative. 
  • My leadership approach focused on inspiring and guiding the team to realize Kafka and Spark streaming services to meet the growing demands of real-time data processing for e-commerce businesses. 
  • I fostered a culture of collaboration and innovation, leading to the development of a powerful multi-cloud platform specifically designed to meet the needs of stakeholders as well as data analysts and data scientists. 
  • Emphasizing data privacy and security, I developed an IoC-based access management system for secure and efficient data transfer.
Jira Trello Miro Kafka Spark GCP BigQuery Dataproc Cloud Functions Pub/Sub Cloud Scheduler Looker AWS IAM and Policy Role Assuming SQS Terraform Terragrunt
Adevinta ASA
Germany
5 months
2022-11 - 2023-03

coordinating cloud migration projects

Cloud DevOps Engineer Jira/Confluence Azure Terraform ...
Cloud DevOps Engineer
  • In this project, I played a key role in coordinating cloud migration projects and was deeply involved in Scrum methodologies.
  •  I advised and supported development teams in all Azure-related topics, particularly in implementing services like serverless computing with Azure Functions and ensuring network efficiency and security.
Jira/Confluence Azure Terraform Github Actions Docker Datadog
Edeka Digital GmbH
Germany
5 months
2022-08 - 2022-12

data architecture and strategy.

Senior Consultant Jira/Confluence AWS EMR AWS Glue ...
Senior Consultant
  • I led a team for a short-term project and advised the client on data architecture and strategy. 
  • My primary focus was on migrating enterprise data to the cloud, including building a data warehouse in AWS and developing automated pipelines with AWS Glue and Terraform for efficient data processing and transfer. 

Jira/Confluence AWS EMR AWS Glue Terraform Spark Docker
Centa MG GmbH
Germany
11 months
2021-09 - 2022-07

Python project

Cloud Engineer Azure Data Factory Databricks Spark ...
Cloud Engineer

  • In order to migrate a classical machine learning model to Azure, which aims to predict the vehicle repair rate, I interpreted the Python project into Spark and used Databricks, MLflow and Azure Data Factory to automate the data ingestion and to parallelize the model training. 
  • Front-end data visualization uses Grafana. 


Azure Data Factory Databricks Spark Delta Lake data vault Azure Pipelines Grafana Snowflake
Mercedes Benz Tech Innovation GmbH
Germany
1 year 7 months
2020-02 - 2021-08

knowledge graph model to represent

Cloud Engineer knowledge graph Kafka Neo4j ...
Cloud Engineer

  • Kitchen furniture blueprints sometimes contain errors which should be avoided before being sent to construction. 
  • As a technical team working with a kitchen provider, we received thousands of kitchen plans on a daily basis. 
  • I designed a knowledge graph model to represent the furniture of a kitchen with geometric and graph algorithms to learn and look for errors in it, as well as a pipelined workflow on Azure to process the data. 
  • Kitchen blueprints as data are first fed into the workflow by Kafka in real time, these are then validated and sent to a Neo4j cluster by an Azure function.
  • After the kitchen blueprints get ingested and analyzed by Neo4j, the result is sent to the Cosmos DB and returned to the client, in case an error is detected or a warning occurred. 

knowledge graph Kafka Neo4j Azure Functions AKS Python .NET
Island Labs GmbH
Germany
1 year 4 months
2018-10 - 2020-01

Spark application for an on premise DWH

Data scientist and engineer Spark 2.x Kafka Hadoop ...
Data scientist and engineer
  • Astronomical data can be immense and requires a big data solution to process it.
  • Working together with astronomers, I designed a Spark application for an on premise DWH to process the data and read in from and write out to its different layers. 
  • The application includes both batch processing to deal with existent data and streaming to deal with new data coming in. 
  • I also optimized the Spark application at different levels which has improved its performance remarkably. 
Spark 2.x Kafka Hadoop Java
Research
China
6 months
2018-04 - 2018-09

Internship - Biostatistics and AI

Intern Python R
Intern
  • The combination of omic data and machine learning / deep learning is one of the cutting-edge areas of biopharma research. 
  • In this project where the company aims to get a better understanding of the high-throughput RNA sequencing data of patients undergoing different medical treatments after a myocardial infarction, my machine learning and deep learning algorithms came to help. 
Python R
Firalis SA
France
2 months
2017-07 - 2017-08

Internship - Psychometry and AI

Intern R
Intern
  • In the psychomotor therapy the diagnosis of schizophrenia had been to that date carried out by the observation and the subjective judgment of medical professionals. 
  • With the hope to develop an AI assistant helping physicians make better and more accurate clinical decisions based on more quantitative indicators, I built an application using machine learning and statistical models to predict schizophrenia. 
R
Centre Hospitalier de Rouffach
France
7 months
2016-02 - 2016-08

development of a sophisticated diagnosis assistant system

AI-Developer .NET Windows Forms
AI-Developer

  • As a backend developer at MedVision, my role was pivotal in the development of a sophisticated diagnosis assistant system. 
  • I focused on designing and implementing user interfaces and software modules in the .NET framework to integrate algorithms developed by machine learning scientists. 
  • My work involved using C# for crafting intuitive and responsive desktop applications, ensuring seamless integration of complex AI algorithms for medical diagnostics, particularly for conditions like pulmonary sarcoidosis. 
  • My responsibility also included optimizing software performance and ensuring data accuracy through rigorous testing and collaboration with the AI team. 

.NET Windows Forms
MedVision Ltd.
China
4 months
2015-11 - 2016-02

Internship - Risk Management

Intern - risk analyst R Excel
Intern - risk analyst

  • As a risk analyst I ensured the role of developing statistical tools to monitor credit risk, market risk, liquidity risk and operational risk of the bank

R Excel
Bank of Communications
Luxembourg
10 months
2015-01 - 2015-10

development of backend systems

Backend Developer Python Django PostgreSQL ...
Backend Developer

  • My role centered around contributing to the development of backend systems for online retail platforms. 
  • My work primarily involved the implementation of Python-based data processing solutions, essential for efficient inventory management and customer data handling in the online retail sector. 
  • A significant part of my responsibilities included working on system architecture, focusing on data security and the optimization of performance. 

Python Django PostgreSQL RabbitMQ
Wanjia Ltd.
China
2 years
2013-01 - 2014-12

creation and maintenance of logistics management systems

Backend Developer Java Spring MySQL ...
Backend Developer
  • involved the creation and maintenance of logistics management systems, with a focus on optimizing performance and managing databases effectively.
  • I was responsible for utilizing Java and the Spring Framework to construct robust and scalable services, catering to a dynamic and demanding logistics environment. 
  • My work also included the integration of SOAP and RESTful APIs to facilitate seamless communication with various third-party services. 
Java Spring MySQL SOAP RESTful
Shanghai Teso Co.
China

Aus- und Weiterbildung

Aus- und Weiterbildung

MSc Data Science

Université Claude Bernard Lyon 1, France

Kompetenzen

Kompetenzen

Top-Skills

Datenarchitektur Cloud Computing Apache Spark AWS Azure Kafka Java Python DevOps Git Scala .NET Framework Databricks C#

Aufgabenbereiche

Project management
sprint planning
architecture design
multi-cloud
pipeline and workflow design
cloud devops
orchestration
CI/CD
data warehouse development
machine learning

Produkte / Standards / Erfahrungen / Methoden

Profile

DevOps Engineer and Cloud Architect with over 8 years of professional experience in IT, dedicated to delivering complex cloud, platform and data solutions to clients and stakeholders continuously. A team player with experience in leading roles and proven interpersonal skills, focused on efficiently managing teams and leading technical projects from conception to successful implementation. 


Domains of Expertise

Software and DevOps Engineering

  • Architecture design
  • test-driven development
  • Agile
  • project coordination
  • consulting


Cloud service and solution (Azure / AWS / GCP)

  • Message Queues
  • Azure Functions / AWS Lambda / GCP Cloud Functions
  • Cloud Run
  • Cloud Scheduler
  • Azure Pipelines
  • AWS EMR
  • AWS Glue
  • Azure Data Factory
  • BigQuery
  • Azure Machine Learning
  • AKS / EKS
  • ADLS Gen2 / AWS S3
  • Cloud networks
  • TCP/IP
  • DNS
  • Application Gateway
  • storage
  • orchestration
  • Datadog


ETL/ELT

  • Airbyte
  • DBT
  • Glue


IoC, orchestration, versioning and tracking

  • Terraform
  • Kubernetes
  • Docker
  • Helm
  • ArgoCVD
  • Ansible
  • MLFlow
  • Argo
  • Luigi
  • Airflow
  • git
  • GitHub
  • Github Actions
  • Hodolint
  • Trivy


Visualization

  • Looker
  • Power BI
  • Grafana


Machine learning algorithms and statistics

  • Regressions, SVM, ensemble methods (XGboost, RM), ensemble methods, clustering, KNN, naïve Bayes, graphic models, association rules learning. 
  • Natural Language Processing (NLP), Autoencoder. 
  • Bayesian models and MCMC. 
  • PCA, MDS, t-SNE, correspondence analysis, density estimation, time series analysis, Gaussian Process, knowledge graph

Programmiersprachen

.NET
Java
Python
Scala
Node.js
R
Shiny
Shell
PowerShell

Datenbanken

Databricks / Spark
Kafka
SQL
Snowflake
MongoDB
Cosmos DB
Hive
Cassandra
Neo4j
TigerGraph
DBT
Airbyte

Einsatzorte

Einsatzorte

egal (+500km)
Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

9 months
2023-04 - 2023-12

development and implementation of data warehouses

Cloud DevOps and DataOps - Lead Data Engineer Jira Trello Miro ...
Cloud DevOps and DataOps - Lead Data Engineer
  • In my role as Lead Data Engineer, I led a team of specialists in the development and implementation of data warehouses and streaming services on the Google Cloud Platform (GCP) and AWS, as part of a strategic multi-cloud initiative. 
  • My leadership approach focused on inspiring and guiding the team to realize Kafka and Spark streaming services to meet the growing demands of real-time data processing for e-commerce businesses. 
  • I fostered a culture of collaboration and innovation, leading to the development of a powerful multi-cloud platform specifically designed to meet the needs of stakeholders as well as data analysts and data scientists. 
  • Emphasizing data privacy and security, I developed an IoC-based access management system for secure and efficient data transfer.
Jira Trello Miro Kafka Spark GCP BigQuery Dataproc Cloud Functions Pub/Sub Cloud Scheduler Looker AWS IAM and Policy Role Assuming SQS Terraform Terragrunt
Adevinta ASA
Germany
5 months
2022-11 - 2023-03

coordinating cloud migration projects

Cloud DevOps Engineer Jira/Confluence Azure Terraform ...
Cloud DevOps Engineer
  • In this project, I played a key role in coordinating cloud migration projects and was deeply involved in Scrum methodologies.
  •  I advised and supported development teams in all Azure-related topics, particularly in implementing services like serverless computing with Azure Functions and ensuring network efficiency and security.
Jira/Confluence Azure Terraform Github Actions Docker Datadog
Edeka Digital GmbH
Germany
5 months
2022-08 - 2022-12

data architecture and strategy.

Senior Consultant Jira/Confluence AWS EMR AWS Glue ...
Senior Consultant
  • I led a team for a short-term project and advised the client on data architecture and strategy. 
  • My primary focus was on migrating enterprise data to the cloud, including building a data warehouse in AWS and developing automated pipelines with AWS Glue and Terraform for efficient data processing and transfer. 

Jira/Confluence AWS EMR AWS Glue Terraform Spark Docker
Centa MG GmbH
Germany
11 months
2021-09 - 2022-07

Python project

Cloud Engineer Azure Data Factory Databricks Spark ...
Cloud Engineer

  • In order to migrate a classical machine learning model to Azure, which aims to predict the vehicle repair rate, I interpreted the Python project into Spark and used Databricks, MLflow and Azure Data Factory to automate the data ingestion and to parallelize the model training. 
  • Front-end data visualization uses Grafana. 


Azure Data Factory Databricks Spark Delta Lake data vault Azure Pipelines Grafana Snowflake
Mercedes Benz Tech Innovation GmbH
Germany
1 year 7 months
2020-02 - 2021-08

knowledge graph model to represent

Cloud Engineer knowledge graph Kafka Neo4j ...
Cloud Engineer

  • Kitchen furniture blueprints sometimes contain errors which should be avoided before being sent to construction. 
  • As a technical team working with a kitchen provider, we received thousands of kitchen plans on a daily basis. 
  • I designed a knowledge graph model to represent the furniture of a kitchen with geometric and graph algorithms to learn and look for errors in it, as well as a pipelined workflow on Azure to process the data. 
  • Kitchen blueprints as data are first fed into the workflow by Kafka in real time, these are then validated and sent to a Neo4j cluster by an Azure function.
  • After the kitchen blueprints get ingested and analyzed by Neo4j, the result is sent to the Cosmos DB and returned to the client, in case an error is detected or a warning occurred. 

knowledge graph Kafka Neo4j Azure Functions AKS Python .NET
Island Labs GmbH
Germany
1 year 4 months
2018-10 - 2020-01

Spark application for an on premise DWH

Data scientist and engineer Spark 2.x Kafka Hadoop ...
Data scientist and engineer
  • Astronomical data can be immense and requires a big data solution to process it.
  • Working together with astronomers, I designed a Spark application for an on premise DWH to process the data and read in from and write out to its different layers. 
  • The application includes both batch processing to deal with existent data and streaming to deal with new data coming in. 
  • I also optimized the Spark application at different levels which has improved its performance remarkably. 
Spark 2.x Kafka Hadoop Java
Research
China
6 months
2018-04 - 2018-09

Internship - Biostatistics and AI

Intern Python R
Intern
  • The combination of omic data and machine learning / deep learning is one of the cutting-edge areas of biopharma research. 
  • In this project where the company aims to get a better understanding of the high-throughput RNA sequencing data of patients undergoing different medical treatments after a myocardial infarction, my machine learning and deep learning algorithms came to help. 
Python R
Firalis SA
France
2 months
2017-07 - 2017-08

Internship - Psychometry and AI

Intern R
Intern
  • In the psychomotor therapy the diagnosis of schizophrenia had been to that date carried out by the observation and the subjective judgment of medical professionals. 
  • With the hope to develop an AI assistant helping physicians make better and more accurate clinical decisions based on more quantitative indicators, I built an application using machine learning and statistical models to predict schizophrenia. 
R
Centre Hospitalier de Rouffach
France
7 months
2016-02 - 2016-08

development of a sophisticated diagnosis assistant system

AI-Developer .NET Windows Forms
AI-Developer

  • As a backend developer at MedVision, my role was pivotal in the development of a sophisticated diagnosis assistant system. 
  • I focused on designing and implementing user interfaces and software modules in the .NET framework to integrate algorithms developed by machine learning scientists. 
  • My work involved using C# for crafting intuitive and responsive desktop applications, ensuring seamless integration of complex AI algorithms for medical diagnostics, particularly for conditions like pulmonary sarcoidosis. 
  • My responsibility also included optimizing software performance and ensuring data accuracy through rigorous testing and collaboration with the AI team. 

.NET Windows Forms
MedVision Ltd.
China
4 months
2015-11 - 2016-02

Internship - Risk Management

Intern - risk analyst R Excel
Intern - risk analyst

  • As a risk analyst I ensured the role of developing statistical tools to monitor credit risk, market risk, liquidity risk and operational risk of the bank

R Excel
Bank of Communications
Luxembourg
10 months
2015-01 - 2015-10

development of backend systems

Backend Developer Python Django PostgreSQL ...
Backend Developer

  • My role centered around contributing to the development of backend systems for online retail platforms. 
  • My work primarily involved the implementation of Python-based data processing solutions, essential for efficient inventory management and customer data handling in the online retail sector. 
  • A significant part of my responsibilities included working on system architecture, focusing on data security and the optimization of performance. 

Python Django PostgreSQL RabbitMQ
Wanjia Ltd.
China
2 years
2013-01 - 2014-12

creation and maintenance of logistics management systems

Backend Developer Java Spring MySQL ...
Backend Developer
  • involved the creation and maintenance of logistics management systems, with a focus on optimizing performance and managing databases effectively.
  • I was responsible for utilizing Java and the Spring Framework to construct robust and scalable services, catering to a dynamic and demanding logistics environment. 
  • My work also included the integration of SOAP and RESTful APIs to facilitate seamless communication with various third-party services. 
Java Spring MySQL SOAP RESTful
Shanghai Teso Co.
China

Aus- und Weiterbildung

Aus- und Weiterbildung

MSc Data Science

Université Claude Bernard Lyon 1, France

Kompetenzen

Kompetenzen

Top-Skills

Datenarchitektur Cloud Computing Apache Spark AWS Azure Kafka Java Python DevOps Git Scala .NET Framework Databricks C#

Aufgabenbereiche

Project management
sprint planning
architecture design
multi-cloud
pipeline and workflow design
cloud devops
orchestration
CI/CD
data warehouse development
machine learning

Produkte / Standards / Erfahrungen / Methoden

Profile

DevOps Engineer and Cloud Architect with over 8 years of professional experience in IT, dedicated to delivering complex cloud, platform and data solutions to clients and stakeholders continuously. A team player with experience in leading roles and proven interpersonal skills, focused on efficiently managing teams and leading technical projects from conception to successful implementation. 


Domains of Expertise

Software and DevOps Engineering

  • Architecture design
  • test-driven development
  • Agile
  • project coordination
  • consulting


Cloud service and solution (Azure / AWS / GCP)

  • Message Queues
  • Azure Functions / AWS Lambda / GCP Cloud Functions
  • Cloud Run
  • Cloud Scheduler
  • Azure Pipelines
  • AWS EMR
  • AWS Glue
  • Azure Data Factory
  • BigQuery
  • Azure Machine Learning
  • AKS / EKS
  • ADLS Gen2 / AWS S3
  • Cloud networks
  • TCP/IP
  • DNS
  • Application Gateway
  • storage
  • orchestration
  • Datadog


ETL/ELT

  • Airbyte
  • DBT
  • Glue


IoC, orchestration, versioning and tracking

  • Terraform
  • Kubernetes
  • Docker
  • Helm
  • ArgoCVD
  • Ansible
  • MLFlow
  • Argo
  • Luigi
  • Airflow
  • git
  • GitHub
  • Github Actions
  • Hodolint
  • Trivy


Visualization

  • Looker
  • Power BI
  • Grafana


Machine learning algorithms and statistics

  • Regressions, SVM, ensemble methods (XGboost, RM), ensemble methods, clustering, KNN, naïve Bayes, graphic models, association rules learning. 
  • Natural Language Processing (NLP), Autoencoder. 
  • Bayesian models and MCMC. 
  • PCA, MDS, t-SNE, correspondence analysis, density estimation, time series analysis, Gaussian Process, knowledge graph

Programmiersprachen

.NET
Java
Python
Scala
Node.js
R
Shiny
Shell
PowerShell

Datenbanken

Databricks / Spark
Kafka
SQL
Snowflake
MongoDB
Cosmos DB
Hive
Cassandra
Neo4j
TigerGraph
DBT
Airbyte

Vertrauen Sie auf Randstad

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.