Data engineer, Cloud (AWS, Azure), and DevOps.
Aktualisiert am 01.05.2024
Profil
Freiberufler / Selbstständiger
Remote-Arbeit
Verfügbar ab: 02.05.2024
Verfügbar zu: 100%
davon vor Ort: 100%
Datawarehouse
data lake
ETL
Apache Spark
Python
TypeScript
data modeling
Data migration
AWS
Azure
DevOps
Automation/Steuerung
Dashboard Design
CI/CD
Java
databricks
FastAPI
RestAPI
Node.js
JavaScript
English
Highly proficient
Arabic
Muttersprache
French
Muttersprache
German
Beginner (A1)

Einsatzorte

Einsatzorte

Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

8 months
2023-09 - now

Various projects

Cloud Data engineer
Cloud Data engineer
7 months
2023-03 - 2023-09

Data Migration and Data stream for Driver Assistance Large scale project

Data Engineer & DataOps Python Spark Fast API ...
Data Engineer & DataOps
  • Conducted data validation and quality checks for the Driving Assistance Project, ensuring accuracy and reliability of collected data
  • Achieved a successful migration of automated-testing project from on-premise environment to Microsoft Azure, the optimization of system performance and its scalability
  • Designed the Architecture of the data pipeline for data stream
  • Implemented Kafka for data streaming, facilitating real-time data flow from diverse APIs to the recomputing unit and Test Framework
Python Spark Fast API Docker Kubernetes Kafka MongoDB CouchDB MS Azure Services
Robert Bosch GmbH
Stuttgart, Germany
1 year
2022-03 - 2023-02

Created and deployed interactive dashboards to monitor employees engagement

Data Engineer-Analyst Python PySpark AWS (Lambda ...
Data Engineer-Analyst

Created and deployed interactive dashboards to monitor employees engagement with Shortways solutions

  • Developed interactive AWS QuickSight dashboards for real-time employee engagement monitoring
  • Designed and implemented efficient data pipelines, ensuring seamless data flow
  • Automated ETL processes using AWS Glue (PySpark) to enhance data transformation and loading
  • Managed Data Lake infrastructure to facilitate data storage and retrieval
  • Ingested data from diverse sources using Athena SQL and Python for analysis
  • Streamlined dashboard creation through automation

Python PySpark AWS (Lambda S3 RDS Redshift Glue Athena Quicksight boto3) docker git GitHub MySQL TypeScript
Shortways
Mayenne, France
1 year
2021-01 - 2021-12

Successfully enhanced and scaled advanced analytics applications

Junior Data Analyst Python R Git ...
Junior Data Analyst
Successfully enhanced and scaled advanced analytics applications, utilizing R/R Shiny, focused on Agricultural Projects and plant health research.
  • Automated data cleansing processes to ensure data quality
  • Detected and reported data anomalies
  • Prepared data for comprehensive visualization and analysis
  • Designed robust Data Models and architectural solutions to optimize data management
  • Improved and scaled advanced R Shiny applications, tailored for Agricultural Projects and plant health research
  • Produced detailed visualization reports using Power BI for data-driven insights
Python R Git GitHub GitHub Action Docker AWS Power BI
Bioline by Invivo
Reims, France

Aus- und Weiterbildung

Aus- und Weiterbildung

1 year 1 month
2019-09 - 2020-09

Artificial Intelligence and Robotics

M.Sc. 1, CY Cergy Paris University, Cergy, France
M.Sc. 1
CY Cergy Paris University, Cergy, France
1 year 11 months
2017-09 - 2019-07

Business Intelligence and Optimization

M.Sc., University of Mohamed Boudiaf, Algeria
M.Sc.
University of Mohamed Boudiaf, Algeria
2 years 11 months
2013-09 - 2016-07

Computer Science

Bachelor, University of Mohamed Boudiaf, Algeria
Bachelor
University of Mohamed Boudiaf, Algeria

Kompetenzen

Kompetenzen

Top-Skills

Datawarehouse data lake ETL Apache Spark Python TypeScript data modeling Data migration AWS Azure DevOps Automation/Steuerung Dashboard Design CI/CD Java databricks FastAPI RestAPI Node.js JavaScript

Produkte / Standards / Erfahrungen / Methoden

Profile:

  • Experienced Data Engineer with an proficiency in Python, AWS, SQL, and cloud-based technologies
  • Achieved architecting and delivering scalable data products, optimizing ETL workflows, and creating cutting-edge data visualizations using leading BI tools
  • Committed to continuous professional growth and leveraging tech expertise to elevate projects to new heights


SKILLS:

Python

  • NumPy
  • Scikit-learn
  • TensorFlow
  • PyTorch
  • Keras
  • Pandas
  • Matplotlib
  • Seaborn
  • SpaCy
  • PySpark
  • fast.ai


Big data

  • Apache Spark
  • Kafka


Data stack

  • MS SQL server
  • MySQL
  • Oracle
  • PostgreSQL
  • MongoDB
  • Neo4j


BI tools

  • MS Power BI
  • Amazon Quicksight
  • GIT - GitHub ? GitLab ? Docker, Kubernetes


AWS

  • S3
  • RDS
  • Redshift
  • Glue
  • Amazon EMR
  • Kinesis
  • Athena
  • Quicksight


MS AZURE

  • Cosmos DB
  • Data Factory
  • Databricks
  • Stream Analytics
  • Synapse Analytics
  • Data Lake Storage


C, C++, JAVA | Web Dev

  • HTML
  • CSS
  • JavaScript
  • Node.js
  • TypeScript
  • R - R shiny - R server ? Ggplot, SparkR- R deployment


INTERNSHIP:

04/2020 - 08/2020

Role:  Research Intern 

Customer: Institute of intelligent Systems and robotics (ISIR), Sorbonne University - Paris, France


Tasks:

  • Optimizing brain-inspired neural networks model - (Spike neural networks)


Skills:

Python (Brian2) - MySQL


02/2019 - 07/2019

Role: Research Intern

Customer: LMPA Lab, University of Mohamed Boudiaf Algeria


Tasks:

  • Design and Discovery using Deep Neural networks (Comparative Study)


Skills:

Models: ML supervised Models, Feed Forward NN, CNN, Molecule Generator: RDKit, Mordred, alvaDesc 1.0., Python: NumPy, Scikit-learn, TensorFlow, Keras, Pandas, Matplotlib

Einsatzorte

Einsatzorte

Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

8 months
2023-09 - now

Various projects

Cloud Data engineer
Cloud Data engineer
7 months
2023-03 - 2023-09

Data Migration and Data stream for Driver Assistance Large scale project

Data Engineer & DataOps Python Spark Fast API ...
Data Engineer & DataOps
  • Conducted data validation and quality checks for the Driving Assistance Project, ensuring accuracy and reliability of collected data
  • Achieved a successful migration of automated-testing project from on-premise environment to Microsoft Azure, the optimization of system performance and its scalability
  • Designed the Architecture of the data pipeline for data stream
  • Implemented Kafka for data streaming, facilitating real-time data flow from diverse APIs to the recomputing unit and Test Framework
Python Spark Fast API Docker Kubernetes Kafka MongoDB CouchDB MS Azure Services
Robert Bosch GmbH
Stuttgart, Germany
1 year
2022-03 - 2023-02

Created and deployed interactive dashboards to monitor employees engagement

Data Engineer-Analyst Python PySpark AWS (Lambda ...
Data Engineer-Analyst

Created and deployed interactive dashboards to monitor employees engagement with Shortways solutions

  • Developed interactive AWS QuickSight dashboards for real-time employee engagement monitoring
  • Designed and implemented efficient data pipelines, ensuring seamless data flow
  • Automated ETL processes using AWS Glue (PySpark) to enhance data transformation and loading
  • Managed Data Lake infrastructure to facilitate data storage and retrieval
  • Ingested data from diverse sources using Athena SQL and Python for analysis
  • Streamlined dashboard creation through automation

Python PySpark AWS (Lambda S3 RDS Redshift Glue Athena Quicksight boto3) docker git GitHub MySQL TypeScript
Shortways
Mayenne, France
1 year
2021-01 - 2021-12

Successfully enhanced and scaled advanced analytics applications

Junior Data Analyst Python R Git ...
Junior Data Analyst
Successfully enhanced and scaled advanced analytics applications, utilizing R/R Shiny, focused on Agricultural Projects and plant health research.
  • Automated data cleansing processes to ensure data quality
  • Detected and reported data anomalies
  • Prepared data for comprehensive visualization and analysis
  • Designed robust Data Models and architectural solutions to optimize data management
  • Improved and scaled advanced R Shiny applications, tailored for Agricultural Projects and plant health research
  • Produced detailed visualization reports using Power BI for data-driven insights
Python R Git GitHub GitHub Action Docker AWS Power BI
Bioline by Invivo
Reims, France

Aus- und Weiterbildung

Aus- und Weiterbildung

1 year 1 month
2019-09 - 2020-09

Artificial Intelligence and Robotics

M.Sc. 1, CY Cergy Paris University, Cergy, France
M.Sc. 1
CY Cergy Paris University, Cergy, France
1 year 11 months
2017-09 - 2019-07

Business Intelligence and Optimization

M.Sc., University of Mohamed Boudiaf, Algeria
M.Sc.
University of Mohamed Boudiaf, Algeria
2 years 11 months
2013-09 - 2016-07

Computer Science

Bachelor, University of Mohamed Boudiaf, Algeria
Bachelor
University of Mohamed Boudiaf, Algeria

Kompetenzen

Kompetenzen

Top-Skills

Datawarehouse data lake ETL Apache Spark Python TypeScript data modeling Data migration AWS Azure DevOps Automation/Steuerung Dashboard Design CI/CD Java databricks FastAPI RestAPI Node.js JavaScript

Produkte / Standards / Erfahrungen / Methoden

Profile:

  • Experienced Data Engineer with an proficiency in Python, AWS, SQL, and cloud-based technologies
  • Achieved architecting and delivering scalable data products, optimizing ETL workflows, and creating cutting-edge data visualizations using leading BI tools
  • Committed to continuous professional growth and leveraging tech expertise to elevate projects to new heights


SKILLS:

Python

  • NumPy
  • Scikit-learn
  • TensorFlow
  • PyTorch
  • Keras
  • Pandas
  • Matplotlib
  • Seaborn
  • SpaCy
  • PySpark
  • fast.ai


Big data

  • Apache Spark
  • Kafka


Data stack

  • MS SQL server
  • MySQL
  • Oracle
  • PostgreSQL
  • MongoDB
  • Neo4j


BI tools

  • MS Power BI
  • Amazon Quicksight
  • GIT - GitHub ? GitLab ? Docker, Kubernetes


AWS

  • S3
  • RDS
  • Redshift
  • Glue
  • Amazon EMR
  • Kinesis
  • Athena
  • Quicksight


MS AZURE

  • Cosmos DB
  • Data Factory
  • Databricks
  • Stream Analytics
  • Synapse Analytics
  • Data Lake Storage


C, C++, JAVA | Web Dev

  • HTML
  • CSS
  • JavaScript
  • Node.js
  • TypeScript
  • R - R shiny - R server ? Ggplot, SparkR- R deployment


INTERNSHIP:

04/2020 - 08/2020

Role:  Research Intern 

Customer: Institute of intelligent Systems and robotics (ISIR), Sorbonne University - Paris, France


Tasks:

  • Optimizing brain-inspired neural networks model - (Spike neural networks)


Skills:

Python (Brian2) - MySQL


02/2019 - 07/2019

Role: Research Intern

Customer: LMPA Lab, University of Mohamed Boudiaf Algeria


Tasks:

  • Design and Discovery using Deep Neural networks (Comparative Study)


Skills:

Models: ML supervised Models, Feed Forward NN, CNN, Molecule Generator: RDKit, Mordred, alvaDesc 1.0., Python: NumPy, Scikit-learn, TensorFlow, Keras, Pandas, Matplotlib

Vertrauen Sie auf GULP

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das GULP Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.