Data Engineering+Cloud+ Python + Microsoft Fabric + Microsoft Dynamics 365 + Azure data factory + Data Bricks+ SQL Server +PySpark
Aktualisiert am 15.08.2024
Profil
Freiberufler / Selbstständiger
Remote-Arbeit
Verfügbar ab: 15.08.2024
Verfügbar zu: 100%
davon vor Ort: 5%
Data Engineer
Azure Devops
Microsoft Fabric
Databricks
MS Azure SQL Database
Python
MS Power BI
Microsoft Dynamics
German
Good
English
Excellent

Einsatzorte

Einsatzorte

Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

1 year 7 months
2022-10 - 2024-04

Designing & Implementation of delta Lakehouse on sensor data (ingestion, Analytics)

Senior Data Engineer Python Databricks Microsoft fabric ...
Senior Data Engineer

  • Designing the Architecture for Lakehouse in Microsoft Azure Cloud
  • Implementation of Landing Zone using Azure Databricks (Redis, Azure Function)
  • Customizable Framework to implement curated and Serving zone in Azure Databricks (Python)
  • Automated ETL/ELT Architecture using Azure Data Factory Pipelines
    • ETL strategy for import of Billions of JSON files
    • Handling Multiple JSON files with all dynamic Pivoting, Flatten and schema operations using Databricks python notebooks.
    • Controlling Table contents & Columns of ALL JSONS Business lines
    • Performance & Optimization Techniques on terabytes of data
    • Complete Power BI Dashboard for all serving tables.

Python Databricks Microsoft fabric Lake Data Factory Python (PySpark+SQL Panda) ESB Azure Function Power BI Dedicated SQL Pool Azure DevOps CI/CD Git repo Microsoft Fabrics Platform
Artizan Technologies UK
Remote

Aus- und Weiterbildung

Aus- und Weiterbildung

2 years 1 month
2009-10 - 2011-10

Master

Computer Science/ E-business, University of applied sciences Fulda
Computer Science/ E-business
University of applied sciences Fulda

Kompetenzen

Kompetenzen

Top-Skills

Data Engineer Azure Devops Microsoft Fabric Databricks MS Azure SQL Database Python MS Power BI Microsoft Dynamics

Produkte / Standards / Erfahrungen / Methoden

Working Experiences
10.2022 - 04.2024
Customer: Artizan Technologies? Solcom Partner?Carl Zeiss 
Role: Senior Data Engineer Remote 

03.2022 - 10.2022
Customer: Flaschenpost GmbH, Germany
Role: Senior Data Engineer Remote 

09.2021 - 03.2022
Customer: E. ON Energy
Role: Senior Data Engineer Remote 

07.2021 - 04.2022
Customer: Hays (German Client)- PlayMobil
Role: Senior Data Engineer Remote 

01.2020 - 06.2021
Customer: Artizan Technologies UK- Hermes
Role: Senior Data Specialist Azure Cloud Remote

08.2019 ? 01.2020
Customer: Sycor GmbH 
Role: Senior BI Consultant for Azure Cloud Göttingen 

2017 - 08.2019
Customer: Aloys F. Dornbracht GmbH & Co. KG
Role: Senior Software Specialist (BI & DWH) Iserlohn

04.2016 ? 09.2016
Customer: Beontra GmbH Karlsruhe 
Role: DWH / BI Consultant 

03.2013 ? 09. 2015
Customer: Adastra GmbH Wolfsburg 
Role: DWH / BI Consultant 

09.2012 ? 01. 2013
Customer: DIMQ GmbH  Köln 
Role: DWH Developer

03.2011 ?02.2012
Customer: Siemens AG,  München 
Role: Corporate Technology Research Assistant

06.2009 ? 12.2010
Customer: Via Software GmbH Dreieich 
Role: IT Developer (Student) 

12. 2007 ? 07.2008
Customer: Institute for Scientific Computing an der TU Braunschweig  Braunschweig 

Role: Research Assistant (Student)


Projects Total

  • 8+ Cloud
  • 6+ OnPremise
  • 3+ Frameworks
  • 3 Devops-CI/CD
  • 3 Dynamics&SAP
  • 2 &1 Worked in Orgs
  • 9 Exp. in Years ETL
  • 10+ Cloud DevOps
  • 5+ SQL DBs
  • 10 + Data Modeling
  • 5+ Azure Synapse
  • 2+ Power BI& Tableau
  • 4+ Databrick
  • 5+ (Pyspark)

Technology Tools & Framework
Data Warehouse
ETL/BI Informatica PowerCenter, SAP BW, Microsoft SQL Server SSIS & SSAS, Pentaho 6.1, SAP BW & SAP Business object

Others 
J2EE Framework, JPA Framework, XAMPP, MS Visio, MS Project

Programmiersprachen

SQL
PL-SQL
Java
Java-Script
PHP 4
Java Beans
Eclipse
Oracle Application Express (APEX)

Datenbanken

Oracle
MS-SQL Server,
DB2

Einsatzorte

Einsatzorte

Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

1 year 7 months
2022-10 - 2024-04

Designing & Implementation of delta Lakehouse on sensor data (ingestion, Analytics)

Senior Data Engineer Python Databricks Microsoft fabric ...
Senior Data Engineer

  • Designing the Architecture for Lakehouse in Microsoft Azure Cloud
  • Implementation of Landing Zone using Azure Databricks (Redis, Azure Function)
  • Customizable Framework to implement curated and Serving zone in Azure Databricks (Python)
  • Automated ETL/ELT Architecture using Azure Data Factory Pipelines
    • ETL strategy for import of Billions of JSON files
    • Handling Multiple JSON files with all dynamic Pivoting, Flatten and schema operations using Databricks python notebooks.
    • Controlling Table contents & Columns of ALL JSONS Business lines
    • Performance & Optimization Techniques on terabytes of data
    • Complete Power BI Dashboard for all serving tables.

Python Databricks Microsoft fabric Lake Data Factory Python (PySpark+SQL Panda) ESB Azure Function Power BI Dedicated SQL Pool Azure DevOps CI/CD Git repo Microsoft Fabrics Platform
Artizan Technologies UK
Remote

Aus- und Weiterbildung

Aus- und Weiterbildung

2 years 1 month
2009-10 - 2011-10

Master

Computer Science/ E-business, University of applied sciences Fulda
Computer Science/ E-business
University of applied sciences Fulda

Kompetenzen

Kompetenzen

Top-Skills

Data Engineer Azure Devops Microsoft Fabric Databricks MS Azure SQL Database Python MS Power BI Microsoft Dynamics

Produkte / Standards / Erfahrungen / Methoden

Working Experiences
10.2022 - 04.2024
Customer: Artizan Technologies? Solcom Partner?Carl Zeiss 
Role: Senior Data Engineer Remote 

03.2022 - 10.2022
Customer: Flaschenpost GmbH, Germany
Role: Senior Data Engineer Remote 

09.2021 - 03.2022
Customer: E. ON Energy
Role: Senior Data Engineer Remote 

07.2021 - 04.2022
Customer: Hays (German Client)- PlayMobil
Role: Senior Data Engineer Remote 

01.2020 - 06.2021
Customer: Artizan Technologies UK- Hermes
Role: Senior Data Specialist Azure Cloud Remote

08.2019 ? 01.2020
Customer: Sycor GmbH 
Role: Senior BI Consultant for Azure Cloud Göttingen 

2017 - 08.2019
Customer: Aloys F. Dornbracht GmbH & Co. KG
Role: Senior Software Specialist (BI & DWH) Iserlohn

04.2016 ? 09.2016
Customer: Beontra GmbH Karlsruhe 
Role: DWH / BI Consultant 

03.2013 ? 09. 2015
Customer: Adastra GmbH Wolfsburg 
Role: DWH / BI Consultant 

09.2012 ? 01. 2013
Customer: DIMQ GmbH  Köln 
Role: DWH Developer

03.2011 ?02.2012
Customer: Siemens AG,  München 
Role: Corporate Technology Research Assistant

06.2009 ? 12.2010
Customer: Via Software GmbH Dreieich 
Role: IT Developer (Student) 

12. 2007 ? 07.2008
Customer: Institute for Scientific Computing an der TU Braunschweig  Braunschweig 

Role: Research Assistant (Student)


Projects Total

  • 8+ Cloud
  • 6+ OnPremise
  • 3+ Frameworks
  • 3 Devops-CI/CD
  • 3 Dynamics&SAP
  • 2 &1 Worked in Orgs
  • 9 Exp. in Years ETL
  • 10+ Cloud DevOps
  • 5+ SQL DBs
  • 10 + Data Modeling
  • 5+ Azure Synapse
  • 2+ Power BI& Tableau
  • 4+ Databrick
  • 5+ (Pyspark)

Technology Tools & Framework
Data Warehouse
ETL/BI Informatica PowerCenter, SAP BW, Microsoft SQL Server SSIS & SSAS, Pentaho 6.1, SAP BW & SAP Business object

Others 
J2EE Framework, JPA Framework, XAMPP, MS Visio, MS Project

Programmiersprachen

SQL
PL-SQL
Java
Java-Script
PHP 4
Java Beans
Eclipse
Oracle Application Express (APEX)

Datenbanken

Oracle
MS-SQL Server,
DB2

Vertrauen Sie auf Randstad

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.