Data Engineering+Cloud+ Python + Microsoft Fabric + Microsoft Dynamics 365 + Azure data factory + Data Bricks+ SQL Server +PySpark
Aktualisiert am 04.07.2024
Profil
Freiberufler / Selbstständiger
Remote-Arbeit
Verfügbar ab: 31.07.2024
Verfügbar zu: 100%
davon vor Ort: 5%
Data Engineer
Azure Devops
Microsoft Fabric
Databricks
MS Azure SQL Database
Python
MS Power BI
Microsoft Dynamics

Einsatzorte

Einsatzorte

Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

1 year 7 months
2022-10 - 2024-04

Designing & Implementation of delta Lakehouse on sensor data (ingestion, Analytics)

Senior Data Engineer Python Databricks Microsoft fabric
Senior Data Engineer

?         Designing the Architecture for Lakehouse in Microsoft Azure Cloud

?         Implementation of Landing Zone using Azure Databricks (Redis, Azure Function)

?         Customizable Framework to implement curated and Serving zone in Azure Databricks (Python)

?         Automated ETL/ELT Architecture using Azure Data Factory Pipelines

·       ETL strategy for import of Billions of JSON files

·       Handling Multiple JSON files with all dynamic Pivoting, Flatten and schema operations using Databricks python notebooks.

·       Controlling Table contents & Columns of ALL JSONS Business lines

·       Performance & Optimization Techniques on terabytes of data

·       Complete Power BI Dashboard for all serving tables.

Lake, Data Factory, Databricks, Python (PySpark+SQL ,Panda), ESB,  Azure Function, Power BI, Dedicated SQL Pool ,Azure DevOps CI/CD ,Git repo, Microsoft Fabrics Platform

Python Databricks Microsoft fabric
Artizan Technologies UK
Remote

Aus- und Weiterbildung

Aus- und Weiterbildung

2 years 1 month
2009-10 - 2011-10

Master

Computer Science/ E-business, University of applied sciences Fulda
Computer Science/ E-business
University of applied sciences Fulda

Einsatzorte

Einsatzorte

Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

1 year 7 months
2022-10 - 2024-04

Designing & Implementation of delta Lakehouse on sensor data (ingestion, Analytics)

Senior Data Engineer Python Databricks Microsoft fabric
Senior Data Engineer

?         Designing the Architecture for Lakehouse in Microsoft Azure Cloud

?         Implementation of Landing Zone using Azure Databricks (Redis, Azure Function)

?         Customizable Framework to implement curated and Serving zone in Azure Databricks (Python)

?         Automated ETL/ELT Architecture using Azure Data Factory Pipelines

·       ETL strategy for import of Billions of JSON files

·       Handling Multiple JSON files with all dynamic Pivoting, Flatten and schema operations using Databricks python notebooks.

·       Controlling Table contents & Columns of ALL JSONS Business lines

·       Performance & Optimization Techniques on terabytes of data

·       Complete Power BI Dashboard for all serving tables.

Lake, Data Factory, Databricks, Python (PySpark+SQL ,Panda), ESB,  Azure Function, Power BI, Dedicated SQL Pool ,Azure DevOps CI/CD ,Git repo, Microsoft Fabrics Platform

Python Databricks Microsoft fabric
Artizan Technologies UK
Remote

Aus- und Weiterbildung

Aus- und Weiterbildung

2 years 1 month
2009-10 - 2011-10

Master

Computer Science/ E-business, University of applied sciences Fulda
Computer Science/ E-business
University of applied sciences Fulda

Vertrauen Sie auf Randstad

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.