Experienced Data engineer with focus on ETL and DWH design
Aktualisiert am 03.11.2023
Profil
Mitarbeiter eines Dienstleisters
Remote-Arbeit
Verfügbar ab: 12.11.2023
Verfügbar zu: 100%
davon vor Ort: 100%
Skill-Profil eines fest angestellten Mitarbeiters des Dienstleisters

Einsatzorte

Deutschland
möglich

Projekte

5 Monate
2023-06 - 2023-10

Migration from legacy Oracle on-premises ETL solution to Databricks.

senior data engineer Azure Data Factory ADLS Gen2 ...
senior data engineer
? Make solution proposal for the migration
? Migrate Oracle PL/SQL procedures and functions to PySpark
? Extension of existing Python-based module (which used for ETL PySpark transformations)
? Coverage of migrated functions with Pytests.
? E2E one-time testing of migrated solution Vs Oracle.
? Post-migration short-time support (bugfixing).
Azure Data Factory ADLS Gen2 Azure DevOps Databricks Medallion architecture Delta tables Databricks Workflows Spark SQL PySpark Python pandas pyyaml Python Poetry
1 Jahr 4 Monate
2022-03 - 2023-06

development of corporate Global Data Platform

senior data engineer Azure Azure Synapse Analytics Python ...
senior data engineer

  • Requirements analysis
  • modeling Data Vault 2.0
  • ETL migration from Oracle to Azure Synapse Analytics for the global DWH product.
  • Designing PySpark notebooks for Synapse Analytics

Azure Azure Synapse Analytics Python PySpark ERWIN
Azure Azure Synapse Analytics Python PySpark ERWIN
2 Jahre
2021-07 - 2023-06

design of corporate product ? datawarehouse

senior data engineer AWS Docker Jenkins ...
senior data engineer

  • Requirements analysis
  • solution design
  • implementation and testing of ETL and ETL orchestration features for the AWS-based DWH product.

AWS Docker Jenkins Python Oracle PostgreSQL
AWS Docker Jenkins Python Oracle PostgreSQL
2 Jahre 10 Monate
2018-09 - 2021-06

core DWH data area

BI developer, Data Architect Oracle 11g Oracle 12c Jira ...
BI developer, Data Architect

  • Creating and maintaining ETL loads using PL/SQL on Oracle
  • Performance tuning and improvement of existing solutions
  • Developing data flow to upload the data from sources to the dimensional target model
  • Creating integration, regression and unit tests
  • Creating batches and scheduling them via Schedulix
  • Preparing consolidated project documentation: detailed data workflow description, solution design and architecture, technical requirements specification
  • Deployment support and bug fixing
  • Analysis of source data and presenting the results
  • Data modelling, DWH architecture, database design
  • Extending data area by business needs, giving guidance for data modelling, assisting and support in related DWH issues solving
  • Maintaining data area documentation, developing complex BI solutions for migrating core business data to the new data model
  • Constant data quality checks for core business data

Oracle 11g Oracle 12c Jira OLAP Data Warehousing Data Integration Data Quality Assurance Data Analysis Reporting Tortoise SVN Toad for Oracle Schedulix PL/SQL Python
Oracle 11g Oracle 12c Jira OLAP Data Warehousing Data Integration Data Quality Assurance Data Analysis Reporting Tortoise SVN Toad for Oracle Schedulix PL/SQL Python

Kompetenzen

Schwerpunkte

ETL
Experte
python
Experte
Databricks
Experte
Azure
Experte
AWS
Experte
PySpark
Experte

Vertrauen Sie auf GULP

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das GULP Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.