Experienced Data Engineer | ELT-/ETL-Development | Data Warehousing | SQL-Development | Python-Development | Containerization | CI/CD-Development
Aktualisiert am 25.05.2024
Profil
Freiberufler / Selbstständiger
Remote-Arbeit
Verfügbar ab: 16.06.2024
Verfügbar zu: 100%
davon vor Ort: 50%
SQL
Python
ETL
Datawarehouse
MS SQL Server
dbt
Docker
Kubernetes
Container
Git
NoSQL
Apache Kafka
Apache Spark
Data Integration
CI/CD
Kommunikation
Gitlab
Github
Scrum
Apache Airflow
Kafka
Business Intelligence
Data Modeling
English
Verhandlungssicher
German
Muttersprache

Einsatzorte

Einsatzorte

Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

7 months
2023-03 - 2023-09

Development of a Data Platform

Data Engineer Python Kubernetes Apache Airflow ...
Data Engineer

Development of a data infrastructure for the automated provision of various socio economic data to support strategical decision-making

  • Design, development, testing, and monitoring of ELT-processes from data sources into Data Warehouse and Data Lake
  • Analysis of new variably structured data sources to be integrated
  • Implementation &expansion ofdata modelsforan optimal data and reportingarchitecture
  • Design of automated data quality and data availability processes to ensure Service Level Agreements
  • Design, development and implementation of improvements of the data engineering workflow using CI/CD and templating Solutions
  • Analysis and optimization of Solutions in production.
  • Development of PoCs for use cases in the area of Streaming technologies

Atlassian JIRA Atlassian Confluence Artifactory Gitlab SAP HANA
Python Kubernetes Apache Airflow Bash Minio Docker Apache Spark Apache Kafka Git SQL (Hana) Apache Spark (PySpark) Gitlab(-CI) Artifactory Confluence/Jira SCRUM Test-Driven Development Code Reviews Mob Coding Procedural Programming
Bundesdruckerei Gruppe
Berlin
1 year 7 months
2021-07 - 2023-01

Development of an Enterprise Data Warehouse

Data Engineer SQL Python MS SQL Server ...
Data Engineer

Design, development, deployment, Operation and continuous improvement of an in-house enterprise data warehouse as a central data source for all internal and external reporting.

  • Requirementsgatheringand documentation oftheexistingdata infrastructure
  • Design of the new data platform
  • Development of the data model and ELT pipelines
  • Automation of the development and deployment process
  • 3rd-level support and process optimization of the data platform
  • Ongoing development with changing requirements
  • Consulting data consumers in the PoC stage

MS SQL Server Metabase PostgreSQL Atlassian JIRA Atlassian Confluence Atlassian Bitbucket
SQL Python MS SQL Server dbt Apache Airflow Bash Docker Kubernetes PowerShell Drone CI Git SQL (T-SQL) Metabase Git (Bitbucket) Confluence/Jira Agile Project Management Code Reviews Pair Programming Object-Oriented Programming (OOP)
EWERK Group
Leipzig
11 months
2020-11 - 2021-09

Continuous Development of a Financial Data Warehouse

Financial Consultant SQL Python MS SQL Server ...
Financial Consultant

Operation and continuous development of an automated reporting System for financial reporting

  • IT operations of the existing reporting System to support all finance processes
  • Source System analysis and continuous development of the data model and ETL processes
  • Data Integration from databases, REST APIs, HTML scrapings and files
  • Performance optimization of existing ETL processes
  • Creation of automated reports
  • Operations of the associated database Servers

Atlassian JIRA Atlassian Confluence Atlassian Bitbucket Windows Server 2016 MS SQL Server MS SQL Server Integration Services Pentaho
SQL Python MS SQL Server PowerShell Git Power Query T-SQL SQL Server Agent SSIS) Windows Server Hitachi Pentaho Git (Bitbucket) Confluence/Jira Excel (Power Query) Code Reviews Code Refactoring Procedural Programming Iteration Planning& Iteration Reviews
EWERK Group
Leipzig
3 months
2020-08 - 2020-10

Development of a Distributed Reporting System

BI Consultant T-SQL MS SQL Server Confluence/Jira ...
BI Consultant

Development, deployment and Operation of a System for distributed data input, central data storage and flexible reporting to automate manual reporting processes 

  • Requirements management
  • Project management including invoicing
  • Deployment of the company's proprietary OCT Standard solution
  • Design and Implementation of T-SQL-procedures
  • Implementation of new ETL pipelines to ingest accounting data
  • Design of reporting templates

MS SQL Server OCT Pentaho Atlassian Confluence Atlassian JIRA Atlassian Bitbucket MS Excel
T-SQL MS SQL Server Confluence/Jira OCT (proprietary tool) Hitachi Pentaho Git (Bitbucket) Excel (Power Query) Windows Scheduler Requirements Engineering Agile Project Management Code Reviews
saxess software GmbH
Leipzig

Aus- und Weiterbildung

Aus- und Weiterbildung

4 years
2014-10 - 2018-09

Business Administration

Master of Science, Universität Leipzig
Master of Science
Universität Leipzig
  • Finance, Tax and Reporting
3 years
2011-10 - 2014-09

Business Administration

Bachelor of Science, Universität Leipzig
Bachelor of Science
Universität Leipzig
  • Finance, Tax and Reporting

Kompetenzen

Kompetenzen

Top-Skills

SQL Python ETL Datawarehouse MS SQL Server dbt Docker Kubernetes Container Git NoSQL Apache Kafka Apache Spark Data Integration CI/CD Kommunikation Gitlab Github Scrum Apache Airflow Kafka Business Intelligence Data Modeling

Produkte / Standards / Erfahrungen / Methoden

Resume Summary
  • Data Engineer with more than 3.5years of experience in developingand maintaining data Solutions, specialized in pipeline and database development for analytical use cases. Lateral thinker Converting business requirements to user-satisfying data Solutions. 
  • Recommended team plaver able to move the whole team towards a common goal.


Core Competencies

  • Data Ingestion & Integration 
  • ETL/ELT-Development 
  • DataOps 
  • Data Warehousing 
  • Data Modeling 
  • Containerization 
  • Private Cloud Development 
  • CI/CD-Development 
  • EfficientTroubleshooting 
  • Effective Communication


Professional Experience

03/2023 - 09/2023:

Role: Data Engineer

Customer: Bundesdruckerei-Gruppe


Tasks:

  • Developed and maintained batch and data Streaming processes
  • Automated developer workflow via CI/CD-Pipelines
  • Evaluated data-solutions for new use cases
  • Designed development Standards to improve the codebase


07/2021 - 01/2023:

Role: Data Engineer

Customer: EWERK Group - Leipzig, Germany


Tasks:

  • Developed and maintained Python-based data ingestion pipelines
  • Developed and deployed transformations using dbt
  • Developed and managed SQL Server and PostgreSQL databases
  • Defined and documented requirements for data applications


11/2020 - 06/2021:

Role: Financial Consultant

Customer: EWERK Group - Leipzig, Germany


Tasks:

  • Maintained and extended the financial Data Warehouse
  • Integrated inhouse ERP-systems under strict data quality constraints
  • Created reports using data from the financial Data Warehouse
  • Advised inhouse developers on Data Governance Standards


01/2020 - 10/2020:

Role: Business Intelligence Consultant

Customer: saxess Software GmbH - Leipzig, Germany


Tasks:

  • Took responsibility for client-side Business Intelligence projects
  • Developed data warehouses on SQL Server and Azure SQL
  • Integrated ERP-systems using pentaho data Integration
  • Wrote documentations for clients and colleagues


Tech Skills

  • SQL (SQL Server, PostgreSQL, Oracle)
  • Python Programming
  • Git (Github/Gitlab/Bitbucket)
  • Docker, Kubernetes & Linux
  • NoSQL (MongoDB, Elasticsearch)
  • dbt
  • Apache Kafka
  • Apache Spark (PySpark)

Branchen

Branchen

Financial Services

Einsatzorte

Einsatzorte

Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

7 months
2023-03 - 2023-09

Development of a Data Platform

Data Engineer Python Kubernetes Apache Airflow ...
Data Engineer

Development of a data infrastructure for the automated provision of various socio economic data to support strategical decision-making

  • Design, development, testing, and monitoring of ELT-processes from data sources into Data Warehouse and Data Lake
  • Analysis of new variably structured data sources to be integrated
  • Implementation &expansion ofdata modelsforan optimal data and reportingarchitecture
  • Design of automated data quality and data availability processes to ensure Service Level Agreements
  • Design, development and implementation of improvements of the data engineering workflow using CI/CD and templating Solutions
  • Analysis and optimization of Solutions in production.
  • Development of PoCs for use cases in the area of Streaming technologies

Atlassian JIRA Atlassian Confluence Artifactory Gitlab SAP HANA
Python Kubernetes Apache Airflow Bash Minio Docker Apache Spark Apache Kafka Git SQL (Hana) Apache Spark (PySpark) Gitlab(-CI) Artifactory Confluence/Jira SCRUM Test-Driven Development Code Reviews Mob Coding Procedural Programming
Bundesdruckerei Gruppe
Berlin
1 year 7 months
2021-07 - 2023-01

Development of an Enterprise Data Warehouse

Data Engineer SQL Python MS SQL Server ...
Data Engineer

Design, development, deployment, Operation and continuous improvement of an in-house enterprise data warehouse as a central data source for all internal and external reporting.

  • Requirementsgatheringand documentation oftheexistingdata infrastructure
  • Design of the new data platform
  • Development of the data model and ELT pipelines
  • Automation of the development and deployment process
  • 3rd-level support and process optimization of the data platform
  • Ongoing development with changing requirements
  • Consulting data consumers in the PoC stage

MS SQL Server Metabase PostgreSQL Atlassian JIRA Atlassian Confluence Atlassian Bitbucket
SQL Python MS SQL Server dbt Apache Airflow Bash Docker Kubernetes PowerShell Drone CI Git SQL (T-SQL) Metabase Git (Bitbucket) Confluence/Jira Agile Project Management Code Reviews Pair Programming Object-Oriented Programming (OOP)
EWERK Group
Leipzig
11 months
2020-11 - 2021-09

Continuous Development of a Financial Data Warehouse

Financial Consultant SQL Python MS SQL Server ...
Financial Consultant

Operation and continuous development of an automated reporting System for financial reporting

  • IT operations of the existing reporting System to support all finance processes
  • Source System analysis and continuous development of the data model and ETL processes
  • Data Integration from databases, REST APIs, HTML scrapings and files
  • Performance optimization of existing ETL processes
  • Creation of automated reports
  • Operations of the associated database Servers

Atlassian JIRA Atlassian Confluence Atlassian Bitbucket Windows Server 2016 MS SQL Server MS SQL Server Integration Services Pentaho
SQL Python MS SQL Server PowerShell Git Power Query T-SQL SQL Server Agent SSIS) Windows Server Hitachi Pentaho Git (Bitbucket) Confluence/Jira Excel (Power Query) Code Reviews Code Refactoring Procedural Programming Iteration Planning& Iteration Reviews
EWERK Group
Leipzig
3 months
2020-08 - 2020-10

Development of a Distributed Reporting System

BI Consultant T-SQL MS SQL Server Confluence/Jira ...
BI Consultant

Development, deployment and Operation of a System for distributed data input, central data storage and flexible reporting to automate manual reporting processes 

  • Requirements management
  • Project management including invoicing
  • Deployment of the company's proprietary OCT Standard solution
  • Design and Implementation of T-SQL-procedures
  • Implementation of new ETL pipelines to ingest accounting data
  • Design of reporting templates

MS SQL Server OCT Pentaho Atlassian Confluence Atlassian JIRA Atlassian Bitbucket MS Excel
T-SQL MS SQL Server Confluence/Jira OCT (proprietary tool) Hitachi Pentaho Git (Bitbucket) Excel (Power Query) Windows Scheduler Requirements Engineering Agile Project Management Code Reviews
saxess software GmbH
Leipzig

Aus- und Weiterbildung

Aus- und Weiterbildung

4 years
2014-10 - 2018-09

Business Administration

Master of Science, Universität Leipzig
Master of Science
Universität Leipzig
  • Finance, Tax and Reporting
3 years
2011-10 - 2014-09

Business Administration

Bachelor of Science, Universität Leipzig
Bachelor of Science
Universität Leipzig
  • Finance, Tax and Reporting

Kompetenzen

Kompetenzen

Top-Skills

SQL Python ETL Datawarehouse MS SQL Server dbt Docker Kubernetes Container Git NoSQL Apache Kafka Apache Spark Data Integration CI/CD Kommunikation Gitlab Github Scrum Apache Airflow Kafka Business Intelligence Data Modeling

Produkte / Standards / Erfahrungen / Methoden

Resume Summary
  • Data Engineer with more than 3.5years of experience in developingand maintaining data Solutions, specialized in pipeline and database development for analytical use cases. Lateral thinker Converting business requirements to user-satisfying data Solutions. 
  • Recommended team plaver able to move the whole team towards a common goal.


Core Competencies

  • Data Ingestion & Integration 
  • ETL/ELT-Development 
  • DataOps 
  • Data Warehousing 
  • Data Modeling 
  • Containerization 
  • Private Cloud Development 
  • CI/CD-Development 
  • EfficientTroubleshooting 
  • Effective Communication


Professional Experience

03/2023 - 09/2023:

Role: Data Engineer

Customer: Bundesdruckerei-Gruppe


Tasks:

  • Developed and maintained batch and data Streaming processes
  • Automated developer workflow via CI/CD-Pipelines
  • Evaluated data-solutions for new use cases
  • Designed development Standards to improve the codebase


07/2021 - 01/2023:

Role: Data Engineer

Customer: EWERK Group - Leipzig, Germany


Tasks:

  • Developed and maintained Python-based data ingestion pipelines
  • Developed and deployed transformations using dbt
  • Developed and managed SQL Server and PostgreSQL databases
  • Defined and documented requirements for data applications


11/2020 - 06/2021:

Role: Financial Consultant

Customer: EWERK Group - Leipzig, Germany


Tasks:

  • Maintained and extended the financial Data Warehouse
  • Integrated inhouse ERP-systems under strict data quality constraints
  • Created reports using data from the financial Data Warehouse
  • Advised inhouse developers on Data Governance Standards


01/2020 - 10/2020:

Role: Business Intelligence Consultant

Customer: saxess Software GmbH - Leipzig, Germany


Tasks:

  • Took responsibility for client-side Business Intelligence projects
  • Developed data warehouses on SQL Server and Azure SQL
  • Integrated ERP-systems using pentaho data Integration
  • Wrote documentations for clients and colleagues


Tech Skills

  • SQL (SQL Server, PostgreSQL, Oracle)
  • Python Programming
  • Git (Github/Gitlab/Bitbucket)
  • Docker, Kubernetes & Linux
  • NoSQL (MongoDB, Elasticsearch)
  • dbt
  • Apache Kafka
  • Apache Spark (PySpark)

Branchen

Branchen

Financial Services

Vertrauen Sie auf Randstad

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.