Experienced full stack Data engineer, Python Expert, Certified Tableau Desktop Specialist. DWH design and ETL development.
Aktualisiert am 03.11.2023
Profil
Mitarbeiter eines Dienstleisters
Remote-Arbeit
Verfügbar ab: 12.11.2023
Verfügbar zu: 100%
davon vor Ort: 100%
Skill-Profil eines fest angestellten Mitarbeiters des Dienstleisters
English
Fortgeschritten

Einsatzorte

Deutschland
möglich

Projekte

1 Monat
2023-10 - heute

Databricks migration project

Team Lead Data Engineer Databricks Pyspark SQL ...
Team Lead Data Engineer
? Create project plan and technical strategy
? Converting Oracle UDF functions to Pyspark code
? Develop Pytests and Integration tests
? Define development strategy in pair with project Architect
? Estimate project scope and required efforts
? Code and documentation review
? Lead canban board and daily standups
? Plan workload for all team members, setup communication process
? Create and support backlog for the project, keep the board organized
? Daily communications with the client
Databricks Pyspark SQL Python Azure Cloud
11 Monate
2023-01 - 2023-11

Azure Data Platform

Senior Data Engineer Azure Synapse SQL ...
Senior Data Engineer
?Create and debug Azure Synapse ETL pipelines
?Create ETL logic using Azure SQL
?Data Model update and product regeneration using Erwin
?Create and debug file processing logic using PySpark
?Communication with Data Modeling and Infrastructure teams to confirm business and technical requirements
?Create CI/CD pipelines using GitHub Actions
?Pacticipate in achitectural changes and product stabilization
?Support initial stages of UAT
?Create approaches of product code generation, testing, logging, data processing
?Create POC to validate technical decisions
Azure Synapse SQL Pyspark Python Erwin Scrum
10 Monate
2022-03 - 2022-12

Marketing ETL platform

Senior Data Engineer Python Luigi BigQuery ...
Senior Data Engineer
? Develop Python ETL jobs to retrieve marketing data from API sources
? Develop Luigi tasks to orchestrate ETL process
? Data research and bug fixing in BigQuery
? Jenkins jobs creation and bug fix
? Google Analytics data retrieval using API
? Optimize and bug fix Python code
Python Luigi BigQuery Google Analytics API Pytests
1 Jahr
2021-03 - 2022-02

Global Data Platform

Senior Data Engineer Python Erwin AWS Redshift ...
Senior Data Engineer
? Develop SQL procedures and code-generation logic in Erwin using Fet
files
? Develop architectural solutions for orchestration, logging, error
handling, incremental strategy, testing concept etc.
? Develop Lambda, Step Functions and Glue Jobs application code
? Develop event-driven architecture concept based on Event Bridge
? Integrate git usage best practises among team (setup protection
rules, PR templates review process etc.)
? Technical documentation creation and code review
? Present stories at the end of the Sprint to Business departments
Python Erwin AWS Redshift Jenkins Docker AWS Lambda AWS Glue; AWS Step Functions AWS Lake Formation AWS S3 AWS IAM AWS Event Bridge AWS SQS AWS CloudWatch PySpark Jira Git
11 Monate
2020-11 - 2021-09

Counterparty monitoring system application support

Senior Consultant PostgreSQL Mulesoft Integration Jira ...
Senior Consultant
? First line support consultation
? System health monitoring and issue tracking
? Communication with developers regarding new features and bug fixes
? Communication with teams of integrated applications
? SQL query optimization and performance tuning
? Investigation and fix of broken data
? Data migration for new features
? Assigning tasks among members of th
PostgreSQL Mulesoft Integration Jira Git Eclipse Java API JSON
1 Jahr 2 Monate
2020-01 - 2021-02

Multistack Global Data Warehouse ? Evolvement of corporate insurance code-generation product used for providing universal datawarehouse to enable reporting capabilities for particular departments.

Data Engineer Python Erwin Oracle ...
Data Engineer

? Develop ETL Python application

? Unit Test development using Pytest

? Develop Kafka Streaming application

? Jenkins jobs creation

? Convert SQL logic from Oracle to PostgreSQL

? Create Deployment Utility application for db deployment

? Develop SQL Health Check Framework

? Github project setup

? Developing of application upgrade strategies

? Help in project organization and processes improvement

? Participating in discussions of architectural concepts

? Documentation creation

? Mentoring of new team members

Python Erwin Oracle PostgreSQL Jira Git kafka Azure Synapse KSQL
1 Jahr 8 Monate
2018-06 - 2020-01

Integration of multiple CRM Systems into Salesforce instance

ETL DEVELOPER, DATA ARCHITECT Talend Open Studio PostgreSQL RestAPI ...
ETL DEVELOPER, DATA ARCHITECT

  • ETL Processes Development using Talend and RestAPI sources
  • SQL scripts creation for data analysis
  • Data analysis, cleaning and enrichment using SQL and Talend
  • Data integration (data from Microsoft Dynamics, Salesforce, Pipedrive)
  • UAT & Production data upload using Talend

Talend Open Studio PostgreSQL RestAPI Salesforse Pipedrive Microsoft Dynamics Jira
4 Monate
2018-03 - 2018-06

A system for long-term storing and reporting of medical data

ETL DEVELOPER SQL Server T-SQL Jira
ETL DEVELOPER

  • Implementation of data transformation scripts (SQL Server) to bring data from different sources
  • Fix stored procedures and triggers to fit new requirements
  • Application data modeling to support data from different sources
  • UAT and production data upload using a custom ETL tool

SQL Server T-SQL Jira
4 Monate
2017-12 - 2018-03

DBA and ETL developer as part of a support team for a number of applications

DBA, ETL DEVELOPER DB2 SQL IBM Infosphere Datastage ...
DBA, ETL DEVELOPER

  • ETL Processes Development using IBM Infosphere Datastage
  • SQL scripts development and optimization (DB2)
  • Daily ETL routine execution support
  • DB2 backup and recovery (Linux systems

DB2 SQL IBM Infosphere Datastage Linux
5 Monate
2017-08 - 2017-12

Financial system for calculation employees? bonuses at a pharmaceutical company

.NET DEVELOPER, OLAP DEVELOPER IBM Cognos TM1 ASP .NET Rest API ...
.NET DEVELOPER, OLAP DEVELOPER

  • Integration of .NET application and OLAP system using RestAPI
  • OLAP system development to store financial data (IBM Cognos TM1)
  • Creation of data cubes views for business analysis
  • Implementation of business logic for accounting documents workflow
  • Application Web UI Development using HTML, JavaScript, ASP .Net

IBM Cognos TM1 ASP .NET Rest API HTML JavaScript CSS Jira Git
4 Monate
2017-05 - 2017-08

Financial system for calculation distributors? bonuses at a pharmaceutical company

TM1 & BI DEVELOPER Cognos Cognos TM1 Git ...
TM1 & BI DEVELOPER

  • OLAP Data models development using IBM Cognos TM1
  • Implementation of distributors' bonuses calculation
  • IBM Cognos environment setup and configuration
  • Setup and support git repository to provide version control of TM1 processes

Cognos Cognos TM1 Git JIRA
4 Monate
2017-02 - 2017-05

HR System, commercial product of IBA Group.

Java developer Java SQL Git ...
Java developer

  • Oracle database installation and configuration (dev environments)
  • Database structure refactoring and optimization
  • Implementation of new business requirements using Java
  • Migration of database structure from MySQL to Oracle

Java SQL Git JIRA

Kompetenzen

Schwerpunkte

Azure
Experte
AWS
Experte
ETL
Experte
Python
Experte
PySpark
Experte

Vertrauen Sie auf GULP

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das GULP Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.