Freelancer: Senior Data Engineer � Informatica IDMC & PowerCenter | PySpark/Spark | Databricks Certified | Remote Contract EU/DACH

Freiberufler / Selbstst�ndiger

Remote-Arbeit

Verf�gbar ab: 01.07.2026

Verf�gbar zu: 100%

davon vor Ort: 0%

Top-Skills

Informatica PowerCenter

IDMC

Apache Spark

PySpark

Python

Databricks

ETL

SQL-Datenbanken

SQL

Oracle

PL/SQL

Einsatzorte

L�nder

Deutschland, Schweiz, �sterreich

Remote-Arbeit

m�glich

Projekte

2 years

2024-07 - now

Developed and optimized containerized PySpark data pipelines

Freelance Senior Data Engineer | Freelance / Contract Python PySpark Pandas ...

Rolle

Freelance Senior Data Engineer | Freelance / Contract

Projektinhalte

PySpark / microservices / Kubernetes/OpenShift / Argo: Developed and optimized containerized PySpark data pipelines; investigated production bugs, skew, bottlenecks, shuffle behavior, partitioning/write strategies and resource usage to reduce runtime and improve cluster efficiency.
Informatica PowerCenter / PL/SQL: Delivered enhancements and fixes for enterprise ETL/DWH processes, working with complex Oracle SQL, PL/SQL and existing PowerCenter implementations.
IDMC Data Integration / PL/SQL / Automic: Implemented fixes and new features in IDMC Data Integration, using complex Oracle SQL/select override logic, PL/SQL and basic Automic scheduling/orchestration exposure.
Informatica CAI / Python: Developed integration and automation logic using Informatica Cloud Application Integration and Python, including REST/API-oriented data exchange flows.
Across these engagements, contributed as a senior hands-on engineer in production support, root-cause analysis, defect resolution, performance tuning and controlled delivery of business-critical changes.

Kenntnisse

Python PySpark Pandas Spark SQL Kubernetes/OpenShift Docker Helm Argo Workflows Bitbucket CI/CD Informatica PowerCenter IDMC Data Integration Informatica CAI Oracle SQL PL/SQL Automic REST APIs

Kunde

Major German Automotive Enterprise

1 year 11 months

2022-09 - 2024-07

Created, monitored, debugged and fine-tuned Apache NiFi flows

ETL / Data Integration Developer Apache NiFi Kafka Java ...

Rolle

ETL / Data Integration Developer

Projektinhalte

Created, monitored, debugged and fine-tuned Apache NiFi flows used in enterprise data integration scenarios.
Developed custom NiFi processors and Java plugins to enable external API connectivity and extend platform capabilities.
Participated in client delivery, including technical analysis, implementation design, troubleshooting and production-oriented fixes.
Worked in a containerized environment using Kubernetes and Docker, with Kafka and Elasticsearch as part of the wider integration landscape.

Kenntnisse

Apache NiFi Kafka Java Elasticsearch Kubernetes Docker REST APIs

Kunde

Cognyte Bulgaria

2015 - 2022: Application Management Support

Customer: Major German Automotive Enterprise

Tasks:

Provided 2nd and 3rd level support for core DWH systems of a major German car manufacturer in a multicultural enterprise environment.
Performed root-cause identification and troubleshooting of data defects, performance issues, workflow failures and production incidents.
Tuned Informatica mappings, sessions, workflows, PL/SQL procedures and complex SQL queries to improve reliability and runtime behavior.
Managed problem and known-error analysis in accordance with ITIL practices, including detailed defect and resolution documentation.
Coordinated development, operations, business and client-side stakeholders during implementation and support activities.

Skills:

Informatica PowerCenter, Oracle, PL/SQL, SQL, QlikView, SAP BusinessObjects, UNIX, Windows

2013 - 2022: Created, monitored and debugged Informatica mappings, sessions and workflows

Role: ETL Developer / Data Warehouse Engineer

Tasks:

Created, monitored and debugged Informatica mappings, sessions and workflows for enterprise DWH processes.
Designed, developed and implemented new or redesigned ETL modules, including database-side logic and integration changes.
Developed object-oriented Python code, PySpark workflows and KornShell/BASH scripts to support ETL processing and automation.
Analyzed and extended PL/SQL code and SQL scripts with focus on correctness, maintainability and performance.
Produced technical documentation for implementation, support, defect resolution and operational handover.

Skills:

Informatica PowerCenter, Oracle, UNIX, PL/SQL, Python, Pandas/Koalas, PySpark, Argo Workflows, Helm, Docker

2012 - 2013: Worked on data warehouse projects

Role: Quality Assurance Specialist

Tasks:

Worked on data warehouse projects for major Canadian insurance companies; reviewed mapping/design documents and maintained QA-specific SQL scripts.
Participated in documenting, resolving and regression testing identified defects and maintaining test documentation.

Skills:

Teradata 13, IBM DB2, Microsoft SQL Server 2008, Windows, MS Office

01/2011 - 01/2012: Customized SugarCRM configurations and developed modules

Role: Software Developer

Customer: MicroAccount Varna

Tasks:

Customized SugarCRM configurations and developed modules using PHP and MySQL; contributed to an ASP.NET/C# application and SQL stored procedures.

Skills:

PHP, MySQL, .NET Framework, C#, SQL, Microsoft SQL Server 2008, Visual Studio 2010

Aus- und Weiterbildung

2007 - 2012

Master of Computer Science, Technical University Varna, Bulgaria

Certifications

Databricks Certified Data Engineer Associate
Elasticsearch 8 and the Elastic Stack: In Depth and Hands On
ITIL Foundation Certificate

Position

Senior Data Engineering und ETL-Delivery in langfristigen Projekten f�r einen gro�en deutschen Automobilkonzern:
� PySpark / Kubernetes / Argo: Entwicklung und Optimierung containerisierter PySpark-Datenpipelines; Analyse von Production-Bugs, Shuffle-Verhalten, Partitionierungsstrategien und Ressourcennutzung zur Reduzierung der Laufzeit und Verbesserung der Cluster-Effizienz.
� Informatica IDMC: Implementierung von Fixes und neuen Features in IDMC Data Integration mit komplexer Oracle-SQL-/Select-Override-Logik und PL/SQL; Bearbeitung von Source-Qualifier-Verhalten, Metadaten-Synchronisation und Datentyp-Inkonsistenzen nach der Migration.
� Informatica PowerCenter / PL/SQL: Umsetzung von Erweiterungen und Fehlerbehebungen f�r Enterprise-ETL-/DWH-Prozesse im Production-Support-Umfeld.
� Informatica CAI / Python: Entwicklung von Integrations- und Automatisierungs-Flows zur Anbindung von REST-APIs und externen Systemen.

Umgebung: Python � PySpark � Spark SQL � Kubernetes/OpenShift � Docker � Argo Workflows � Informatica IDMC � PowerCenter � Oracle � PL/SQL � Automic � Bitbucket CI/CD

Kompetenzen

Top-Skills

Informatica PowerCenter IDMC Apache Spark PySpark Python Databricks ETL SQL-Datenbanken SQL Oracle PL/SQL

Produkte / Standards / Erfahrungen / Methoden

PROFESSIONAL PROFILE

Senior Data Engineer with 15+ years of hands-on engineering and consulting experience delivering, supporting and improving enterprise data�platforms. Strong background in Informatica PowerCenter, IDMC, Oracle, PL/SQL and complex SQL, combined with practical Python/PySpark�development in Kubernetes/OpenShift-based environments. Databricks Certified Data Engineer Associate, with solid understanding of�Databricks Lakehouse concepts, Delta Lake and Databricks SQL, supported by a strong Spark/PySpark and SQL foundation. Experienced in�production support, root-cause analysis, performance tuning, stabilization and continuous improvement of business-critical ETL and data�integration systems for a Major German Automotive Enterprise.

CORE VALUE PROPOSITION

Enterprise ETL & IDMC

PowerCenter and IDMC engineering, complex SQL implementation, PL/SQL�changes, data quality improvements and controlled change delivery.

Production Ownership

2nd/3rd level support, incident analysis, defect resolution and reliable handover to operations.

Performance Engineering

PySpark bottleneck analysis, cluster resource tuning, partitioning strategies and runtime optimization.

Hybrid Skill Set

Informatica/Oracle/DWH background plus Python, Spark, Databricks certification, Docker, Helm, Argo, Automic and CI/CD.

TECHNICAL EXPERTISE

Modern Data Engineering

Apache Spark / PySpark, Databricks (Data Engineer Associate�certified), Kubernetes, OpenShift, Docker, Helm, Argo Workflows,�Automic.

Data Integration

Informatica PowerCenter, IDMC, Apache NiFi, Kafka, enterprise DWH, data�integration design and implementation.

Operations

Production support, root-cause analysis, performance tuning, debugging, ITIL�practices, documentation, client delivery and technical trainings.

Programmiersprachen

Python

OOP ETL frameworks

Pandas

Koalas

Spark SQL

Java

custom NiFi processors/plugins

BASH/KornShell

Bitbucket CI/CD

Datenbanken

Oracle

PL/SQL

SQL performance tuning

complex joins

stored procedures

Teradata

DB2

SQL Server

PostgreSQL

Einsatzorte

L�nder

Deutschland, Schweiz, �sterreich

Remote-Arbeit

m�glich

Projekte

2 years

2024-07 - now

Developed and optimized containerized PySpark data pipelines

Freelance Senior Data Engineer | Freelance / Contract Python PySpark Pandas ...

Rolle

Freelance Senior Data Engineer | Freelance / Contract

Projektinhalte

PySpark / microservices / Kubernetes/OpenShift / Argo: Developed and optimized containerized PySpark data pipelines; investigated production bugs, skew, bottlenecks, shuffle behavior, partitioning/write strategies and resource usage to reduce runtime and improve cluster efficiency.
Informatica PowerCenter / PL/SQL: Delivered enhancements and fixes for enterprise ETL/DWH processes, working with complex Oracle SQL, PL/SQL and existing PowerCenter implementations.
IDMC Data Integration / PL/SQL / Automic: Implemented fixes and new features in IDMC Data Integration, using complex Oracle SQL/select override logic, PL/SQL and basic Automic scheduling/orchestration exposure.
Informatica CAI / Python: Developed integration and automation logic using Informatica Cloud Application Integration and Python, including REST/API-oriented data exchange flows.
Across these engagements, contributed as a senior hands-on engineer in production support, root-cause analysis, defect resolution, performance tuning and controlled delivery of business-critical changes.

Kenntnisse

Python PySpark Pandas Spark SQL Kubernetes/OpenShift Docker Helm Argo Workflows Bitbucket CI/CD Informatica PowerCenter IDMC Data Integration Informatica CAI Oracle SQL PL/SQL Automic REST APIs

Kunde

Major German Automotive Enterprise

1 year 11 months

2022-09 - 2024-07

Created, monitored, debugged and fine-tuned Apache NiFi flows

ETL / Data Integration Developer Apache NiFi Kafka Java ...

Rolle

ETL / Data Integration Developer

Projektinhalte

Created, monitored, debugged and fine-tuned Apache NiFi flows used in enterprise data integration scenarios.
Developed custom NiFi processors and Java plugins to enable external API connectivity and extend platform capabilities.
Participated in client delivery, including technical analysis, implementation design, troubleshooting and production-oriented fixes.
Worked in a containerized environment using Kubernetes and Docker, with Kafka and Elasticsearch as part of the wider integration landscape.

Kenntnisse

Apache NiFi Kafka Java Elasticsearch Kubernetes Docker REST APIs

Kunde

Cognyte Bulgaria

2015 - 2022: Application Management Support

Customer: Major German Automotive Enterprise

Tasks:

Provided 2nd and 3rd level support for core DWH systems of a major German car manufacturer in a multicultural enterprise environment.
Performed root-cause identification and troubleshooting of data defects, performance issues, workflow failures and production incidents.
Tuned Informatica mappings, sessions, workflows, PL/SQL procedures and complex SQL queries to improve reliability and runtime behavior.
Managed problem and known-error analysis in accordance with ITIL practices, including detailed defect and resolution documentation.
Coordinated development, operations, business and client-side stakeholders during implementation and support activities.

Skills:

Informatica PowerCenter, Oracle, PL/SQL, SQL, QlikView, SAP BusinessObjects, UNIX, Windows

2013 - 2022: Created, monitored and debugged Informatica mappings, sessions and workflows

Role: ETL Developer / Data Warehouse Engineer

Tasks:

Created, monitored and debugged Informatica mappings, sessions and workflows for enterprise DWH processes.
Designed, developed and implemented new or redesigned ETL modules, including database-side logic and integration changes.
Developed object-oriented Python code, PySpark workflows and KornShell/BASH scripts to support ETL processing and automation.
Analyzed and extended PL/SQL code and SQL scripts with focus on correctness, maintainability and performance.
Produced technical documentation for implementation, support, defect resolution and operational handover.

Skills:

Informatica PowerCenter, Oracle, UNIX, PL/SQL, Python, Pandas/Koalas, PySpark, Argo Workflows, Helm, Docker

2012 - 2013: Worked on data warehouse projects

Role: Quality Assurance Specialist

Tasks:

Worked on data warehouse projects for major Canadian insurance companies; reviewed mapping/design documents and maintained QA-specific SQL scripts.
Participated in documenting, resolving and regression testing identified defects and maintaining test documentation.

Skills:

Teradata 13, IBM DB2, Microsoft SQL Server 2008, Windows, MS Office

01/2011 - 01/2012: Customized SugarCRM configurations and developed modules

Role: Software Developer

Customer: MicroAccount Varna

Tasks:

Customized SugarCRM configurations and developed modules using PHP and MySQL; contributed to an ASP.NET/C# application and SQL stored procedures.

Skills:

PHP, MySQL, .NET Framework, C#, SQL, Microsoft SQL Server 2008, Visual Studio 2010

Aus- und Weiterbildung

2007 - 2012

Master of Computer Science, Technical University Varna, Bulgaria

Certifications

Databricks Certified Data Engineer Associate
Elasticsearch 8 and the Elastic Stack: In Depth and Hands On
ITIL Foundation Certificate

Position

Kompetenzen

Top-Skills

Informatica PowerCenter IDMC Apache Spark PySpark Python Databricks ETL SQL-Datenbanken SQL Oracle PL/SQL

Produkte / Standards / Erfahrungen / Methoden

PROFESSIONAL PROFILE

CORE VALUE PROPOSITION

Enterprise ETL & IDMC

PowerCenter and IDMC engineering, complex SQL implementation, PL/SQL�changes, data quality improvements and controlled change delivery.

Production Ownership

2nd/3rd level support, incident analysis, defect resolution and reliable handover to operations.

Performance Engineering

PySpark bottleneck analysis, cluster resource tuning, partitioning strategies and runtime optimization.

Hybrid Skill Set

Informatica/Oracle/DWH background plus Python, Spark, Databricks certification, Docker, Helm, Argo, Automic and CI/CD.

TECHNICAL EXPERTISE

Modern Data Engineering

Apache Spark / PySpark, Databricks (Data Engineer Associate�certified), Kubernetes, OpenShift, Docker, Helm, Argo Workflows,�Automic.

Data Integration

Informatica PowerCenter, IDMC, Apache NiFi, Kafka, enterprise DWH, data�integration design and implementation.

Operations

Production support, root-cause analysis, performance tuning, debugging, ITIL�practices, documentation, client delivery and technical trainings.

Programmiersprachen

Python

OOP ETL frameworks

Pandas

Koalas

Spark SQL

Java

custom NiFi processors/plugins

BASH/KornShell

Bitbucket CI/CD

Datenbanken

Oracle

PL/SQL

SQL performance tuning

complex joins

stored procedures

Teradata

DB2

SQL Server

PostgreSQL

Vertrauen Sie auf Randstad

Im Bereich Freelancing

Im Bereich Arbeitnehmer�berlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Name E-Mail-Adresse Ihre Frage

Telefonnummer Unternehmen

Ich habe die Datenschutzbestimmungen gelesen und bin damit einverstanden.

Einsatzorte

Einsatzorte

Projekte

Projekte

Developed and optimized containerized PySpark data pipelines

Created, monitored, debugged and fine-tuned Apache NiFi flows

Aus- und Weiterbildung

Aus- und Weiterbildung

Position

Position

Kompetenzen

Kompetenzen

Top-Skills

Produkte / Standards / Erfahrungen / Methoden

Programmiersprachen

Datenbanken

Einsatzorte

Einsatzorte

Projekte

Projekte

Developed and optimized containerized PySpark data pipelines

Created, monitored, debugged and fine-tuned Apache NiFi flows

Aus- und Weiterbildung

Aus- und Weiterbildung

Position

Position

Kompetenzen

Kompetenzen

Top-Skills

Produkte / Standards / Erfahrungen / Methoden

Programmiersprachen

Datenbanken

Vertrauen Sie auf Randstad

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.