Freelancer: Data architecture, data engineering, DevOps, AI, Business analysis, Business intelligence

Freiberufler / Selbstst�ndiger

Remote-Arbeit

Verf�gbar ab: 09.09.2026

Verf�gbar zu: 100%

davon vor Ort: 25%

Top-Skills

Cloud Architect

Databricks

Azure

AWS

Google Cloud

SQL

Python

Bourne-again-shell

Hadoop

K�nstliche Intelligenz

Stakeholdermanagement

Einsatzorte

St�dte

Amsterdam (+500km)

L�nder

Deutschland, Schweiz, �sterreich

Remote-Arbeit

m�glich

Projekte

2 years 8 months

2024-02 - now

design of a modern Azure-based streaming data platform

Senior Data Platform Engineer Azure Azure DevOps Databricks ...

Rolle

Senior Data Platform Engineer

Projektinhalte

Led the design of a modern Azure-based streaming data platform supporting real-time ingestion and analytics
Coordinated architecture decisions with platform teams across multiple business units, ensuring alignment with enterprise standards
Integrated Databricks, AKS, and Unity Catalog to support governed data access for batch and�streaming use cases��
Collaborated with platform stakeholders to align architecture with compliance, security, and business SLAs, facilitating consensus among technical and business leadership��

Kenntnisse

Azure Azure DevOps Databricks AKS Unity Catalog Python Bash Powershell Airflow Docker/ACR Terraform Terragrunt

Kunde

Nationale-Nederlanden | Rotterdam, Netherlands

Rolle

Owner

Projektinhalte

As an independent consultant since 2021, engaged directly with clients to assess technical requirements, design cloud-native data platforms, and deliver high-impact solutions.�
Led cross-functional project teams, coordinating offshore and onshore developers while serving as the primary technical advisor to C-level stakeholders.�
Acted as a trusted advisor on data modernization and streaming architecture, translating complex technical designs into business-aligned outcomes.�
Frequently led project kickoffs, architecture reviews, and delivery strategy sessions with cross-functional stakeholders.�

Kunde

CBM3 | Amstelveen, Netherlands

1 year 7 months

2025-03 - 2026-09

Directed a code quality and review initiative

Senior Data Engineer / Architect Azure Python SQL ...

Rolle

Senior Data Engineer / Architect

Projektinhalte

Co-led a data engineering team over a 6-month engagement, driving data strategy, stakeholder alignment, and structured code review practices across existing pipelines
Directed a code quality and review initiative, implementing automated PR review workflows using Mistral and GitHub Copilot Enterprise to strengthen pipeline reliability and maintainability�
Championed AI integration into engineering workflows, embedding automated review tooling into day-to-day development to raise team-wide code quality standards
Ensured dashboard visibility and data integrity were preserved and enhanced throughout pipeline changes, supporting ASML's machine-generated data used for fault prediction and component inspection by clients�
Acted as a key liaison between engineering and stakeholders, translating technical pipeline decisions into business-relevant outcomes for data strategy planning�

Kenntnisse

Azure Python SQL PySpark Databricks GitHub Copilot Enterprise Mistral Azure DevOps pipelines Power BI/dashboarding Helm AKS Trivy DevSecOps

Kunde

ASML | Veldhoven, Netherlands

6 months

2025-08 - 2026-01

Established and scaled the Amsterdam data engineering hub

Interim Data Engineering Lead AWS (S3 EMR Kafka (MSK) ...

Rolle

Interim Data Engineering Lead

Projektinhalte

Established and scaled the Amsterdam data engineering hub from the ground up, defining hiring criteria, conducting technical interviews, and building a high-performing local team
Led and mentored distributed engineering teams across three regions (China, Poland, Netherlands), establishing consistent engineering practices and fostering collaboration across time zones and cultural contexts
Guided team members through complex architectural decisions and performance optimization challenges, elevating technical capabilities across the organization�
Oversaw VIDAA TV OS Telemetry Lakehouse operations processing ~20TB/day of logs and metrics in near-realtime streaming and batch modes
Directed pipeline stabilization efforts on AWS infrastructure (EMR, Kafka, Airflow, Hive, Spark), empowering team members to implement tuning solutions for backpressure, partitioning/skew issues, and reliable backfills/retries
Led architecture and design sessions for storage layout optimization (Parquet/Delta, partitions, compaction) and data modeling, coaching engineers on query optimization techniques

Kenntnisse

AWS (S3 EMR Kafka (MSK) Airflow Hive Spark Athena) Terraform GitLab

Kunde

Vidaa (V Home OS) | Amsterdam, Netherlands

2023 - 2023: Architected a cloud-native migration

Role: Lead Data Engineer / Architect

Customer: MS Amlin Insurance | Amstelveen, Netherlands

Tasks:

Architected a cloud-native migration of legacy ETL workloads to Azure Data Factory and Databricks Mentored and led a team of 5 junior offshore developers, establishing coding standards and conducting regular code reviews to ensure quality and consistency
Coordinated project execution with business and product teams, managing stakeholder expectations and delivery timelines
Delivered platform components with embedded monitoring and observability to ensure operational resilience

Skills:

Azure, Azure Data Factory, Databricks, PySpark, PowerBI

2023 - 2023: Re-engineered backend processing

Role: Senior Data Engineer

Customer: Nomura Asset Management | Amstelveen, Netherlands

Tasks:

Re-engineered backend processing for real-time financial transaction data using Spark on AWS EMR Optimized Yarn job execution and JVM tuning to support high-throughput, low-latency analytics Provided technical guidance to development team on performance optimization and best practices Implemented pipeline resilience and monitoring strategies aligned with compliance and governance policies

Skills:

AWS, Spark, Python, EC2, EMR, Glue, Presto, CloudSearch, Yarn, Livy

2022 - 2023: Wind turbine data analysis

Role: Senior Data Engineer

Customer: Vattenfall | Amsterdam, Netherlands

Tasks:

Wind turbine data analysis in the analytics department, building analytical models for fault prediction and proactive malfunctioning prevention
Collaborated with data science teams to translate ML requirements into production-ready engineering solutions

Skills:

Databricks, Azure, Spark, Python, Powershell, Scikit-Learn, Power Automate, AKS

2021 - 2022: analysis of data generated

Role: Senior Data Engineer

Customer: ASML

Tasks:

Took full ownership of a critical use case in the analysis of data generated by ASML's lithography machines, focusing on predicting future failures
Worked closely with cross-functional engineering teams to ensure seamless integration of analytics into production systems

Skills:

On-prem (CDH 6.x) and Azure, Azure DevOps, Terraform, BitBucket, BuildKite, Spark, PySpark, Hive, Python, Scikit-Learn, Azure Data Factory, InfluxDB

10/2014 - 10/2021: Designed and implemented a storage/analytics platform

Role: Senior DevOps / Data Platform Engineer

Customer: ING Bank | Amsterdam, Netherlands

Tasks:

Led the foundational team that established ING's data lake project for Netherlands and Belgium, managing architecture decisions and technical roadmap
Designed and implemented a storage/analytics platform based on Hortonworks/Cloudera HDP, using automation for cluster provisioning and security layers
Managed cloud migration initiatives, leading technical teams through the transition of on-premise workloads to public cloud (GCP and Azure)
Automated delivery pipelines with Ansible and Terraform
Served as technical lead for scaling, tuning and maintenance of Hadoop clusters, providing guidance to operations teams
Focused on optimization of Spark applications running on Hadoop and Yarn
Participated in security and cloud risk management committees (internal and vendors), representing the data platform team and influencing enterprise-wide policies
Collaborated with data engineers and scientists teams to plan, design and deliver production-ready statistical models, bridging the gap between research and production

2013 - 2014: Conducted thorough analysis

Role: Big Data Consultant

Customer: Orange Telecom | Rosh Ha'Ayin, Israel

Tasks:

Conducted thorough analysis of current ETL flows and BI reporting methods, identifying potential areas for big data analysis
Configured and led setup of Hadoop clusters (4-15 nodes), overseeing initialization, development, and team onboarding
Managed large-scale projects with telecom clients, coordinating with stakeholders and ensuring delivery on time and within scope (100 TB ? 2 PB data volumes)
Utilized comprehensive Hadoop ecosystem tools: Cloudera CDH4, HBase, MapReduce, Hive, Pig, Hue, Oozie, Flume, Sqoop

more Projects on request

Aus- und Weiterbildung

2010

B.Sc - Computer Science

Clark University, USA

2002

Software Practical Engineer

Tel Aviv University, School of PE

COURSES

Databricks Data Engineer Professional - Databricks
Databricks Platform Architect - Databricks
Linear Classifiers in Python - Datacamp
Generative AI Fundamentals - Databricks
Cloudera Administrator - Cloudera

Kompetenzen

Top-Skills

Cloud Architect Databricks Azure AWS Google Cloud SQL Python Bourne-again-shell Hadoop K�nstliche Intelligenz Stakeholdermanagement

Produkte / Standards / Erfahrungen / Methoden

PROFESSIONAL SUMMARY

Experienced data and platform engineer with 25+ years designing and scaling distributed systems�and real-time data solutions across cloud (AWS, Azure, GCP). Proven technical leader with�extensive experience managing teams, mentoring engineers, and driving organizational�transformation through platform modernization. Successfully delivered event-driven architectures�using Spark, Databricks, EMR, and orchestration tools like Airflow and Kubernetes. Passionate about�enabling organizations to unlock value from streaming data through robust, scalable platforms.�Brings a unique mix of hands-on engineering, technical leadership, team management, and�client-facing delivery across finance, energy, insurance, and telecom industries.��

SKILLS

Leadership & Management: Technical Team Leadership, Offshore Team Management,�Mentoring, Stakeholder Management, Architecture Governance, Cross-functional�Collaboration��
Data Engineering: Python, SQL, Data Warehouse, Data Modelling, ETL, ELT��
Cloud Engineering: AWS, GCP, Azure, Azure DevOps��
Architecture: Databricks, Unity Catalog, EMR, Presto, Glue, Athena��
DevOps & Infrastructure: Git, Artifactory, Docker, Kubernetes, AKS, GKS, OpenShift,�Terraform, Terragrunt, Jenkins, Bitbucket��
Monitoring & Observability: Splunk, ELK, Apache Solr��
Big Data & Streaming: Hadoop, Cloudera CDH, Spark, Airflow, Kafka, Hive, Presto, Sqoop, Oozie,�Kerberos
ETL Tools: Informatica, Datastage
BI & Visualization: Power BI, Tableau�

Programmiersprachen

Bash

CShell

Unix

Linux

Powershell

REST

Pandas

Scikit-Learn

Datenbanken

Oracle

SQL Server

PostgreSQL

InfluxDB

MongoDB

HBase

Redis

Cassandra

Einsatzorte

St�dte

Amsterdam (+500km)

L�nder

Deutschland, Schweiz, �sterreich

Remote-Arbeit

m�glich

Projekte

2 years 8 months

2024-02 - now

design of a modern Azure-based streaming data platform

Senior Data Platform Engineer Azure Azure DevOps Databricks ...

Rolle

Senior Data Platform Engineer

Projektinhalte

Led the design of a modern Azure-based streaming data platform supporting real-time ingestion and analytics
Coordinated architecture decisions with platform teams across multiple business units, ensuring alignment with enterprise standards
Integrated Databricks, AKS, and Unity Catalog to support governed data access for batch and�streaming use cases��
Collaborated with platform stakeholders to align architecture with compliance, security, and business SLAs, facilitating consensus among technical and business leadership��

Kenntnisse

Azure Azure DevOps Databricks AKS Unity Catalog Python Bash Powershell Airflow Docker/ACR Terraform Terragrunt

Kunde

Nationale-Nederlanden | Rotterdam, Netherlands

Rolle

Owner

Projektinhalte

As an independent consultant since 2021, engaged directly with clients to assess technical requirements, design cloud-native data platforms, and deliver high-impact solutions.�
Led cross-functional project teams, coordinating offshore and onshore developers while serving as the primary technical advisor to C-level stakeholders.�
Acted as a trusted advisor on data modernization and streaming architecture, translating complex technical designs into business-aligned outcomes.�
Frequently led project kickoffs, architecture reviews, and delivery strategy sessions with cross-functional stakeholders.�

Kunde

CBM3 | Amstelveen, Netherlands

1 year 7 months

2025-03 - 2026-09

Directed a code quality and review initiative

Senior Data Engineer / Architect Azure Python SQL ...

Rolle

Senior Data Engineer / Architect

Projektinhalte

Co-led a data engineering team over a 6-month engagement, driving data strategy, stakeholder alignment, and structured code review practices across existing pipelines
Directed a code quality and review initiative, implementing automated PR review workflows using Mistral and GitHub Copilot Enterprise to strengthen pipeline reliability and maintainability�
Championed AI integration into engineering workflows, embedding automated review tooling into day-to-day development to raise team-wide code quality standards
Ensured dashboard visibility and data integrity were preserved and enhanced throughout pipeline changes, supporting ASML's machine-generated data used for fault prediction and component inspection by clients�
Acted as a key liaison between engineering and stakeholders, translating technical pipeline decisions into business-relevant outcomes for data strategy planning�

Kenntnisse

Azure Python SQL PySpark Databricks GitHub Copilot Enterprise Mistral Azure DevOps pipelines Power BI/dashboarding Helm AKS Trivy DevSecOps

Kunde

ASML | Veldhoven, Netherlands

6 months

2025-08 - 2026-01

Established and scaled the Amsterdam data engineering hub

Interim Data Engineering Lead AWS (S3 EMR Kafka (MSK) ...

Rolle

Interim Data Engineering Lead

Projektinhalte

Established and scaled the Amsterdam data engineering hub from the ground up, defining hiring criteria, conducting technical interviews, and building a high-performing local team
Led and mentored distributed engineering teams across three regions (China, Poland, Netherlands), establishing consistent engineering practices and fostering collaboration across time zones and cultural contexts
Guided team members through complex architectural decisions and performance optimization challenges, elevating technical capabilities across the organization�
Oversaw VIDAA TV OS Telemetry Lakehouse operations processing ~20TB/day of logs and metrics in near-realtime streaming and batch modes
Directed pipeline stabilization efforts on AWS infrastructure (EMR, Kafka, Airflow, Hive, Spark), empowering team members to implement tuning solutions for backpressure, partitioning/skew issues, and reliable backfills/retries
Led architecture and design sessions for storage layout optimization (Parquet/Delta, partitions, compaction) and data modeling, coaching engineers on query optimization techniques

Kenntnisse

AWS (S3 EMR Kafka (MSK) Airflow Hive Spark Athena) Terraform GitLab

Kunde

Vidaa (V Home OS) | Amsterdam, Netherlands

2023 - 2023: Architected a cloud-native migration

Role: Lead Data Engineer / Architect

Customer: MS Amlin Insurance | Amstelveen, Netherlands

Tasks:

Architected a cloud-native migration of legacy ETL workloads to Azure Data Factory and Databricks Mentored and led a team of 5 junior offshore developers, establishing coding standards and conducting regular code reviews to ensure quality and consistency
Coordinated project execution with business and product teams, managing stakeholder expectations and delivery timelines
Delivered platform components with embedded monitoring and observability to ensure operational resilience

Skills:

Azure, Azure Data Factory, Databricks, PySpark, PowerBI

2023 - 2023: Re-engineered backend processing

Role: Senior Data Engineer

Customer: Nomura Asset Management | Amstelveen, Netherlands

Tasks:

Re-engineered backend processing for real-time financial transaction data using Spark on AWS EMR Optimized Yarn job execution and JVM tuning to support high-throughput, low-latency analytics Provided technical guidance to development team on performance optimization and best practices Implemented pipeline resilience and monitoring strategies aligned with compliance and governance policies

Skills:

AWS, Spark, Python, EC2, EMR, Glue, Presto, CloudSearch, Yarn, Livy

2022 - 2023: Wind turbine data analysis

Role: Senior Data Engineer

Customer: Vattenfall | Amsterdam, Netherlands

Tasks:

Wind turbine data analysis in the analytics department, building analytical models for fault prediction and proactive malfunctioning prevention
Collaborated with data science teams to translate ML requirements into production-ready engineering solutions

Skills:

Databricks, Azure, Spark, Python, Powershell, Scikit-Learn, Power Automate, AKS

2021 - 2022: analysis of data generated

Role: Senior Data Engineer

Customer: ASML

Tasks:

Took full ownership of a critical use case in the analysis of data generated by ASML's lithography machines, focusing on predicting future failures
Worked closely with cross-functional engineering teams to ensure seamless integration of analytics into production systems

Skills:

On-prem (CDH 6.x) and Azure, Azure DevOps, Terraform, BitBucket, BuildKite, Spark, PySpark, Hive, Python, Scikit-Learn, Azure Data Factory, InfluxDB

10/2014 - 10/2021: Designed and implemented a storage/analytics platform

Role: Senior DevOps / Data Platform Engineer

Customer: ING Bank | Amsterdam, Netherlands

Tasks:

Led the foundational team that established ING's data lake project for Netherlands and Belgium, managing architecture decisions and technical roadmap
Designed and implemented a storage/analytics platform based on Hortonworks/Cloudera HDP, using automation for cluster provisioning and security layers
Managed cloud migration initiatives, leading technical teams through the transition of on-premise workloads to public cloud (GCP and Azure)
Automated delivery pipelines with Ansible and Terraform
Served as technical lead for scaling, tuning and maintenance of Hadoop clusters, providing guidance to operations teams
Focused on optimization of Spark applications running on Hadoop and Yarn
Participated in security and cloud risk management committees (internal and vendors), representing the data platform team and influencing enterprise-wide policies
Collaborated with data engineers and scientists teams to plan, design and deliver production-ready statistical models, bridging the gap between research and production

2013 - 2014: Conducted thorough analysis

Role: Big Data Consultant

Customer: Orange Telecom | Rosh Ha'Ayin, Israel

Tasks:

Conducted thorough analysis of current ETL flows and BI reporting methods, identifying potential areas for big data analysis
Configured and led setup of Hadoop clusters (4-15 nodes), overseeing initialization, development, and team onboarding
Managed large-scale projects with telecom clients, coordinating with stakeholders and ensuring delivery on time and within scope (100 TB ? 2 PB data volumes)
Utilized comprehensive Hadoop ecosystem tools: Cloudera CDH4, HBase, MapReduce, Hive, Pig, Hue, Oozie, Flume, Sqoop

more Projects on request

Aus- und Weiterbildung

2010

B.Sc - Computer Science

Clark University, USA

2002

Software Practical Engineer

Tel Aviv University, School of PE

COURSES

Databricks Data Engineer Professional - Databricks
Databricks Platform Architect - Databricks
Linear Classifiers in Python - Datacamp
Generative AI Fundamentals - Databricks
Cloudera Administrator - Cloudera

Kompetenzen

Top-Skills

Cloud Architect Databricks Azure AWS Google Cloud SQL Python Bourne-again-shell Hadoop K�nstliche Intelligenz Stakeholdermanagement

Produkte / Standards / Erfahrungen / Methoden

PROFESSIONAL SUMMARY

SKILLS

Leadership & Management: Technical Team Leadership, Offshore Team Management,�Mentoring, Stakeholder Management, Architecture Governance, Cross-functional�Collaboration��
Data Engineering: Python, SQL, Data Warehouse, Data Modelling, ETL, ELT��
Cloud Engineering: AWS, GCP, Azure, Azure DevOps��
Architecture: Databricks, Unity Catalog, EMR, Presto, Glue, Athena��
DevOps & Infrastructure: Git, Artifactory, Docker, Kubernetes, AKS, GKS, OpenShift,�Terraform, Terragrunt, Jenkins, Bitbucket��
Monitoring & Observability: Splunk, ELK, Apache Solr��
Big Data & Streaming: Hadoop, Cloudera CDH, Spark, Airflow, Kafka, Hive, Presto, Sqoop, Oozie,�Kerberos
ETL Tools: Informatica, Datastage
BI & Visualization: Power BI, Tableau�

Programmiersprachen

Bash

CShell

Unix

Linux

Powershell

REST

Pandas

Scikit-Learn

Datenbanken

Oracle

SQL Server

PostgreSQL

InfluxDB

MongoDB

HBase

Redis

Cassandra

Vertrauen Sie auf Randstad

Im Bereich Freelancing

Im Bereich Arbeitnehmer�berlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Name E-Mail-Adresse Ihre Frage

Telefonnummer Unternehmen

Ich habe die Datenschutzbestimmungen gelesen und bin damit einverstanden.

Einsatzorte

Einsatzorte

Projekte

Projekte

design of a modern Azure-based streaming data platform

Client-Facing Experience & Solution Ownership

Directed a code quality and review initiative

Established and scaled the Amsterdam data engineering hub

Aus- und Weiterbildung

Aus- und Weiterbildung

Kompetenzen

Kompetenzen

Top-Skills

Produkte / Standards / Erfahrungen / Methoden

Programmiersprachen

Datenbanken

Einsatzorte

Einsatzorte

Projekte

Projekte

design of a modern Azure-based streaming data platform

Client-Facing Experience & Solution Ownership

Directed a code quality and review initiative

Established and scaled the Amsterdam data engineering hub

Aus- und Weiterbildung

Aus- und Weiterbildung

Kompetenzen

Kompetenzen

Top-Skills

Produkte / Standards / Erfahrungen / Methoden

Programmiersprachen

Datenbanken

Vertrauen Sie auf Randstad

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.