Freelancer: Architektur, Projektmanagement, Entwicklung und Coaching im Big Data und Cloud Umfeld

Freiberufler / Selbstst�ndiger

Remote-Arbeit

Verf�gbar ab: 15.11.2023

Verf�gbar zu: 80%

davon vor Ort: 50%

Top-Skills

AWS

Apache Spark

Apache Kafka

Microservices

Scala

Elastic Search

Sprachen

Deutsch

Englisch

Franz�sisch

Latein

Einsatzorte

L�nder

Deutschland, �sterreich, Schweiz

Deutschland: bevorzugt D1, D2,D5

UK: Bevorzugt London

Remote-Arbeit

m�glich

Projekte

5 Jahre 2 Monate

2018-10 - heute

Global data and analytics platform

Tech lead / Design Authority Spark Apache Storm Apache Flume ...

Rolle

Tech lead / Design Authority

Projektinhalte

Industry: Finance

Role: Tech lead / Design Authority

Tasks: Architecture, system design, development

o Implement an event driven, stream processor for high frequency events on Kafka / Spark for S3
o Implement Redshift Spectrum / Glue Crawler based Data Lake for events with continuous schema eveolution
o Asses requirements and design cloud based data processing docker components with AWS ECS
o Design and implement Service Deployment Automation with Terraform
o Implement Python based Applications with AWS Lambda
o Implement data pipelines with AWS Kinesis and AWS SQS
o Migrate existing data infrstractures from relational databases and Classic Readshift to the new Data Lake

Kenntnisse

Spark Apache Storm Apache Flume Cassandra Apache Kafka Docker

Kunde

ClearScore Ltd

Einsatzort

London

1 Jahr 6 Monate

2017-05 - 2018-10

Publishing and Editing microservices platform

Tech lead / Design Authority Postgres Scala Python ...

Rolle

Tech lead / Design Authority

Projektinhalte

Industry: Publishing

Role: Tech lead / Design Authority

Tasks: Architecture, system design, development

o Implement a micro service centric event sourced platform for a paper publication system
o Asses requirements and design cloud based data processing docker components with AWS ECR
o Design and implement Service Deployment Automation with Terraform
o Develop a concept for Monolith migration to microservices using strangulation pattern
o Implement components with TDD on Java 8 with Kinesis, Elastic Search, PostgreSQL, AWS Lambda
o Implement Python based Applications with AWS Lambda
o Implement data pipelines with AWS Kinesis and AWS SQS
o Refactor and migrate microservices to Docker centric deployments

Kenntnisse

Postgres Scala Python AWS Apache Kafka Kinesis Docker

Kunde

Elsevier Ltd

Einsatzort

Oxford

8 Monate

2016-10 - 2017-05

Data and Analytics platform on AWS

Lead Data Engineer Apache Kafka Apache Spark Scala ...

Rolle

Lead Data Engineer

Projektinhalte

Industry: Transport

Role: Lead Data Engineer

Tasks: Architecture, system design, development

o Asses requirements and design a cloud-based data processing platform
o Design and implement Service Deployment Automation with AWS CloudFormation and Ansible
o Introduce and implement Apache Kafka as a message platform
o Implement a high volume, near real time data processing pipeline from RDBMS bin log, JMS and Kafka data sources into Redshift and AWS S3 using Apache Spark Streaming on Scala
o Implement real – time Geo - Tracking applications for vehicles with Elastic Search and Spark

Kenntnisse

Apache Kafka Apache Spark Scala Terraform Elastic Search

Kunde

Flixbus / FlixMobility GmbH

Einsatzort

Berlin

5 Monate

2016-07 - 2016-11

Design und Implementierung eines Streaming Systems f�r die Echtzeitdetektion von Anomalien und Ausf�llen in Stromnetzen

Architeckt, Entwickler, Coach Spark Apache Storm Apache Flume ...

Rolle

Architeckt, Entwickler, Coach

Projektinhalte

Implementierung eines Streaming Systems mit Apache Spark, Cassandra, Kafka und Flume

Validierung eines Apache Storm basierten - Prototyps
Implementierung einer Anomalie Detektion
Portierung des fingerprinting und des modell trainers von python (numpy/pandas) auf Spark MLlib
Caoching der Entwickler

Kenntnisse

Spark Apache Storm Apache Flume Cassandra Apache Kafka

Kunde

Siemens AG

Einsatzort

N�rnberg

4 Monate

2016-07 - 2016-10

Design und Implementierung eines Streaming Systems f�r die Echtzeitdetektion von Anomalien und Ausf�llen in Stromnetzen

Architeckt, Entwickler, Coach Spark Apache Storm Apache Flume ...

Rolle

Architeckt, Entwickler, Coach

Projektinhalte

Implementierung eines Streaming Systems mit Apache Spark, Cassandra, Kafka und Flume

Validierung eines Apache Storm basierten - Prototyps
Implementierung einer Anomalie Detektion
Portierung des fingerprinting und des modell trainers von python (numpy/pandas) auf Spark MLlib
Caoching der Entwickler

Kenntnisse

Spark Apache Storm Apache Flume Cassandra Apache Spark Scala

Kunde

Siemens AG

Einsatzort

N�rnberg

8 Monate

2015-12 - 2016-07

High volume tracking and web/app usage profiling

System design, development Spark Cassandra Hadoop ...

Rolle

System design, development

Projektinhalte

System design, development

Implement probabilistic identification mechanisms for App and Web users in profiling/tracking records with Spark
Implement a large scale Cassandra/Spark based aggregation platform for web and app user reporting and analytics
Implement high volume SSTable based bulk Loading for large Cassandra Clusters
Implement automated AWS Elastic Map Reduce based pipelines with EMR and Spark
Implement Sessioning and Cookie restoration mechanisms for user tracking records

Kenntnisse

Spark Cassandra Hadoop AWS

Kunde

GfK SE

Einsatzort

Berlin, N�rnberg

1 Jahr 7 Monate

2014-06 - 2015-12

High volume data collection and profiling

Softwareentwicklung, Architektur Spark Cassandra Hadoop ...

Rolle

Softwareentwicklung, Architektur

Projektinhalte

System design, development

Implement a streaming system for user profiling and segmentation with Apache Storm and Kafka
Implement data collection services with AWS auto scale for through puts of up to 50 k requests/sec
Implement MapReduce aggregation and processing Jobs with Scalding and batch aggregation application with Apache Spark on HDFS and HBase
Implement user profile storage synchronisation with Kafka, Flume, Spark and HBase
Build an API for real time profile and segment look ups with a Cassandra backend
Implement high volume SSTable based bulk Loading for large Cassandra Clusters
Introduce Scala and Spark / Coaching of developers

Kenntnisse

Spark Cassandra Hadoop Scalding Apache Kafka

Kunde

xplosion Interactive GmbH

Einsatzort

Hamburg

7 Monate

2015-01 - 2015-07

Real time copyright infringement detection with Storm and Kafka

Architekt Apache Storm Apache Kafka Akka ...

Rolle

Architekt

Projektinhalte

System design, development

Refactoring und re implementation of a system for text and image analysis and plagarism detection with Apache Storm, redis and kafka
Implement specialized Akka – Actor components to increase throughput and performance of complex operations, scale out to 150 Mio surveyed sites / day
Implement Graphite based metering

Kenntnisse

Apache Storm Apache Kafka Akka Redis

Kunde

dpa / Mecom GmbH

Einsatzort

Hamburg

8 Monate

2014-08 - 2015-03

Implement a lamda processing System with Hadoop and Storm

Architekt, Entwickler Apache Storm Scalding Apache Flume ...

Rolle

Architekt, Entwickler

Projektinhalte

System design, development

Implement MapReduce based Lambda processing system for insurance contract data processing on top of Cloudera CDH 4 with Apache Storm, Scalding, Flume and Mongo DB
Set up kerberized CDH Clusters for Dev and production environments in secured locations

Kenntnisse

Apache Storm Scalding Apache Flume MongoDB Hadoop

Kunde

Allianz SE

Einsatzort

M�nchen

Projekterfahrung

�

10/2012 -2015

GfK SE, �N�rnberg

System design, development, team lead

Design and implementation of an automated data aggregation system for mobile connection records on a 48 node - Apache Hadoop cluster using scheduling, message queuing.
Implementation of a trilateration prototype with Apache Storm
Set up 98 node AWS Hadoop and application cluster with scale out, load balancing and multiple security and VPN zones for large scale delivery of up 2 TB/day

�

2011 - 2013

Hivemind, K�ln

System design, development, team lead

Implementation of a Akka - based crawler with reactive content recognition and processing for up to 10 Mio surveyed resources / day
Utilization of natural language libraries for content analysis with post processing in hadoop
Operate and deploy a large MongoDB cluster

�

11/2010 - 05/2011

eSailors GmbH, Hamburg

System design, development

Optimize an existing financial transaction framework, increase JSON serialization performance
Refactoring and optimization of JMS consumers on top of ActiveMQ
Set up and improve existing data centre structure

07/2010 ? 11/2010

Germanischer Lloyd, Hamburg

System design, development

Implement a security module for ship building document deliveries using Adobe DRM in an existing Spring application
Design and build a rule based / security policy framework
Requirement collection and specification of a REST bases service layer with GL?s existing application landscape

10/2009 - 08/2010

Tape.tv GmbH, Berlin

System design, development, team lead

Implement a job management and scheduling application for video encoding and transcoding tasks with Spring, ActiveMQ
Set up and improve existing Data Centre structure

�

10/2009 - 08/2010

T-Mobile Deutschand GmbH, Bonn

Requirement engineering und specification

Collect requirements and write a specification for the T-Mobile Germany Portal Migration project
Implement a XML based ? Model generator

�

04/2009 - 10/2009

Sevenload GmbH, K�ln

Team lead and development

Implement a data aggregation system for revenue share billing for the ad section of Sevenload?s Video - Platform operations on top of Hadoop.

Set up and install a multi node Hadoop Cluster
Design and set up of Sevenload?s new data centre with 175 nodes�

�

01/2006 - 07/2006 und 09/2006 -01/2009

Techniker Krankenkasse, Hamburg

System design, development, coaching

Migrate an existing zOS application environment to JEE

Implement an automated hospital billing and case processing system

Coaching of existing developers
Developer workshops for new Java developers
Implement an automated pharmacy billing and case processing system

Prior to 2006

Implementation of a Web portals and application for insurances (Techniker Krankenkasse, IKK), Tour operators (Itravel, Thomas Cook), Commerce (Otto.de, Trademiles) and telco order management systems (freenet AG)
Lead a test and integration team for industry appliances (Postal Automation) for Siemens AG and Royal Mail
Lead the development team for the European implementation of NTT i-Mode (Sun Microsystems, E-Plus)
Lead the development team for Deutsche Post AG?s web mail service

Aus- und Weiterbildung

Education

10/1995 ? 04/1999

Universit�t zu K�ln, Universit�t Hamburg,

Computer Science

1995

Abitur, Staatliches Internat Schlo� Pl�n

Kompetenzen

Top-Skills

AWS Apache Spark Apache Kafka Microservices Scala Elastic Search

Produkte / Standards / Erfahrungen / Methoden

Akka

Ansible

Apache Flume

Apache Spark

Apache Storm

AWS

AWS EMR

Hadoop

Redshift

Scalding

Spark

Technologien:

Apache Hadoop, Twitter Storm, Hive auf Cloudera und Hortonworks
JEE: JSP, JSTL, Servlets, JNDI, JDBC, RMI, EJB 1.1 - 3.0 ,
JMS, JavaMail, CORBA/IDL
Sonstige: Oracle JDBC Erweiterungen, Netscape LDAP SDK,
Apple Enterprise Objects Framework (EOF),
Regular Expressions unter Java und Perl

Applikationsserver:
JBoss 4 - 5, Glassfish, Apple WebObjects ab 4, BEA WebLogic, Tomcat, iPlanet Application Server 6,
OC4J (Oracle Container for J2EE)/Orion Server, ATG Dynamo 5.6.1/6.0.0,
Websphere

Java Frameworks und Toolkits:
Hadoop, Zookeeper, ATG Dynamo Application Framework, Dynamo Personalisation, Dynamo Scenario
Apache Jserv, Jakarta Cocoon, Jakarta Struts 1 und 2, Jakarta Log4j, Jakarta Ant, Junit,
HTTPUnit und JFCUnit

Sonstiges:
PHP 3 und 4, CGI ProgrLmmierung mit Perl und mod_perl,
shell scripting unter linux und Solaris

Betriebssysteme

Docker

HPUX

Mac OS

OS/400

PalmOS

SUN OS, Solaris

Unix

Windows

Systemadministration:
Solaris ab 2.6, Linux seit 1.3.X - 2.4 (alle gängigen Distributinen), FreeBSD 4.X, Windows NT 4.0, MacOS (Classic)
Grundkenntnisse: HP-UX, MacOS X Server, OS/400, Cisco IOS und vielen anderen UNIX - Derivate

Programmiersprachen

Java

JavaScript

Lisp

Perl

PHP

PL/SQL

Python

Scala

Shell

Terraform

Sprachen:
Java (Schwerpunkt), Scala, PHP, Perl und Shell (bash,tcsh) scripting,
C (Grundkenntnisse) und Lisp (Grundkenntnisse), UML,� SQL - 92, Oracle SQL, PL/SQL (Grundkenntnisse), XML, HTML, JavaScript (ECMAScript)

Technologien:
Hadoop, Twitter Storm, Hive, JSP, Spring, EJB, JEE

Datenbanken

Access

Adabas

Cassandra

DB/400

DB2

Elastic Search

JDBC

MongoDB

MySQL

ODBC

Oracle

Postgres

Redis

SQL

Durchgeführte Migrationen zwischen MySQL und Oracle und Oracle und DB2. Modellierung und Design von grossen Oracle Installationen, sowie Administration und Programmierung mit PL/SQL und Java Stored Procedures.

Datenkommunikation

Apache Kafka

AppleTalk

CORBA

Ethernet

Fax

Internet, Intranet

ISDN

Kinesis

LAN, LAN Manager

NetBeui

NetBios

RFC

Router

RPC

SMTP

SNMP

TCP/IP

UUCP

Windows Netzwerk

Emailsysteme:
Sendmail, Postfix, qmail, iPlanet Messaging Server 5

Firewall und Masquerading Netzwerke
Planung und Installation von Solaris, Linux und BSD basierte Firewalls mit BIG/IP Controller, SunScreen und IPChains (bastille - firewall)

Fileserver:
NFS (Solaris, Linux), NIS (YP) unter Solaris und Linux, Samba unter Linux und AppleTalk (Netatalk) unter Linux, NT Domäne mit Samba und NT - basierte Domänen Controller

LDAP Server:
Open LDAP, Netscape Directory Server, iPlanet Directory Server 4/5

Hardware

Alpha

Ascii/X - Terminals

Drucker

Macintosh

Streamer

SUN

Branchen

Bisher bin ich für Kunden folgender Branchen tätig gewesen:
Wertpapier- und Finanzdienstleistungen, Banken und Versicherungen,
Gesetzliche Krankenversicherungen, Konsumgüter,
Medien, Reisen und Touristik, Handel, Chemie und Pharma,
Industrie, Automation

Vertrauen Sie auf GULP

Im Bereich Freelancing

Im Bereich Arbeitnehmer�berlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Name E-Mail-Adresse Ihre Frage

Telefonnummer Unternehmen

Ich habe die Datenschutzbestimmungen gelesen und bin damit einverstanden.

Das GULP Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.