Mathematical optimization for scheduling
Role: Software Engineer & Applied Mathematician

Tasks:
The constraint-optimization problem was build for a flexible scheduling tool, as well as its interaction with the frontend.
Duration: 1 months
Team setting: Team of 2, remote

Skills: 
JuMP, julia, Pluto, svelte, javascript, typescript, jetbrains space, terraform, nomad

Building scalable Data Science compute cluster from scratch
Role: Software & Cloud & Web Engineer

Tasks:
For the product cloud.jolin.io a data science compute cluster was build on top of kubernetes. This includes securing container runtimes, authorization of running jobs, autoscaling, integration with version control, and building of front-end to spawn individual scalable data science environments.
Duration: 13 months
Team setting: Team of 1, on-site

Skills: 
terraform, kubernetes, docker, k8s ingress, k8s services, k8s rbac, kyverno, k8s networking, k8s volumes, k8s configs, k8s secrets, k8s jobs, k8s deployments, argocd, longhorn, k3s, k3s disaster recovery, etcd, keycloak, s3, dns, certificates, julia, pluto, javascript, tailwind, astro, npm, parcel, preact, mui, jwt, aws sqs, aws rds, python, GitLab, GitHub

Custom ChatGPT service
Role: AI & Web Engineer

Tasks:
A state of the art user-interface was build upon on generative AI,
including backend and frontend.
Duration: 1 months
Team setting: Team of 2, remote

Skills: 
python, poetry, langchain, tailwind, chatgpt api, flask, fastapi, tailwind

Central datalake setup and ingestion
Role: Architect & Data Engineer

Tasks:
The client had several different data sources for customer and orders, which
should be centralized for several usecases. As a solution a big data lake
on top of AWS S3 and Apache Hudi was setup and first data ingestions
pipelines completed. In production.
Duration: 9 months
Team setting: Team of 5, remote

Skills: 
Infrastructure-as-code, aws cdk, python, boto3, PySpark, AWS Glue, IAM, S3, ECS, Fargate, Lambda, Apache Hudi, DeltaLake, Databricks, GitHub, Jira, Miro

PoC Julia migration of scikit-decide
Role: Software Engineer

Tasks:
Scikit-decide is an open source tool by Airbus for reinforcement learning and
scheduling. The core was translated from Python to Julia to demonstrate
feasibility and benchmark performance improvements.
Duration: 1 months
Team setting: Team of 2, remote

Skills: 
python, julia, GitHub

Supporting Usecase Development on Datalake
Role: Lead Developer & Architect

Tasks:
Guidance was provided for architectural decisions, adapting access
policies, and debugging routing issues. A specific GDPR treatment
ingestion processes was implemented and rolled-out. In production.
Duration: 6 months
Team setting: Team Lead, Team of 2, remote

Skills:
Infrastructure-as-code, cloudformation, sceptre, python, boto3,PySpark, scala, Spark, AWS Glue, AWS Secrets, AWS IAM, S3, SNS,Kubernetes, Docker, AWS VPC, AWS Networking, GitHub, Jira

20 ETL Pipelines on AWS
Role: Lead Developer & Architect

Tasks:
Replacing an CRM required the development of about 20 ETL pipelines
to replace existing systems with new data-flows. Including one
REST API. In production.
Duration: 10 months
Team setting: Team Lead, Team of 3, remote

Skills:
AWS Glue, PySpark, python, boto3, pandas, AWS SNS, AWSSQS, SQL, MySQL, PostgreSQL, MongoDB, AWS DocumentDB,Salesforce, AWS API Gateway, AWS Cognito, AWS Lambda,infrastructure-as-code, cloudformation, sceptre, GitHub, Jira

Building Multitenant Datalake on AWS
Role: Lead Developer & Architect

Tasks:
Implementing from scratch a datalake platform on AWS which is
deployed in several countries using InfrastructureAsCode as the key
technology. A key focus was GDPR conformity. In production.
Duration: 5 months
Team setting: Team Lead, Team of 2, remote with a few on-side workshops

Skills:
Infrastructure-as-code, cloudformation, sceptre, python, boto3, PySpark, scala, Spark, AWS SageMaker, AWS Glue, AWS Secrets, AWS IAM, S3, SNS, Lambda, Kubernetes, Docker, EKS, Kafka, MSK, AWS VPC, AWS Transit Gateway, AWS Networking, AWS EC2, AWS Session Manager, AWS CloudWatch, AWS Sagemaker, GitHub, Jira

Unification of Existing Time Series Analytics
Role: Core Developer

Tasks:
Several custom anomaly detection solutions on time series were refactored and unified into a generic framework which can be easily deployed to new usecases and new infrastructures (AWS tested). In production.
Duration: 9 months
Team setting: Team of 15, on-site, Scrum

Skills:
Python, PySpark, (PL)SQL, Hive, HBase, Oracle, Tableau, Nifi, Kubernetes, Docker, Azure, Gitlab

Recommender System
Role: Data Science Developer

Tasks:
Designed, implemented, and deployed Big Data recommendation system, now running in production for Millions of daily customers. In production.
Duration: 7 months
Team setting: Team of 1, on-site, weekly reviews

Skills:
On-premise, R, Scala, SBT, Spark, Yarn, HDFS, Bitbucket, Jira, Grafana, Prometheus, Elastic Stack, Kibana

Review: Custom Datascience Framework
Role: Quality Assurance & Adviser

Tasks:
Infrastructure review and code review of a framework implemented build by one of our customers.
Duration: 2 months
Team setting: Team of 1, mixed remote & on-site

Skills:
R, AWS

Workshop: Developing with Apache Spark
Role: Teacher

Tasks:
Four one-day workshops at customers, two introductory, the other two advanced. Contents: Performance optimization, monitoring, interfacing Scala-R-Python, best practices.
Duration: 4 × 1 day
Setting: Group of 15 persons, sole presenter

Skills:
R, Python, Spark

Fraud Detection
Role: Data Science Developer

Tasks:
Draft, development, implementation, evaluation and deployment of an anomaly detection system to detect previously unkown types of fraud.
Duration: 14 months
Team Setting: Team of 1, on-site, review once every three months

Skills:
R, Scala, Spark, Yarn, Bitbucket, Jira, Elastic Stack, Kibana

Callcenter and Webcontent Optimization using Speech Analytics
Role: Data Science Developer

Tasks:
A 3 dimensional content detection system was setup for written conversations. Given only plain text, it identifyed customer specific product entities, services, and problems.
Duration: 6 month
Team Setting: Team of 3, on-site, reviews every week

Skills:
Python, NLP, spacy, GitHub, Elastic Stack, Kibana

Web Visualization
Role: Web Developer

Tasks:
Build Django based web-dashboard with Bokeh based interactive data analysis visualization.

Duration: 4 month
Team Setting: Team of 1, remote, steady exchange with CEO

Skills: 
Python, Django, Bokeh, Gitlab

Data Parsing
Role: Python Developer

Tasks:
Build parser to extract time series data from customer specific text data formats.
Duration: 8 month
Team Setting: Team of 1, remote, steady exchange with CEO

Skills: 
Python, PyParsing, Cython, Gitlab