• Freelance consultant and expert for Machine Learning applications for ?content understanding? on visual (video), audio and textual data supporting the RTL Data Team in order to build the next generation multi-purpose platform (RTL+).
• The key target of this project is to generate additional metadata from the raw content which can be used afterwards by the downstream applications like search, recommendation and personalization. The main challenge is to establish a reliable, scalable and production ready state of the art solution for a large number of building blocks and create an execution pipeline on top of it.

Video based models: 

• Aesthetic Ranking
• Dominant Color Extraction
• End Credits Detection
• Face Detection
• Image Quality Detection
• Logo Detection
• Mood Detection
• Object detection and Recognition
• Place Prediction
• Scene and Shot-Boundary Detection
• Shot Type Detection by using and optimizing pre-trained and self-trained models

Audio based models and solutions: 

• Speech-to-Text transcriptions using Google?s Speech-to- Text API and Whisper from Open-AI on Podcasts and other audio sources

NLP solutions: 

• language detection (fastText), festivity detection, kids content detection, adult content detection, topic modeling (BERTopic), keyword extraction (KeyBERT) and text summarization

• Freelance consultant and expert for Deep Learning / Machine Learning / Data Science applications in following areas: 
  • fraud recognition, product recommendation systems, image recognition / image classification, anomaly detection, time series analysis and NLP
  • Guiding the agile (scrum/Kanban) projects from conception to production and maintenance & optimization
• Main focus on eCommerce solutions based on consumer data, product master data & descriptions, product images and sales transactions

Product Similarity:

• in order to increase of the downstream system's performance this solution will help to find similar or related products for a particular product which can be used then as a benchmark or replacement
• The similarity will be determined by various modalities: 
  • visual similarity (image autoencoder), consumer behavior (clickstream data) and product descriptions (NLP transformers)

Skills:

Python, Jupyter, PySpark, TensorFlow, Jira, Bitbucket

Dynamic Pricing:

• the main goal for this project is to identify poor performing products in an early stage, uncover possible product issues and determine the right actions e.g. optimal price change to boost performance
• The overarching goal was to gradually replace the existing solution

Skills:

Python, Jupyter, PySpark, XGBoost, matplotlib, TensorFlow

Consumer Lifetime Value:

• conception, implementation and maintenance for the historical and future monetary value attributed to an individual consumer. Regular extensions and adaptations for e.g. new markets / brands and deep dive into the model's most important features
• The models are based on consumer behavior data and are running fully in production and will be updated on a weekly basis for all consumers. The results (KPIs) are intensively used in downstream systems and for marketing campaigns.

Skills:

Python, XGBoost, SHAP, matplotlib, Exasol, Jira, Bitbucket

Visual Product Embeddings:

• conception and implementation of a variational autoencoder based on product images
• The source images are being filtered, downscaled and prepared for a convolutional neural network (VAE) where the embeddings will be generated
• These embeddings are able to capture design elements of a product image which can be used to find similar products but also will be fed into downstream models to improve any productbased model
• The solution is running in production and will be updated with new images on a weekly basis

Skills:

Python, Keras/TensorFlow, PySpark, SageMaker, OpenCV

Purchase Propensity Scores: 

• conception, implementation and maintenance for modelling the consumer's purchase intention
• The solution is running very stable in production for a few years already and the results provide a high contribution to the marketing channels

Python, XGBoost, SHAP, matplotlib, Exasol, Jira, Bitbucket

• participating the "Histopathology Cancer Detection" competition
• The goal was to identify metastatic cancer in medical images
• My role was to bring state of the art computer vision techniques to the team and to implement an ensemble of models for the submission
• We have reached #26 from 1.149 competitors using advanced (high-speed) training techniques and heavy image augmentations

• The goal of the project was to build an MVP for a product image classification system to support annotators' workflows and to identify outliers/broken images within the image pool
• My role was also to educate the team on the latest deep learning/computer vision possibilities and find additional business cases to implement