• Developed streaming and batch data pipelines on AWS Fargate with Kotlin, Kafka Streams and Connect, Avro, Confluent Cloud, Lambda, DynamoDB, S3, Docker
• Developed REST APIs for mobile devices and internal data APIs with OpenApi, ApiGateway, Lamdba, DynamoDB
• Created reports from retail datasets of 2,5B+ records using S3, Glue and Athena Recreated existing SAP data feeds by converting ABAP to SQL with PostgreSQL, Airflow, Python

• Developed healthcare data integrations for HUS DataLake on Azure with Kubernetes, Data Lake Storage, Data Factory, Databricks, Scala
• Built the BM-OR pipeline to send operating room records via HUS DataLake to a third party for analysis. 

Orchestration:

• Azure Data Factory, transformations:
  • ?Databricks/Scala and Delta Table, public key encryption for in-transit data 

• Design and implement streaming data platform for customer product, pricing and related data from enterprise sources to JDA Pricer
• Modeled data with Apache Avro
• Designed complex streaming topology with cross-topic validation and enrichment
• Implemented streaming pipelines as Kafka Streams Java applications
• Fully responsible for Phase I of the project with scope of over 6000 retail stores
• Confluent Certified Developer for Apache Kafka 5/2020

• Fully responsible for data integrations between JDA Pricer, customer enterprise planning tools and store point-of-sale systems
• Built a SQL/Python database for inbound data with change data capture from full data feeds
• Developed a price and promotion data pipeline to store point-of-sale and online ecommerce tool
• Customer was able to execute price changes and promotions in near realtime (URL on request)