Architecture and design, project lead, architecture and development of microservices and streaming applications with Kafka. Services deployed on AWS.
Aktualisiert am 27.05.2024
Profil
Mitarbeiter eines Dienstleisters
Remote-Arbeit
Verfügbar ab: 02.06.2024
Verfügbar zu: 100%
davon vor Ort: 100%
Skill-Profil eines fest angestellten Mitarbeiters des Dienstleisters
German
English
French
Spanish

Einsatzorte

Einsatzorte

Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

1 Jahr 10 Monate
2022-09 - heute

Implement microservice to automate transport and transformation of data from the factory floor to the Siemens Data Cloud, with the help of Kafka and Snowflake

Project Lead, Development, Engineering Rust Kafka Snowflake ...
Project Lead, Development, Engineering

  •  Implement microservice to automate transport and transformation of data from the factory floor to the Siemens Data Cloud, with the help of Kafka and Snowflake
  • Implement streaming pipeline to validate and transform data from diverse sources, like S3 bucket or SFTP server, and move them to Snowflake and Postgres
  • Implement microservices to automate live replication of data between MSSQL and Snowflake, with the help of Kafka, Apache Flink and S3 buckets
  • Deploy microservices on AWS with Kubernetes and Helm charts
  • Requirements engineering
  • Developing data transformation applications using streaming with Kafka and Kubernetes
  • Enhancing and optimizing Flink application deployments on Kubernetes using flink SQL transformations for dynamic view materialization.
  • Setting up automated ETL pipeline with Rust services, SQL on RisingWave to stream data from MSSQL Server to Snowflake for 720 view definition in a large application context
  • Translating T-SQL definitions to RW-SQL definitions and Snowflake SQL definitions
  • Monitoring and maintaining a RisingWave database cluster in a Production Environment

Rust Kafka Snowflake Postgres MSSQL Kubernetes Rising Wave
Siemens
8 Monate
2022-10 - 2023-05

Implement microservices to enable bidirectional data synchronization between Salesforce and IRIS, automating data integration processes

Project Lead, Development, Engineering, Support Elastic Search Azure Helm ...
Project Lead, Development, Engineering, Support

  • Implement microservices to enable bidirectional data synchronization between Salesforce and IRIS, automating data integration processes
  • Implement a microservice to automate synchronisation between IRIS and ElasticSearch
  • Implement a scalable Salesforce Connector service, for consuming messages from Salesforce topics via the Salesforce pub/sub API, and forwarding them to Kafka topics after format validation. Designed for easy deployment and scalability, the connector supports multiple instances for different Salesforce topics.
  • Deploy services on Azure with Kubernetes and Helm charts
  • Requirements engineering

Elastic Search Azure Helm Kubernetes Microservices Kafka
Hays
Germany/India
3 Jahre 6 Monate
2019-04 - 2022-09

Implement a microservice that aggregates payment data, transforms it into Elasticsearch documents, and indexes it for improved data accessibility and search functionality

Development, Engineering Elastic Search Kafka Postgres ...
Development, Engineering

  • Implement a microservice that aggregates payment data, transforms it into Elasticsearch documents, and indexes it for improved data accessibility and search functionality
  • Implement a microservices system, with ingest and query-API components, for streaming Kafka data to Postgres and providing HTTP access
  • Deploy services on AWS ECS with Docker and Terraform
  • Requirements engineering

Elastic Search Kafka Postgres AWS Terraform Docker Microservices
PAYONE, Frankfurt
1 Jahr 1 Monat
2020-07 - 2021-07

Implement a microservices tool providing a dashboard overview of AWS expenses, offering custom recommendations for cost optimization, especially for AWS Logs, EC2 and ECS services.

Development, Engineering AWS CDK AWS Lambda
Development, Engineering

  • Implement a microservices tool providing a dashboard overview of AWS expenses, offering custom recommendations for cost optimization, especially for AWS Logs, EC2 and ECS services.
  • Deploy services on AWS with CDK and using AWS Lambda

AWS CDK AWS Lambda
Hivemind Technologies AG
1 Jahr 5 Monate
2017-12 - 2019-04

Backend web application

Development, Engineering Java
Development, Engineering
  • Backend web application: development of an e-payment API according to a new European law
  • Deploy services with Docker
  • Implementation of REST APIs for data access
  • Requirements engineering
Java
Equens Worldline, Aachen
5 Jahre 1 Monat
2012-12 - 2017-12

terminal payment software

Development, Engineering Python
Development, Engineering
  • Test engineer for terminal payment software
  • Implementation and maintenance of automated functional tests for payment terminals
  • Test driven development and continuous integration and deployment pipelines
  • Requirements engineering
Python
Atos Worldline, Aachen

Position

Position

Principal Software Developer

Kompetenzen

Kompetenzen

Produkte / Standards / Erfahrungen / Methoden

Profile
Architecture and design, project lead, architecture and development of microservices and streaming applications with Kafka. Services deployed on AWS or Azure with Docker or Kubernetes.

Einsatzorte

Einsatzorte

Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

1 Jahr 10 Monate
2022-09 - heute

Implement microservice to automate transport and transformation of data from the factory floor to the Siemens Data Cloud, with the help of Kafka and Snowflake

Project Lead, Development, Engineering Rust Kafka Snowflake ...
Project Lead, Development, Engineering

  •  Implement microservice to automate transport and transformation of data from the factory floor to the Siemens Data Cloud, with the help of Kafka and Snowflake
  • Implement streaming pipeline to validate and transform data from diverse sources, like S3 bucket or SFTP server, and move them to Snowflake and Postgres
  • Implement microservices to automate live replication of data between MSSQL and Snowflake, with the help of Kafka, Apache Flink and S3 buckets
  • Deploy microservices on AWS with Kubernetes and Helm charts
  • Requirements engineering
  • Developing data transformation applications using streaming with Kafka and Kubernetes
  • Enhancing and optimizing Flink application deployments on Kubernetes using flink SQL transformations for dynamic view materialization.
  • Setting up automated ETL pipeline with Rust services, SQL on RisingWave to stream data from MSSQL Server to Snowflake for 720 view definition in a large application context
  • Translating T-SQL definitions to RW-SQL definitions and Snowflake SQL definitions
  • Monitoring and maintaining a RisingWave database cluster in a Production Environment

Rust Kafka Snowflake Postgres MSSQL Kubernetes Rising Wave
Siemens
8 Monate
2022-10 - 2023-05

Implement microservices to enable bidirectional data synchronization between Salesforce and IRIS, automating data integration processes

Project Lead, Development, Engineering, Support Elastic Search Azure Helm ...
Project Lead, Development, Engineering, Support

  • Implement microservices to enable bidirectional data synchronization between Salesforce and IRIS, automating data integration processes
  • Implement a microservice to automate synchronisation between IRIS and ElasticSearch
  • Implement a scalable Salesforce Connector service, for consuming messages from Salesforce topics via the Salesforce pub/sub API, and forwarding them to Kafka topics after format validation. Designed for easy deployment and scalability, the connector supports multiple instances for different Salesforce topics.
  • Deploy services on Azure with Kubernetes and Helm charts
  • Requirements engineering

Elastic Search Azure Helm Kubernetes Microservices Kafka
Hays
Germany/India
3 Jahre 6 Monate
2019-04 - 2022-09

Implement a microservice that aggregates payment data, transforms it into Elasticsearch documents, and indexes it for improved data accessibility and search functionality

Development, Engineering Elastic Search Kafka Postgres ...
Development, Engineering

  • Implement a microservice that aggregates payment data, transforms it into Elasticsearch documents, and indexes it for improved data accessibility and search functionality
  • Implement a microservices system, with ingest and query-API components, for streaming Kafka data to Postgres and providing HTTP access
  • Deploy services on AWS ECS with Docker and Terraform
  • Requirements engineering

Elastic Search Kafka Postgres AWS Terraform Docker Microservices
PAYONE, Frankfurt
1 Jahr 1 Monat
2020-07 - 2021-07

Implement a microservices tool providing a dashboard overview of AWS expenses, offering custom recommendations for cost optimization, especially for AWS Logs, EC2 and ECS services.

Development, Engineering AWS CDK AWS Lambda
Development, Engineering

  • Implement a microservices tool providing a dashboard overview of AWS expenses, offering custom recommendations for cost optimization, especially for AWS Logs, EC2 and ECS services.
  • Deploy services on AWS with CDK and using AWS Lambda

AWS CDK AWS Lambda
Hivemind Technologies AG
1 Jahr 5 Monate
2017-12 - 2019-04

Backend web application

Development, Engineering Java
Development, Engineering
  • Backend web application: development of an e-payment API according to a new European law
  • Deploy services with Docker
  • Implementation of REST APIs for data access
  • Requirements engineering
Java
Equens Worldline, Aachen
5 Jahre 1 Monat
2012-12 - 2017-12

terminal payment software

Development, Engineering Python
Development, Engineering
  • Test engineer for terminal payment software
  • Implementation and maintenance of automated functional tests for payment terminals
  • Test driven development and continuous integration and deployment pipelines
  • Requirements engineering
Python
Atos Worldline, Aachen

Position

Position

Principal Software Developer

Kompetenzen

Kompetenzen

Produkte / Standards / Erfahrungen / Methoden

Profile
Architecture and design, project lead, architecture and development of microservices and streaming applications with Kafka. Services deployed on AWS or Azure with Docker or Kubernetes.

Vertrauen Sie auf Randstad

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.