Senior Big Data und DevOps Architect und Engineer
Aktualisiert am 19.09.2023
Profil
Mitarbeiter eines Dienstleisters
Remote-Arbeit
Verfügbar ab: 01.10.2023
Verfügbar zu: 100%
davon vor Ort: 100%
Skill-Profil eines fest angestellten Mitarbeiters des Dienstleisters

Einsatzorte

Einsatzorte

Deutschland, Österreich, Schweiz
möglich

Projekte

Projekte

1 Jahr 6 Monate
2022-10 - heute

DevOps Architect / Developer at a Cloud Provider

The client wants to provide Openshift Installations for air-gapped offline clusters. This uses Ansible to set up the nodes incl. network switches and Openshit IPI installer.

 

 

?      Senior DevOps Architect & Engineer

?      Openshift 4

?      Ansible Tower

?      Openshift Operator SDK ? Golang

2 Jahre 8 Monate
2021-08 - heute

Java Spring Boot Developer / Architect at [Company name on request]

Java Spring Boot Developer / Architect
Java Spring Boot Developer / Architect

Microservice Factory is an App that eases the creation of Microservices. One can describe a Microservice in a Frontend by entering details. The Microservice Factory will then generate a Java Spring Boot Microservice.

 

The Factory Microservice is implemented in Java Spring Boot. It offers REST API endpoints to the Frontend for the generation of the Java Spring Boot Microservice. It uses JPA with the Hibernate framework to persist the Microservice metadata in a PostgreSQL database. Spring Security is used to outsource endpoint security and user management to Keycloak.

 

?      Senior Java Spring Boot Architect & Developer

?      Java Spring Boot

?      JPA

?      Hibernate

?      PostgreSQL

?      Spring Security

?      Keycloak

?      AWS EKS

?      Werbservices

?      REST API

1 Jahr 7 Monate
2021-03 - 2022-09

DevOps Architect / Developer at a Logistic Company

DevOps Architect / Developer
DevOps Architect / Developer

Client has a legacy monolith for his core systems. This is migrated to a Microservices architecture run on hybrid Kubernetes clusters on AWS EKS and on-prem VMWare Tanzu.

When I joined the project, the client was running some Java Spring Boot Microservices on VMWare instances. My task was to create a multi-environment deployment on AWS EKS (managed Kubernetes) and VMWare Tanzu which is a Kubernetes distribution of VMWare. This included setting up the EKS clusters as well as migrating the Microservices to Kubernetes. All cloud resources have been created for a multi-environment system using Terraform. Deployments to Kubernetes was implemented using Helm Charts. The CI/CD pipelines were developed in Jenkins. Sonarcube was integrated in ther build process to assure code quality. NexusIQ was used to check included libraries for vulnerabilities.

?      DevOps Architect / Developer

?      AWS EKS (managed Kubernetes)

?      VMWare Tanzu (Kubernetes distribution)

?      Jenkins

?      Bitbucket

?      Sonarcube

?      NexusIQ

?      Java Spring Boot

?      Gradle

?      Flyway

?      Postgres QL

?      Helm Chart

?      Terraform

1 Jahr 6 Monate
2019-09 - 2021-02

DevOps Architect / Developer at a State Printer

DevOps Architect / Developer
DevOps Architect / Developer

Client operates a RedHat OpenShift platform. This is RedHat?s version of Kubernetes. I have implemented CI/CD processes in GitLab that uses JFrog Artifactory as a Docker Registry to build and deploy projects to OpenShift. In order to easier onboard new projects to OpenShift a reference project has been implemented that uses Java Spring Boot in the backend and Angular in the Frontend. Helped 30 projects to onboard on OpenShift, coached project?s DevOps engineers.

 

?      DevOps Architect

?      RedShift OpenShift (Kubernetes)

?      GitLab

?      JFrog Artifactory

?      Java Spring Boot

?      Angular

?      Ansible

?      Maven

?      Docker

1 Monat
2019-07 - 2019-07

DEVOPS & Cloud Ops Architect / Developer at Schoolbook Publisher

DEVOPS & Cloud Ops Architect
DEVOPS & Cloud Ops Architect

Client uses C# ASP.NET to implement plugins for the publishing content management system. The systems runs on EC2 boxes without the possibility of scaling of individual services. I have consulted the how to migrate this system into a distributed application that?s implemented in the AWS cloud mainly using AWS ECS and Lambda. I?ve setup Jenkins to drive the CI/CD pipeline including automated testing.

?      Cloud / DevOps Architect

?      AWS

?      ECS (EC2 + Fargate)

?      ECR

?      S3

?      API Gateway

?      Lambda

?      SQS

?      SNS

?      RDS

?      Redis

?      EFS

?      EC2

?      ELB

?      ALB

?      S3

?      CloudWatch

?      CloudFormation

?      Elastic Beanstalk

?      Docker

?      Terraform

?      Jenkins

9 Monate
2018-10 - 2019-06

DEVOPS & Cloud Ops Architect / Developer

Architect / Developer ECS EC2 Fargate ...
Architect / Developer

Migration of a Java monolith to an AWS distributed system

A large Java Spring Boot monolith was migrated to an AWS distributed system. Back-end rest services were migrated to ECS services for front-end access. Other functions were implemented in Lambda and chained together using SQS.

 

The CICD-processes for the build and deployment processes have been implemented in Jenkins. The deployment of the AWS resources were described in Terraform (> 250 resources). The regression testing of feature branches has been implemented.

 

The project was implement by 3 team, 2 development teams and 1 cross-functional team. I was part of the cross-functional team for implementing DEVOPS

Roles:

  • Cloud Ops DeveloperTechnologies: 
  • AWS
      • ECS (EC2 + Fargate)
      • Lambda
      • SQS
      • SNS
      • RDS
      • Redis
      • EFS
      • EC2
      • S3
      • CloudWatch
      • CloudFormation
    • Terraform

Jenkins

IntelliJ Jenkins Confluence Jira
ECS EC2 Fargate Lambda SQS SNS RDS Redis EFS EC2 S3 CloudWatch CloudFormation
Kiel
2 Monate
2018-08 - 2018-09

Cloud Ops Architect Developer at [Company name on request]

Architect / Developer Java Spring Boot AWS EKS ...
Architect / Developer

Prototype Predictive Maintenance Earlier this year we?ve developed a prototype for a German Car Producer who wants to use car information to predict maintenance needs of the cars. The system contained MicroServices implemented in Spring Boot. It gathered reference input data from legacy systems via Rest API. At that point of time the system was deployed to Pivotal Cloud Foundry. GitLab was the CI/CD system used.

 

The MicroServices are now containerized and deployed to AWS EKS and / or AWS Lambda.

Roles:

  • Cloud Ops DeveloperTechnologies:
  • REST API
  • Spring Boot
  • Hadoop
  • AWS EKS
  • AWS Lambda
  • GitLab
Java Spring Boot AWS EKS Lambda GitLab
[Company name on request]
Fehmarnn
3 Monate
2018-06 - 2018-08

Big Data Architect at an Automotive Supplier

Java Hortonworks HDP ...

Car Measurement File Management The automotive supplier wants to build a product to manage car measurement files. The main architecture’s feature is Apache Nifi from Hortonworks Data Flow (HDF). A test system needed to be setup. JMeter is used for performance test execution. Performance results are stored in elasticsearch. KPI Dashboards are implemented in Kibana. The entire application was an IOT application.

 

Roles:

  • Big Data Architect

Technologies:

  • Java
  • Hortonworks (HDP & HDF)
  • Hadoop
  • Nifi
Java Hortonworks HDP HDF Hadoop Nifi
4 Monate
2018-03 - 2018-06

Car information Pipelines into Data Lake

Big Data Architect Hadoop Cloudera Kafka ...
Big Data Architect

Car information Pipelines into Data Lake A German car manufacturer gathers information from their cars. They are delivered via a rest-endpoint. The raw input files in Google’s binary ProtoBuf format. The files are feeded in Kafka with a Kafka producer that reads the rest-endpoint and delivers Kafka Topic. The raw files are split into data formats using a custom Kafka Source and delivered via Flume into HDFS landing area. Oozie workflows are used to update the data in Hive and Impala and pushing data into master Impala database. The system has reached production grade.

Roles:

  • Big Data Architect 

Technologies:

  • Hadoop
  • Cloudera
  • Kafka
  • Flume
  • Hive
  • Impala
  • Oozie
  • ProtoBuf
  • Java
  • Bash
  • Linux Shell Scripting
Hadoop Cloudera Kafka Flume Hive Impala Oozie ProtoBuf Java
2 Monate
2018-02 - 2018-03

Prototype Predictive Maintenance

Architekt und Developer Java Spring Boot Hadoop ...
Architekt und Developer

We’ve developed a prototype for a German Car Producer who wants to use car information to predict maintenance needs of the cars. The system contained MicroServices implemented in Spring Boot. It gathered reference input data from legacy systems via Rest API. The system was deployed to Pivotal Cloud Foundry

Roles:

  • Big Data Developer

Technologies: 

  • Java
  • REST API
  • Spring Boot
  • Hadoop
  • Kafka
  • Pivotal Cloud Foundry
Java Spring Boot Hadoop Kafka Pivotal Cloud Foundry
2 Monate
2018-01 - 2018-02

Visitor counting for shops

Data Scientist YOLO 2
Data Scientist

Clothing shops want to know the conversion rate (revenue per visitor). The system extends normal counting system by identifying the gender of the visitors. The image classification is done by YOLO 2

Roles:

  • Data Scientist

DeveloperTechnologies: 

  • YOLO 2
YOLO 2
2 Monate
2018-01 - 2018-02

Neural Network Playground

ta Scientist, Developer TensorFlow TypeScript Node.js
ta Scientist, Developer

TensorFlow Playground is an interactive visualization of neural networks, written in typescript using d3.js. It contains a tiny neural network library that meets the demands of this educational visualization. You can simulate, in real time, in your browser, small neural networks and see the results. Node.js was used to run the playground on the workstation.

TensorFlow TypeScript Node.js
2 Monate
2018-01 - 2018-02

Text recognition on pharmaceutical prescription papers

Data Scientist, Developer TensorFlow Python
Data Scientist, Developer

The text on pharamceutical prescription papers was to be OCRed. For this we’ve implemented a convolutional neural network using Tensorflow and Python. The scanned images were trained against a part of the data set and then tested against the rest.

 

TensorFlow Python

Kompetenzen

Kompetenzen

Produkte / Standards / Erfahrungen / Methoden

AWS
Confluence
EC2
Hadoop
Hive
IntelliJ
Jenkins
Jira
Node.js
Redis
TensorFlow

Programmiersprachen

Java
Python
TypeScript

Datenbanken

RDS

Einsatzorte

Einsatzorte

Deutschland, Österreich, Schweiz
möglich

Projekte

Projekte

1 Jahr 6 Monate
2022-10 - heute

DevOps Architect / Developer at a Cloud Provider

The client wants to provide Openshift Installations for air-gapped offline clusters. This uses Ansible to set up the nodes incl. network switches and Openshit IPI installer.

 

 

?      Senior DevOps Architect & Engineer

?      Openshift 4

?      Ansible Tower

?      Openshift Operator SDK ? Golang

2 Jahre 8 Monate
2021-08 - heute

Java Spring Boot Developer / Architect at [Company name on request]

Java Spring Boot Developer / Architect
Java Spring Boot Developer / Architect

Microservice Factory is an App that eases the creation of Microservices. One can describe a Microservice in a Frontend by entering details. The Microservice Factory will then generate a Java Spring Boot Microservice.

 

The Factory Microservice is implemented in Java Spring Boot. It offers REST API endpoints to the Frontend for the generation of the Java Spring Boot Microservice. It uses JPA with the Hibernate framework to persist the Microservice metadata in a PostgreSQL database. Spring Security is used to outsource endpoint security and user management to Keycloak.

 

?      Senior Java Spring Boot Architect & Developer

?      Java Spring Boot

?      JPA

?      Hibernate

?      PostgreSQL

?      Spring Security

?      Keycloak

?      AWS EKS

?      Werbservices

?      REST API

1 Jahr 7 Monate
2021-03 - 2022-09

DevOps Architect / Developer at a Logistic Company

DevOps Architect / Developer
DevOps Architect / Developer

Client has a legacy monolith for his core systems. This is migrated to a Microservices architecture run on hybrid Kubernetes clusters on AWS EKS and on-prem VMWare Tanzu.

When I joined the project, the client was running some Java Spring Boot Microservices on VMWare instances. My task was to create a multi-environment deployment on AWS EKS (managed Kubernetes) and VMWare Tanzu which is a Kubernetes distribution of VMWare. This included setting up the EKS clusters as well as migrating the Microservices to Kubernetes. All cloud resources have been created for a multi-environment system using Terraform. Deployments to Kubernetes was implemented using Helm Charts. The CI/CD pipelines were developed in Jenkins. Sonarcube was integrated in ther build process to assure code quality. NexusIQ was used to check included libraries for vulnerabilities.

?      DevOps Architect / Developer

?      AWS EKS (managed Kubernetes)

?      VMWare Tanzu (Kubernetes distribution)

?      Jenkins

?      Bitbucket

?      Sonarcube

?      NexusIQ

?      Java Spring Boot

?      Gradle

?      Flyway

?      Postgres QL

?      Helm Chart

?      Terraform

1 Jahr 6 Monate
2019-09 - 2021-02

DevOps Architect / Developer at a State Printer

DevOps Architect / Developer
DevOps Architect / Developer

Client operates a RedHat OpenShift platform. This is RedHat?s version of Kubernetes. I have implemented CI/CD processes in GitLab that uses JFrog Artifactory as a Docker Registry to build and deploy projects to OpenShift. In order to easier onboard new projects to OpenShift a reference project has been implemented that uses Java Spring Boot in the backend and Angular in the Frontend. Helped 30 projects to onboard on OpenShift, coached project?s DevOps engineers.

 

?      DevOps Architect

?      RedShift OpenShift (Kubernetes)

?      GitLab

?      JFrog Artifactory

?      Java Spring Boot

?      Angular

?      Ansible

?      Maven

?      Docker

1 Monat
2019-07 - 2019-07

DEVOPS & Cloud Ops Architect / Developer at Schoolbook Publisher

DEVOPS & Cloud Ops Architect
DEVOPS & Cloud Ops Architect

Client uses C# ASP.NET to implement plugins for the publishing content management system. The systems runs on EC2 boxes without the possibility of scaling of individual services. I have consulted the how to migrate this system into a distributed application that?s implemented in the AWS cloud mainly using AWS ECS and Lambda. I?ve setup Jenkins to drive the CI/CD pipeline including automated testing.

?      Cloud / DevOps Architect

?      AWS

?      ECS (EC2 + Fargate)

?      ECR

?      S3

?      API Gateway

?      Lambda

?      SQS

?      SNS

?      RDS

?      Redis

?      EFS

?      EC2

?      ELB

?      ALB

?      S3

?      CloudWatch

?      CloudFormation

?      Elastic Beanstalk

?      Docker

?      Terraform

?      Jenkins

9 Monate
2018-10 - 2019-06

DEVOPS & Cloud Ops Architect / Developer

Architect / Developer ECS EC2 Fargate ...
Architect / Developer

Migration of a Java monolith to an AWS distributed system

A large Java Spring Boot monolith was migrated to an AWS distributed system. Back-end rest services were migrated to ECS services for front-end access. Other functions were implemented in Lambda and chained together using SQS.

 

The CICD-processes for the build and deployment processes have been implemented in Jenkins. The deployment of the AWS resources were described in Terraform (> 250 resources). The regression testing of feature branches has been implemented.

 

The project was implement by 3 team, 2 development teams and 1 cross-functional team. I was part of the cross-functional team for implementing DEVOPS

Roles:

  • Cloud Ops DeveloperTechnologies: 
  • AWS
      • ECS (EC2 + Fargate)
      • Lambda
      • SQS
      • SNS
      • RDS
      • Redis
      • EFS
      • EC2
      • S3
      • CloudWatch
      • CloudFormation
    • Terraform

Jenkins

IntelliJ Jenkins Confluence Jira
ECS EC2 Fargate Lambda SQS SNS RDS Redis EFS EC2 S3 CloudWatch CloudFormation
Kiel
2 Monate
2018-08 - 2018-09

Cloud Ops Architect Developer at [Company name on request]

Architect / Developer Java Spring Boot AWS EKS ...
Architect / Developer

Prototype Predictive Maintenance Earlier this year we?ve developed a prototype for a German Car Producer who wants to use car information to predict maintenance needs of the cars. The system contained MicroServices implemented in Spring Boot. It gathered reference input data from legacy systems via Rest API. At that point of time the system was deployed to Pivotal Cloud Foundry. GitLab was the CI/CD system used.

 

The MicroServices are now containerized and deployed to AWS EKS and / or AWS Lambda.

Roles:

  • Cloud Ops DeveloperTechnologies:
  • REST API
  • Spring Boot
  • Hadoop
  • AWS EKS
  • AWS Lambda
  • GitLab
Java Spring Boot AWS EKS Lambda GitLab
[Company name on request]
Fehmarnn
3 Monate
2018-06 - 2018-08

Big Data Architect at an Automotive Supplier

Java Hortonworks HDP ...

Car Measurement File Management The automotive supplier wants to build a product to manage car measurement files. The main architecture’s feature is Apache Nifi from Hortonworks Data Flow (HDF). A test system needed to be setup. JMeter is used for performance test execution. Performance results are stored in elasticsearch. KPI Dashboards are implemented in Kibana. The entire application was an IOT application.

 

Roles:

  • Big Data Architect

Technologies:

  • Java
  • Hortonworks (HDP & HDF)
  • Hadoop
  • Nifi
Java Hortonworks HDP HDF Hadoop Nifi
4 Monate
2018-03 - 2018-06

Car information Pipelines into Data Lake

Big Data Architect Hadoop Cloudera Kafka ...
Big Data Architect

Car information Pipelines into Data Lake A German car manufacturer gathers information from their cars. They are delivered via a rest-endpoint. The raw input files in Google’s binary ProtoBuf format. The files are feeded in Kafka with a Kafka producer that reads the rest-endpoint and delivers Kafka Topic. The raw files are split into data formats using a custom Kafka Source and delivered via Flume into HDFS landing area. Oozie workflows are used to update the data in Hive and Impala and pushing data into master Impala database. The system has reached production grade.

Roles:

  • Big Data Architect 

Technologies:

  • Hadoop
  • Cloudera
  • Kafka
  • Flume
  • Hive
  • Impala
  • Oozie
  • ProtoBuf
  • Java
  • Bash
  • Linux Shell Scripting
Hadoop Cloudera Kafka Flume Hive Impala Oozie ProtoBuf Java
2 Monate
2018-02 - 2018-03

Prototype Predictive Maintenance

Architekt und Developer Java Spring Boot Hadoop ...
Architekt und Developer

We’ve developed a prototype for a German Car Producer who wants to use car information to predict maintenance needs of the cars. The system contained MicroServices implemented in Spring Boot. It gathered reference input data from legacy systems via Rest API. The system was deployed to Pivotal Cloud Foundry

Roles:

  • Big Data Developer

Technologies: 

  • Java
  • REST API
  • Spring Boot
  • Hadoop
  • Kafka
  • Pivotal Cloud Foundry
Java Spring Boot Hadoop Kafka Pivotal Cloud Foundry
2 Monate
2018-01 - 2018-02

Visitor counting for shops

Data Scientist YOLO 2
Data Scientist

Clothing shops want to know the conversion rate (revenue per visitor). The system extends normal counting system by identifying the gender of the visitors. The image classification is done by YOLO 2

Roles:

  • Data Scientist

DeveloperTechnologies: 

  • YOLO 2
YOLO 2
2 Monate
2018-01 - 2018-02

Neural Network Playground

ta Scientist, Developer TensorFlow TypeScript Node.js
ta Scientist, Developer

TensorFlow Playground is an interactive visualization of neural networks, written in typescript using d3.js. It contains a tiny neural network library that meets the demands of this educational visualization. You can simulate, in real time, in your browser, small neural networks and see the results. Node.js was used to run the playground on the workstation.

TensorFlow TypeScript Node.js
2 Monate
2018-01 - 2018-02

Text recognition on pharmaceutical prescription papers

Data Scientist, Developer TensorFlow Python
Data Scientist, Developer

The text on pharamceutical prescription papers was to be OCRed. For this we’ve implemented a convolutional neural network using Tensorflow and Python. The scanned images were trained against a part of the data set and then tested against the rest.

 

TensorFlow Python

Kompetenzen

Kompetenzen

Produkte / Standards / Erfahrungen / Methoden

AWS
Confluence
EC2
Hadoop
Hive
IntelliJ
Jenkins
Jira
Node.js
Redis
TensorFlow

Programmiersprachen

Java
Python
TypeScript

Datenbanken

RDS

Vertrauen Sie auf GULP

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das GULP Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.