Data Engineer & Data Science Consultant - Schwerpunkte u. a. Python Stack, Apache Airflow, SQL & NoSQL Databases
Aktualisiert am 28.08.2024
Profil
Mitarbeiter eines Dienstleisters
Remote-Arbeit
Verfügbar ab: 03.09.2024
Verfügbar zu: 80%
davon vor Ort: 25%
Skill-Profil eines fest angestellten Mitarbeiters des Dienstleisters
Deutsch
Muttersprache
Englisch
Verhandlungssicher

Einsatzorte

Einsatzorte

Deutschland
möglich

Projekte

Projekte

1 Jahr 8 Monate
2023-01 - heute

Data Pipeline and Cloud Data Warehouse infrastructure development

Data Engineer Python PostgreSQL Rest API ...
Data Engineer
Project Skills / Methodology:
  • Planning, implementing and maintaining of end-to-end data pipelines based on customer specification 
  • Development of shared Python data engineering utility module
  • Software and data pipeline quality control in an agile development process
  • Development of new infrastructure components to create a Data Mesh self-service architecture


Technology:

? Azure Databricks with Unity Data Catalog

? PostreSQL database cluster

? Apache Airflow

? Python/PySpark and SQL-based ETL/LT data engineering stack

? Different data source types like Azure Blob Storage, REST API, Kafka topics

Azure MS Azure SQL Database Python
Python PostgreSQL Rest API Kafka topics
1 Jahr 8 Monate
2023-01 - heute

Development and refactoring of a python based library for sales forecasting using different prediction and machine learning approaches

Data Science & Engineering Consultant Python Pandas Numpy Sklearn ...
Data Science & Engineering Consultant
Project:
Development and refactoring of a python based
library for sales
forecasting using different prediction and machine learning
approaches


Role:

Data Science & Engineering Consultant


Project language: German


Project Skills/Methodology:

? Refactoring of existing code to improve user experience as well as the structure and maintainability of said code


Technology:

? Azure ML

? Python: pandas, numpy sklearn, matplotlib

Azure MS Azure SQL Database
Python Pandas Numpy Sklearn Matplotlib
3 Jahre
2020-01 - 2022-12

Developing and maintaining code and infrastructure for a large scale data management system for the medial research sector

ETL Developer, Devops Engineer, Medical IT Specialist JavaScript jQuery Angular ...
ETL Developer, Devops Engineer, Medical IT Specialist
Project Skills/Methodology:
  • Planning, implementing and maintaining different ETL processes sourcing a large variety of systems in an agile interdisciplinary team
  • Maintenance, migration and consolidation of legacy system components
  • Implementation and maintainance of a platform for standardized data exchange over multiple national university clinics


Technology:

? Python as main programming language

? JavaScript/jQuery/Angular, HTML, CSS, Java as supporting langues/tools

? MariaDB database (SQL), RESTful Object Storage service

? CouchDB (NoSQL) based metadata management

? CentOS 7 and Ubuntu servers, Docker, Docker-Compose for system operation

? CI/CD pipelines with Gitlab

Python Ubuntu CentOS Docker
JavaScript jQuery Angular HTML CSS Java MariaDB SQL Restful Docker-Compose CI/CD Gitlab
Göttingen
1 Jahr 10 Monate
2018-03 - 2019-12

Circlon | Operate

Devops Engineer SQL HTML CSS ...
Devops Engineer

Project: Circlon | Operate Web platform for mobile device management for logistics customers. Record and manage mobile devices to carry out and track complaint processes as well as to carry out various evaluations like the frequency of certain device faults


Project: Circlon | Cool Control

Control is a telematics solution for monitoring refrigerated transport, with a focus on the food logistics sector. The system has physical components on the vehicle (recording of temperature, door openings, vehicle position) and a web platform on which the recorded data can be viewed by the customer.


Project Skills/Methodology: ? Working as a developer in a SCRUM team ? Development of a modern frontend web solution building upon a combination of legacy and newly developed system components ? Migrating existing systems for existing customers and assisting in the onboarding of new global customers

Technology:

? Angular

? HTML / CSS

? Jasmin & Selenium Tests

? C# / .NET / Entity Framework

? SQL

? Azure Devops



Angular Azure Devops
SQL HTML CSS C# .Net Jasmin & Selenium Tests Entity Framework
Göttingen
3 Jahre 4 Monate
2014-09 - 2017-12

Support & further development of ERP system PSI Penta

Fullstack Developer /Devops Engineer Raspberry Pi SQL Visual Basic .NET
Fullstack Developer /Devops Engineer

Project Skills/Methodology: 

  • Migrating existing code onto a modern tech stack ? Maintenance and development of legacy code

Technology: 

  • Visual Basic.NET ? SQL ? Oracle

Technology:

  • Raspberry Pi

Oracle
Raspberry Pi SQL Visual Basic .NET
Göttingen

Position

Position

Fullstack Developer / Devops Engineer,

IT specialist for application development,

Technical Specialist EDP & Software Developer

Data Engineer Consultant

Kompetenzen

Kompetenzen

Schwerpunkte

Implementation
Fortgeschritten
Python Data Science Stack
Fortgeschritten
Functional Design
Fortgeschritten
Requiremants
Fortgeschritten
NoSQL Databases
Fortgeschritten
SQL
Fortgeschritten
Data Modelling & ETL
Fortgeschritten
Cloud Computing
Fortgeschritten
Azure
Fortgeschritten
Python (Pandas, FastAPI, Flask, Celery, SQL Alchemy), Workflow Automation (ActiveWorkflow, Apache Airflow), CI/CD, Docker, SQL & NoSQL Databases, Object Storage Services, Web-ID Stack (SAML, OAuth, Open ID Connect, Keycloak), Linked Data (Schema.org, JSON-LD, WikiData), Cloud Computing (Azure, AWS)

Branchen

Branchen

  • Healthcare
  • Logistics
  • E-Commerce
  • Research Data Management
  • Business Administration
  • Higher Education

Einsatzorte

Einsatzorte

Deutschland
möglich

Projekte

Projekte

1 Jahr 8 Monate
2023-01 - heute

Data Pipeline and Cloud Data Warehouse infrastructure development

Data Engineer Python PostgreSQL Rest API ...
Data Engineer
Project Skills / Methodology:
  • Planning, implementing and maintaining of end-to-end data pipelines based on customer specification 
  • Development of shared Python data engineering utility module
  • Software and data pipeline quality control in an agile development process
  • Development of new infrastructure components to create a Data Mesh self-service architecture


Technology:

? Azure Databricks with Unity Data Catalog

? PostreSQL database cluster

? Apache Airflow

? Python/PySpark and SQL-based ETL/LT data engineering stack

? Different data source types like Azure Blob Storage, REST API, Kafka topics

Azure MS Azure SQL Database Python
Python PostgreSQL Rest API Kafka topics
1 Jahr 8 Monate
2023-01 - heute

Development and refactoring of a python based library for sales forecasting using different prediction and machine learning approaches

Data Science & Engineering Consultant Python Pandas Numpy Sklearn ...
Data Science & Engineering Consultant
Project:
Development and refactoring of a python based
library for sales
forecasting using different prediction and machine learning
approaches


Role:

Data Science & Engineering Consultant


Project language: German


Project Skills/Methodology:

? Refactoring of existing code to improve user experience as well as the structure and maintainability of said code


Technology:

? Azure ML

? Python: pandas, numpy sklearn, matplotlib

Azure MS Azure SQL Database
Python Pandas Numpy Sklearn Matplotlib
3 Jahre
2020-01 - 2022-12

Developing and maintaining code and infrastructure for a large scale data management system for the medial research sector

ETL Developer, Devops Engineer, Medical IT Specialist JavaScript jQuery Angular ...
ETL Developer, Devops Engineer, Medical IT Specialist
Project Skills/Methodology:
  • Planning, implementing and maintaining different ETL processes sourcing a large variety of systems in an agile interdisciplinary team
  • Maintenance, migration and consolidation of legacy system components
  • Implementation and maintainance of a platform for standardized data exchange over multiple national university clinics


Technology:

? Python as main programming language

? JavaScript/jQuery/Angular, HTML, CSS, Java as supporting langues/tools

? MariaDB database (SQL), RESTful Object Storage service

? CouchDB (NoSQL) based metadata management

? CentOS 7 and Ubuntu servers, Docker, Docker-Compose for system operation

? CI/CD pipelines with Gitlab

Python Ubuntu CentOS Docker
JavaScript jQuery Angular HTML CSS Java MariaDB SQL Restful Docker-Compose CI/CD Gitlab
Göttingen
1 Jahr 10 Monate
2018-03 - 2019-12

Circlon | Operate

Devops Engineer SQL HTML CSS ...
Devops Engineer

Project: Circlon | Operate Web platform for mobile device management for logistics customers. Record and manage mobile devices to carry out and track complaint processes as well as to carry out various evaluations like the frequency of certain device faults


Project: Circlon | Cool Control

Control is a telematics solution for monitoring refrigerated transport, with a focus on the food logistics sector. The system has physical components on the vehicle (recording of temperature, door openings, vehicle position) and a web platform on which the recorded data can be viewed by the customer.


Project Skills/Methodology: ? Working as a developer in a SCRUM team ? Development of a modern frontend web solution building upon a combination of legacy and newly developed system components ? Migrating existing systems for existing customers and assisting in the onboarding of new global customers

Technology:

? Angular

? HTML / CSS

? Jasmin & Selenium Tests

? C# / .NET / Entity Framework

? SQL

? Azure Devops



Angular Azure Devops
SQL HTML CSS C# .Net Jasmin & Selenium Tests Entity Framework
Göttingen
3 Jahre 4 Monate
2014-09 - 2017-12

Support & further development of ERP system PSI Penta

Fullstack Developer /Devops Engineer Raspberry Pi SQL Visual Basic .NET
Fullstack Developer /Devops Engineer

Project Skills/Methodology: 

  • Migrating existing code onto a modern tech stack ? Maintenance and development of legacy code

Technology: 

  • Visual Basic.NET ? SQL ? Oracle

Technology:

  • Raspberry Pi

Oracle
Raspberry Pi SQL Visual Basic .NET
Göttingen

Position

Position

Fullstack Developer / Devops Engineer,

IT specialist for application development,

Technical Specialist EDP & Software Developer

Data Engineer Consultant

Kompetenzen

Kompetenzen

Schwerpunkte

Implementation
Fortgeschritten
Python Data Science Stack
Fortgeschritten
Functional Design
Fortgeschritten
Requiremants
Fortgeschritten
NoSQL Databases
Fortgeschritten
SQL
Fortgeschritten
Data Modelling & ETL
Fortgeschritten
Cloud Computing
Fortgeschritten
Azure
Fortgeschritten
Python (Pandas, FastAPI, Flask, Celery, SQL Alchemy), Workflow Automation (ActiveWorkflow, Apache Airflow), CI/CD, Docker, SQL & NoSQL Databases, Object Storage Services, Web-ID Stack (SAML, OAuth, Open ID Connect, Keycloak), Linked Data (Schema.org, JSON-LD, WikiData), Cloud Computing (Azure, AWS)

Branchen

Branchen

  • Healthcare
  • Logistics
  • E-Commerce
  • Research Data Management
  • Business Administration
  • Higher Education

Vertrauen Sie auf Randstad

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.