Database/ETL Developer, Data Engineer, Database Architect, Cloud Data Engineer
Aktualisiert am 04.01.2024
Profil
Freiberufler / Selbstständiger
Remote-Arbeit
Verfügbar ab: 15.01.2024
Verfügbar zu: 100%
davon vor Ort: 25%
ETL
Datenbankentwicklung
Datawarehouse
AWS
SQL-Programmierung
Python
Git
Talend
Oracle
MySQL
MS SQL Server
Jenkins
MS SQL Server Reporting Services
Amazon RDS
amazon Redshift
Atlassian Confluence
Atlassian JIRA
Agile Softwareentwicklung
Data Modeling
Tamil
Mother Tongue
English
Proficient User
German
Independent User (B1/B2)

Einsatzorte

Einsatzorte

Deutschland
möglich

Projekte

Projekte

9 months
2023-04 - 2023-12

DataOps Helpdesk

Cloud Data Engineer/Full-time Python SQL ETL ...
Cloud Data Engineer/Full-time
  • Provided pivotal support to internal customers on their Data Science and Engineering projects hosted on AWS, ensuring optimal data utilization
  • Developed and deployed a robust architecture designed to facilitate integration testing of all Terraform AWS modules of internal customers using Python and Boto3
  • Automated the testing process through GitLab, ensuring continuous testing of modules utilized by internal customers, thereby reducing errors, and enhancing reliability in daily operations

Python SQL ETL Database Modelling Terraform AWS Database Migration Services (DMS) AWS Aurora MySQL GitLab Bitbucket Ansible Microsoft SQL Server SQL Server Reporting Services (SSRS) Airflow
Deutsche Bahn AG (Customer)
9 months
2023-04 - 2023-12

Developed robust data pipelines

Cloud Data Engineer/Full-time Python SQL ETL ...
Cloud Data Engineer/Full-time
  • Developed robust data pipelines using Apache Airflow, transient EMR clusters, and GitLab, ensuring timely and accurate data delivery for the NLP project
  • Worked closely with data scientists to understand data requirements and ensured the provision of accurate data for model training and analysis

Python SQL ETL Database Modelling Terraform AWS Database Migration Services (DMS) AWS Aurora MySQL GitLab Bitbucket Ansible Microsoft SQL Server SQL Server Reporting Services (SSRS) Airflow
TruBridge GmbH (Internal)
2 years
2022-01 - 2023-12

Database Migration to AWS Cloud

Cloud Data Engineer/Full-time Python SQL ETL ...
Cloud Data Engineer/Full-time
  • Led the migration of on-premises SQL Server databases to AWS Aurora MySQL utilizing AWS DMS, ensuring a smooth transition with zero data loss
  • Designed and implemented ETL processes, ensuring data integrity and availability
  • Automated AWS infrastructure provisioning and management using Terraform and Bitbucket, enhancing deployment efficiency and reducing manual errors
  • Developed comprehensive reports utilizing SSRS, providing actionable insights for stakeholders
Python SQL ETL Database Modelling Terraform AWS Database Migration Services (DMS) AWS Aurora MySQL GitLab Bitbucket Ansible Microsoft SQL Server SQL Server Reporting Services (SSRS) Airflow
Swiss Life AG (Customer)/ GmbH, Mannheim (Germany)
1 year 9 months
2020-04 - 2021-12

pearheaded the development and maintenance of ELT solutions

Business Intelligence Engineer/Full-time Python SQL ELT ...
Business Intelligence Engineer/Full-time
  • Spearheaded the development and maintenance of ELT solutions on the Oracle platform, utilizing Oracle Data Integrator (ODI) to ensure seamless data extraction, loading, and transformation
  • Established Jenkins from scratch, creating a robust CI/CD data warehouse rollout pipeline, which streamlined the release of ELT packages and SQL scripts to various production and test instances
  • Enhanced deployment efficiency and reduced manual intervention by automating data warehouse releases

Python SQL ELT Database Modelling Oracle Data Integrator (ODI) Oracle Database Jenkins Groovy Scripting
Riverty (Former Arvato Financial Solutions), Baden-Baden (Germany)
1 year 4 months
2018-12 - 2020-03

Developed and maintained high-performance ETL solutions

Data Engineer/Full-time Python SQL ETL ...
Data Engineer/Full-time
  • Developed and maintained high-performance ETL solutions utilizing Talend Open Studio (TOS) and MySQL, ensuring efficient data extraction, transformation, and loading to deliver data to the Business Intelligence/Data Science teams
  • Spearheaded the migration of legacy ETL scripts, originally written in PHP and Python, to Talend, ensuring a seamless transition with minimal disruption to ongoing operations
  • Stepped into the role of Interim Product Owner, effectively prioritizing and ranking backlogs on the sprint board, ensuring alignment with strategic objectives and timely delivery of data team projects
Python SQL ETL Database Modelling MySQL Database Redis Talend Open Studio AWS
Sovendus GmbH, Karlsruhe (Germany)
2 years
2016-12 - 2018-11

Designed and deployed high-performance data integration solutions

Database Developer/Full-time Python SQL ETL ...
Database Developer/Full-time
  • Designed and deployed high-performance data integration solutions including Extraction, Transformation, and Loading (ETL) packages for Data Warehousing using Microsoft SQL Server Integration Services (SSIS)
  • Created tailored reports based on the varying needs of internal customers using Microsoft SQL Server Reporting Services (SSRS) and Tableau
  • Developed numerous web scraping programs with Python to extract data from internal sources, facilitating data availability for analysis and decision-making
Python SQL ETL Database Modelling SQL Server Database SQL Server Integration Services (SSIS) SQL Server Reporting Services (SSRS) AWS Redshift & Aurora Tableau
Misumi Europa GmbH, Frankfurt (Germany)
9 months
2016-03 - 2016-11

Designed a comprehensive process from scratch within SQL Server

Database Developer/Internship and Master Thesis SQL ETL Database Modelling ...
Database Developer/Internship and Master Thesis
  • Designed a comprehensive process from scratch within SQL Server to assess the quality of various data sources, ensuring robust data validation and quality assurance
  • Developed a front-end interface using Microsoft Access, providing users with an intuitive platform to interact with and manage data quality processes
  • Master Thesis Topic: on REquest


SQL ETL Database Modelling SQL Server Database SQL Server Integration Services (SSIS) Microsoft Access
Management Services Helwig Schmitt GmbH, Hofgeismar (Germany)
2 years
2012-08 - 2014-07

Engaged in the project development phase

Data Warehouse Analyst/Full-time SQL ETL Database Modelling ...
Data Warehouse Analyst/Full-time
  • Engaged in the project development phase, ensuring the quality and compatibility of code in adherence to Verizon?s Quality standards and industry best practices
  • Developed Teradata SQL test scripts, translating test procedures into executable scripts and executing them using Teradata SQL Assistant and BTEQ
  • Analyzed business and functional requirements, deriving detailed test plans, test cases, and procedures to ensure thorough testing of UNIX/Teradata-based Data Warehouse applications
  • Coordinated integration testing activities among various Data Warehouse teams and Upstream/Downstream application test teams, ensuring comprehensive testing and quality assurance
  • Acted as a pivotal Point of Contact (POC) among the Production, Development, and System Integration Testing (SIT) teams, ensuring seamless communication and issue tracking within the Production box
  • Conducted daily status calls with the development team and clients, ensuring all stakeholders were aligned and updated regarding project status and any emerging issues
SQL ETL Database Modelling Teradata Database HP Quality Center Database Testing
Verizon Data Services India Pvt. Ltd., Chennai (India)

Aus- und Weiterbildung

Aus- und Weiterbildung

2 years 3 months
2014-09 - 2016-11

Communication and Media Engineering

M.Sc., Offenburg University of Applied Sciences, Offenburg (Germany)
M.Sc.
Offenburg University of Applied Sciences, Offenburg (Germany)
Software Engineering

4 years 1 month
2008-06 - 2012-06

Electrical and Electronics Engineering

B.E., St. Joseph?s College of Engineering (Affiliated to Anna University), Chennai (India)
B.E.
St. Joseph?s College of Engineering (Affiliated to Anna University), Chennai (India)
  • Electrical, Electronics & Computer Science

1 year 11 months
2006-06 - 2008-04

Higher Secondary Certificate

Alpha Plus Matriculation Higher Secondary School, Trichy (India)
Alpha Plus Matriculation Higher Secondary School, Trichy (India)
  • Computer Science
  • Mathematics
  • Physics and Chemistry

9 years 11 months
1996-06 - 2006-04

Secondary School Leaving Certificate

Palakurichy (India)
Palakurichy (India)


                                    

Position

Position

Data Engineer

Kompetenzen

Kompetenzen

Top-Skills

ETL Datenbankentwicklung Datawarehouse AWS SQL-Programmierung Python Git Talend Oracle MySQL MS SQL Server Jenkins MS SQL Server Reporting Services Amazon RDS amazon Redshift Atlassian Confluence Atlassian JIRA Agile Softwareentwicklung Data Modeling

Produkte / Standards / Erfahrungen / Methoden

Technical Skills
  • SQL, ETL/ELT, Database Modelling 
  • Python (Pandas, PySpark, Boto3, etc.) 
  • AWS (RDS, Aurora, Redshift, DMS, S3, Athena) 
  • AWS (Kinesis, Glue, Lambda, EMR, CloudWatch, QuickSight) 
  • Terraform, Ansible, GitLab, Jenkins, Airflow 
  • Microsoft SQL Server, SSIS, SSRS, MySQL
  • Oracle Database, Oracle Data Integrator, Teradata, Talend Open Studio 
  • Bitbucket, SVN, NoSQL (Redis, DynamoDB), Groovy 

Einsatzorte

Einsatzorte

Deutschland
möglich

Projekte

Projekte

9 months
2023-04 - 2023-12

DataOps Helpdesk

Cloud Data Engineer/Full-time Python SQL ETL ...
Cloud Data Engineer/Full-time
  • Provided pivotal support to internal customers on their Data Science and Engineering projects hosted on AWS, ensuring optimal data utilization
  • Developed and deployed a robust architecture designed to facilitate integration testing of all Terraform AWS modules of internal customers using Python and Boto3
  • Automated the testing process through GitLab, ensuring continuous testing of modules utilized by internal customers, thereby reducing errors, and enhancing reliability in daily operations

Python SQL ETL Database Modelling Terraform AWS Database Migration Services (DMS) AWS Aurora MySQL GitLab Bitbucket Ansible Microsoft SQL Server SQL Server Reporting Services (SSRS) Airflow
Deutsche Bahn AG (Customer)
9 months
2023-04 - 2023-12

Developed robust data pipelines

Cloud Data Engineer/Full-time Python SQL ETL ...
Cloud Data Engineer/Full-time
  • Developed robust data pipelines using Apache Airflow, transient EMR clusters, and GitLab, ensuring timely and accurate data delivery for the NLP project
  • Worked closely with data scientists to understand data requirements and ensured the provision of accurate data for model training and analysis

Python SQL ETL Database Modelling Terraform AWS Database Migration Services (DMS) AWS Aurora MySQL GitLab Bitbucket Ansible Microsoft SQL Server SQL Server Reporting Services (SSRS) Airflow
TruBridge GmbH (Internal)
2 years
2022-01 - 2023-12

Database Migration to AWS Cloud

Cloud Data Engineer/Full-time Python SQL ETL ...
Cloud Data Engineer/Full-time
  • Led the migration of on-premises SQL Server databases to AWS Aurora MySQL utilizing AWS DMS, ensuring a smooth transition with zero data loss
  • Designed and implemented ETL processes, ensuring data integrity and availability
  • Automated AWS infrastructure provisioning and management using Terraform and Bitbucket, enhancing deployment efficiency and reducing manual errors
  • Developed comprehensive reports utilizing SSRS, providing actionable insights for stakeholders
Python SQL ETL Database Modelling Terraform AWS Database Migration Services (DMS) AWS Aurora MySQL GitLab Bitbucket Ansible Microsoft SQL Server SQL Server Reporting Services (SSRS) Airflow
Swiss Life AG (Customer)/ GmbH, Mannheim (Germany)
1 year 9 months
2020-04 - 2021-12

pearheaded the development and maintenance of ELT solutions

Business Intelligence Engineer/Full-time Python SQL ELT ...
Business Intelligence Engineer/Full-time
  • Spearheaded the development and maintenance of ELT solutions on the Oracle platform, utilizing Oracle Data Integrator (ODI) to ensure seamless data extraction, loading, and transformation
  • Established Jenkins from scratch, creating a robust CI/CD data warehouse rollout pipeline, which streamlined the release of ELT packages and SQL scripts to various production and test instances
  • Enhanced deployment efficiency and reduced manual intervention by automating data warehouse releases

Python SQL ELT Database Modelling Oracle Data Integrator (ODI) Oracle Database Jenkins Groovy Scripting
Riverty (Former Arvato Financial Solutions), Baden-Baden (Germany)
1 year 4 months
2018-12 - 2020-03

Developed and maintained high-performance ETL solutions

Data Engineer/Full-time Python SQL ETL ...
Data Engineer/Full-time
  • Developed and maintained high-performance ETL solutions utilizing Talend Open Studio (TOS) and MySQL, ensuring efficient data extraction, transformation, and loading to deliver data to the Business Intelligence/Data Science teams
  • Spearheaded the migration of legacy ETL scripts, originally written in PHP and Python, to Talend, ensuring a seamless transition with minimal disruption to ongoing operations
  • Stepped into the role of Interim Product Owner, effectively prioritizing and ranking backlogs on the sprint board, ensuring alignment with strategic objectives and timely delivery of data team projects
Python SQL ETL Database Modelling MySQL Database Redis Talend Open Studio AWS
Sovendus GmbH, Karlsruhe (Germany)
2 years
2016-12 - 2018-11

Designed and deployed high-performance data integration solutions

Database Developer/Full-time Python SQL ETL ...
Database Developer/Full-time
  • Designed and deployed high-performance data integration solutions including Extraction, Transformation, and Loading (ETL) packages for Data Warehousing using Microsoft SQL Server Integration Services (SSIS)
  • Created tailored reports based on the varying needs of internal customers using Microsoft SQL Server Reporting Services (SSRS) and Tableau
  • Developed numerous web scraping programs with Python to extract data from internal sources, facilitating data availability for analysis and decision-making
Python SQL ETL Database Modelling SQL Server Database SQL Server Integration Services (SSIS) SQL Server Reporting Services (SSRS) AWS Redshift & Aurora Tableau
Misumi Europa GmbH, Frankfurt (Germany)
9 months
2016-03 - 2016-11

Designed a comprehensive process from scratch within SQL Server

Database Developer/Internship and Master Thesis SQL ETL Database Modelling ...
Database Developer/Internship and Master Thesis
  • Designed a comprehensive process from scratch within SQL Server to assess the quality of various data sources, ensuring robust data validation and quality assurance
  • Developed a front-end interface using Microsoft Access, providing users with an intuitive platform to interact with and manage data quality processes
  • Master Thesis Topic: on REquest


SQL ETL Database Modelling SQL Server Database SQL Server Integration Services (SSIS) Microsoft Access
Management Services Helwig Schmitt GmbH, Hofgeismar (Germany)
2 years
2012-08 - 2014-07

Engaged in the project development phase

Data Warehouse Analyst/Full-time SQL ETL Database Modelling ...
Data Warehouse Analyst/Full-time
  • Engaged in the project development phase, ensuring the quality and compatibility of code in adherence to Verizon?s Quality standards and industry best practices
  • Developed Teradata SQL test scripts, translating test procedures into executable scripts and executing them using Teradata SQL Assistant and BTEQ
  • Analyzed business and functional requirements, deriving detailed test plans, test cases, and procedures to ensure thorough testing of UNIX/Teradata-based Data Warehouse applications
  • Coordinated integration testing activities among various Data Warehouse teams and Upstream/Downstream application test teams, ensuring comprehensive testing and quality assurance
  • Acted as a pivotal Point of Contact (POC) among the Production, Development, and System Integration Testing (SIT) teams, ensuring seamless communication and issue tracking within the Production box
  • Conducted daily status calls with the development team and clients, ensuring all stakeholders were aligned and updated regarding project status and any emerging issues
SQL ETL Database Modelling Teradata Database HP Quality Center Database Testing
Verizon Data Services India Pvt. Ltd., Chennai (India)

Aus- und Weiterbildung

Aus- und Weiterbildung

2 years 3 months
2014-09 - 2016-11

Communication and Media Engineering

M.Sc., Offenburg University of Applied Sciences, Offenburg (Germany)
M.Sc.
Offenburg University of Applied Sciences, Offenburg (Germany)
Software Engineering

4 years 1 month
2008-06 - 2012-06

Electrical and Electronics Engineering

B.E., St. Joseph?s College of Engineering (Affiliated to Anna University), Chennai (India)
B.E.
St. Joseph?s College of Engineering (Affiliated to Anna University), Chennai (India)
  • Electrical, Electronics & Computer Science

1 year 11 months
2006-06 - 2008-04

Higher Secondary Certificate

Alpha Plus Matriculation Higher Secondary School, Trichy (India)
Alpha Plus Matriculation Higher Secondary School, Trichy (India)
  • Computer Science
  • Mathematics
  • Physics and Chemistry

9 years 11 months
1996-06 - 2006-04

Secondary School Leaving Certificate

Palakurichy (India)
Palakurichy (India)


                                    

Position

Position

Data Engineer

Kompetenzen

Kompetenzen

Top-Skills

ETL Datenbankentwicklung Datawarehouse AWS SQL-Programmierung Python Git Talend Oracle MySQL MS SQL Server Jenkins MS SQL Server Reporting Services Amazon RDS amazon Redshift Atlassian Confluence Atlassian JIRA Agile Softwareentwicklung Data Modeling

Produkte / Standards / Erfahrungen / Methoden

Technical Skills
  • SQL, ETL/ELT, Database Modelling 
  • Python (Pandas, PySpark, Boto3, etc.) 
  • AWS (RDS, Aurora, Redshift, DMS, S3, Athena) 
  • AWS (Kinesis, Glue, Lambda, EMR, CloudWatch, QuickSight) 
  • Terraform, Ansible, GitLab, Jenkins, Airflow 
  • Microsoft SQL Server, SSIS, SSRS, MySQL
  • Oracle Database, Oracle Data Integrator, Teradata, Talend Open Studio 
  • Bitbucket, SVN, NoSQL (Redis, DynamoDB), Groovy 

Vertrauen Sie auf Randstad

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.