Big Data Engineer, Apache Hadoop
Aktualisiert am 23.10.2019
Profil
Freiberufler / Selbstständiger
Verfügbar ab: 01.11.2019
Verfügbar zu: 100%
davon vor Ort: 100%
Big Data
Big Data Analytics
Hadoop
Hortonworks Distribution Platform
MySQL
PostgreSQL
Oracle
Ansi SQL
Java
In Memory Database
Cloudera Distribution for Hadoop
Scrum
Apache Spark
Apache kafka
Hive
HBase
Apache Ranger
Apache Yarn
Microsoft Windows
Microsoft Azure
Ansible
Docker
English
Excellent
German
B2 Level (Having UniCert B1 certificate) ? Working proficiency
Hindi
Mother Tongue

Einsatzorte

Einsatzorte

Deutschland
nicht möglich

Projekte

Projekte

6 Monate
2019-03 - 2019-08

Big Data Architecture & Operations

Senior Big Data Engineer & Developer
Senior Big Data Engineer & Developer
  • Responsible for monitoring, configuring, performance tuning & administrating the enterprise Hadoop environments.
  • Well versed with Hadoop distribution framework- Hortonworks Data Platform (HDP) & its various components (Apache Kafka, Apache Spark, Apache Hive, Apache HBase, Apache Ranger, Apache Flume, Apache YARN, Apache Oozie etc.).
  • Responsible for creating data pipelines between various external systems and Hadoop production system.
  • Resolved critical real-time incidents based on all the Hadoop environments (Production, Pre-Production, Development & Sandbox) and provided root cause analysis.
Volkswagen Financial Services AG, Braunschweig, Germany
6 Monate
2018-07 - 2018-12

Big Data Architecture & Operations (Hadoop)

Senior Big Data Engineer & Developer
Senior Big Data Engineer & Developer
  • Developing, managing, monitoring & administrating the enterprise Hadoop environments.
  • Created the large, shared & multi-tenant Hadoop Clusters for POC, Development, Sandbox and Production environments.
  • Built scripts for the automation of Hadoop administrative tasks and various other functionalities.
  • Coordination and close collaboration with other organizational teams (infrastructure, network, IT security, database and application teams).
Schwarz IT GmbH & Co. KG, Heilbronn, Germany
7 Monate
2017-12 - 2018-06

Big Data Architecture & Operations

Big Data Engineer & Developer
Big Data Engineer & Developer
  • Responsible for developing, managing, monitoring & administrating the enterprise Hadoop environments for the client Schwarz IT GmbH.
  • Implemented ETL processes with different Business Intelligence (BI) tools and integrated to Hadoop environments.
  • Performed HDP version update & upgrade for existing Hadoop clusters.
  • Develop and deliver end-to-end Big Data solutions.
Etengo Academic Experts GmbH, Mannheim, Germany
3 Jahre 7 Monate
2014-06 - 2017-12

Big Data Analytics

Big Data Developer and Researcher
Big Data Developer and Researcher
  • Worked extensively with various Big Data Technologies (Hadoop Ecosystem, Apache Spark, Apache Zeppelin, Spark Streaming, Spark SQL, Hive, Impala, MapReduce and Hadoop Cluster Setup).
  • Design and developed various Proof of Concepts (POCs) for large scale big data analytics and real-time data analytics to collect, store, process, analyze and reporting of the data.
  • Application development with Java, Python and Scala.
  • Developed various prototypes for performance evaluation and optimization of the Relational Databases (RDBMS) and In-Memory Databases (IMDBs).
Deutsche Börse AG, Eschborn, Germany
1 Jahr 7 Monate
2012-03 - 2013-09

Software Engineering

Java/JEE Developer
Java/JEE Developer
  • Development and enhancement of various Java/JEE Projects.
  • Well versed with Java/JEE technologies, JSP, Servlet, JDBC, Struts, JavaScript, XML and HTML for end-to-end development.
  • Developed application with Oracle, PLSQL, MySQL and PostgreSQL.
  • Involved in requirement analysis, design, development, testing, debugging, client interaction, on-site coordination and deployment.
Wipro Technologies, Bangalore (India)

Aus- und Weiterbildung

Aus- und Weiterbildung

4 Jahre 1 Monat
2013-10 - 2017-10

Master of Science(MS), Distributed Software Systems

Master of Science(MS), Technical University of Darmstadt, Germany
Master of Science(MS)
Technical University of Darmstadt, Germany
4 Jahre
2007-08 - 2011-07

Bachelor of Engineering (BE), Information Technology

Bachelor of Engineering (BE), College of Technology and Engineering, MPUAT Udaipur, India
Bachelor of Engineering (BE)
College of Technology and Engineering, MPUAT Udaipur, India

Kompetenzen

Kompetenzen

Top-Skills

Big Data Big Data Analytics Hadoop Hortonworks Distribution Platform MySQL PostgreSQL Oracle Ansi SQL Java In Memory Database Cloudera Distribution for Hadoop Scrum Apache Spark Apache kafka Hive HBase Apache Ranger Apache Yarn Microsoft Windows Microsoft Azure Ansible Docker

Produkte / Standards / Erfahrungen / Methoden

Technical Proficiency

Big Data Distribution Frameworks:

  • Hortonworks Data Platform(HDP)
  • Cloudera Distribution of Hadoop(CDH)

Methodologies:

  • Agile Development
  • SCRUM

Tools:

  • Eclipse
  • IntelliJ
  • SVN
  • JIRA
  • Bugzilla
  • Git
  • RStudio
  • Apache Zeppelin

Automation & Configuration Tools:

  • Ansible

Containerization Tools:

  • Docker

Cloud Tools:

  • Microsoft Azure

Betriebssysteme

Linux
Microsoft Windows

Programmiersprachen

HQL
Java/JEE
JavaScript
JSP
Python
Servlet
Shell Scripting
SQL
XML

Datenbanken

MS SQL Server
MySQL
Oracle
PostgreSQL
Redis
VoltDB

Einsatzorte

Einsatzorte

Deutschland
nicht möglich

Projekte

Projekte

6 Monate
2019-03 - 2019-08

Big Data Architecture & Operations

Senior Big Data Engineer & Developer
Senior Big Data Engineer & Developer
  • Responsible for monitoring, configuring, performance tuning & administrating the enterprise Hadoop environments.
  • Well versed with Hadoop distribution framework- Hortonworks Data Platform (HDP) & its various components (Apache Kafka, Apache Spark, Apache Hive, Apache HBase, Apache Ranger, Apache Flume, Apache YARN, Apache Oozie etc.).
  • Responsible for creating data pipelines between various external systems and Hadoop production system.
  • Resolved critical real-time incidents based on all the Hadoop environments (Production, Pre-Production, Development & Sandbox) and provided root cause analysis.
Volkswagen Financial Services AG, Braunschweig, Germany
6 Monate
2018-07 - 2018-12

Big Data Architecture & Operations (Hadoop)

Senior Big Data Engineer & Developer
Senior Big Data Engineer & Developer
  • Developing, managing, monitoring & administrating the enterprise Hadoop environments.
  • Created the large, shared & multi-tenant Hadoop Clusters for POC, Development, Sandbox and Production environments.
  • Built scripts for the automation of Hadoop administrative tasks and various other functionalities.
  • Coordination and close collaboration with other organizational teams (infrastructure, network, IT security, database and application teams).
Schwarz IT GmbH & Co. KG, Heilbronn, Germany
7 Monate
2017-12 - 2018-06

Big Data Architecture & Operations

Big Data Engineer & Developer
Big Data Engineer & Developer
  • Responsible for developing, managing, monitoring & administrating the enterprise Hadoop environments for the client Schwarz IT GmbH.
  • Implemented ETL processes with different Business Intelligence (BI) tools and integrated to Hadoop environments.
  • Performed HDP version update & upgrade for existing Hadoop clusters.
  • Develop and deliver end-to-end Big Data solutions.
Etengo Academic Experts GmbH, Mannheim, Germany
3 Jahre 7 Monate
2014-06 - 2017-12

Big Data Analytics

Big Data Developer and Researcher
Big Data Developer and Researcher
  • Worked extensively with various Big Data Technologies (Hadoop Ecosystem, Apache Spark, Apache Zeppelin, Spark Streaming, Spark SQL, Hive, Impala, MapReduce and Hadoop Cluster Setup).
  • Design and developed various Proof of Concepts (POCs) for large scale big data analytics and real-time data analytics to collect, store, process, analyze and reporting of the data.
  • Application development with Java, Python and Scala.
  • Developed various prototypes for performance evaluation and optimization of the Relational Databases (RDBMS) and In-Memory Databases (IMDBs).
Deutsche Börse AG, Eschborn, Germany
1 Jahr 7 Monate
2012-03 - 2013-09

Software Engineering

Java/JEE Developer
Java/JEE Developer
  • Development and enhancement of various Java/JEE Projects.
  • Well versed with Java/JEE technologies, JSP, Servlet, JDBC, Struts, JavaScript, XML and HTML for end-to-end development.
  • Developed application with Oracle, PLSQL, MySQL and PostgreSQL.
  • Involved in requirement analysis, design, development, testing, debugging, client interaction, on-site coordination and deployment.
Wipro Technologies, Bangalore (India)

Aus- und Weiterbildung

Aus- und Weiterbildung

4 Jahre 1 Monat
2013-10 - 2017-10

Master of Science(MS), Distributed Software Systems

Master of Science(MS), Technical University of Darmstadt, Germany
Master of Science(MS)
Technical University of Darmstadt, Germany
4 Jahre
2007-08 - 2011-07

Bachelor of Engineering (BE), Information Technology

Bachelor of Engineering (BE), College of Technology and Engineering, MPUAT Udaipur, India
Bachelor of Engineering (BE)
College of Technology and Engineering, MPUAT Udaipur, India

Kompetenzen

Kompetenzen

Top-Skills

Big Data Big Data Analytics Hadoop Hortonworks Distribution Platform MySQL PostgreSQL Oracle Ansi SQL Java In Memory Database Cloudera Distribution for Hadoop Scrum Apache Spark Apache kafka Hive HBase Apache Ranger Apache Yarn Microsoft Windows Microsoft Azure Ansible Docker

Produkte / Standards / Erfahrungen / Methoden

Technical Proficiency

Big Data Distribution Frameworks:

  • Hortonworks Data Platform(HDP)
  • Cloudera Distribution of Hadoop(CDH)

Methodologies:

  • Agile Development
  • SCRUM

Tools:

  • Eclipse
  • IntelliJ
  • SVN
  • JIRA
  • Bugzilla
  • Git
  • RStudio
  • Apache Zeppelin

Automation & Configuration Tools:

  • Ansible

Containerization Tools:

  • Docker

Cloud Tools:

  • Microsoft Azure

Betriebssysteme

Linux
Microsoft Windows

Programmiersprachen

HQL
Java/JEE
JavaScript
JSP
Python
Servlet
Shell Scripting
SQL
XML

Datenbanken

MS SQL Server
MySQL
Oracle
PostgreSQL
Redis
VoltDB

Vertrauen Sie auf GULP

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das GULP Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.