Big Data: architecture, technical leading, consulting, development
Aktualisiert am 09.08.2023
Profil
Freiberufler / Selbstständiger
Verfügbar ab: 09.08.2023
Verfügbar zu: 100%
davon vor Ort: 50%
AWS
Big Data
Technical Leading
Architekt
agiles Projektmanagement
Softwarearchitektur
Managementberatung
Managementerfahrung
Beratung
Cloud Computing
Big Data Analytics
Romanian
First Language
English
Proficient
German
Advanced

Einsatzorte

Nuremberg (+200km)
Deutschland, Österreich, Schweiz
nicht möglich

Projekte

2 Jahre 7 Monate
2020-09 - 2023-03

Big Data & AWS Cloud

ASSOCIATE DIRECTOR (PRINCIPAL ARCHITECT)
ASSOCIATE DIRECTOR (PRINCIPAL ARCHITECT)

Module Leader for a Big Data & AWS Cloud (customer BMW, München) a heavy data driven automotive project handling thousands of prototype vehicle's data, some with several TBs of new data per day, a total of more than 500 TB of data and increasing fast)

  • Owning and overseeing all technical aspects (architecture, development, operations, DevOps, testing) of the Big Data project (automotive) with the recent shift on using the AWS Cloud for the data processing / scalable capabilities / lower and predictive costs
  • Leading all customer meetings, owning the architecture, future plans (envisioning how the newly cloud migrated project could accommodate 20x more data than it is currently ingesting daily, while still being able to execute a lot more queries, a nice and responsive UI frontend, reducing costs, optimizing existing data processing, ? while offering parts of the processed data to other departments to consume)
  • Technical management of internal and external resources, interviewing and hiring all new colleagues


Technologies:

  • (starting with) an on-premises Big Data multi-tenant environment (Hadoop - BMW's CNBDP heavily customized Hadoop)
  • then migrated the entire data alongside the Big Data functionality to AWS Cloud (end date ~June 2021), while continuously working on envisioning the roadmap and future additions, the entire module future path and owning the entire architecture (Big Data & AI/ML on Cloud / Hybrid Cloud), working with a growing team to transform the business requirements into ideas and then into really working software scalable solutions
  • final stable Big Data landscape (AWS EMR - Spark, Scala, StepFunctions / S3 / Athena / Glue / ? ), Fancy UI (Angular JS, serverless REST APIs / API Gateway & AWS Lambda etc.), Security (all services related to high security needs of our very demanding customer)

Cognizant
Nürnberg (München - Remote)
1 Jahr 11 Monate
2018-10 - 2020-08

Overseeing the technical aspect of internal and external projects

PRINCIPAL DATA ARCHITECT
PRINCIPAL DATA ARCHITECT

  • Overseeing the technical aspect of internal and external projects Consulting and guiding client companies' management level in all aspects related to Big Data / Data Analytics /
  • Cloud computing / and for Industry: Smart Retail (IoT, Smart Data, Edge & Fog computing / ML & AI - architecture parts)
  • Technical management of internal consultants and/or clients' employees involved in HCDA projects
  • Creating lots of presentations, technology examples and architecture diagrams, in-house quick demos (with some extensions for purposes like: exhibitions and presentations during customer's meetings etc.)
  • Establishing architecture, deciding on AWS features to be used Evaluating, planning and managing several project aspects: analytics support & Data Lake features (data governance, data security features, data processing?)
  • Leading the on-site work (with colleagues or client's employees)


Technologies:

  • anything matching client's in-place functionality bricks, ready to be placed or even future additions (Big Data & AI/ML on Cloud / on-premises / Hybrid or Multi Cloud)

Horn & Company Data Analytics
Nürnberg (Remote)
6 Monate
2017-12 - 2018-05

Cloud agnostic Data Intelligence Hub Platform

LEAD ARCHITECT
LEAD ARCHITECT

  • In charge of all architecture aspects for DIH, an upcoming product (Data Intelligence Hub ? a new data marketplace platform) built around: Big Data and real time data (eg. IoT devices), Azure (later also AWS) Cloud, strict level Security and compliance
  • Also played a range of sub-roles like: Technical Leader for development team / Senior Big Data Architect / the Company's technical connection to Fraunhofer's IDS (technical discussions, workshops and direct contributions)
  • Worked with more than 10 various technical experts and architects to combine their experiences into a complex solution architecture for DIH, Lead in the same time the Development group (25+ developers on various teams)


Technologies:

  • Cloud agnostic Data Intelligence Hub Platform - DIH (deployed on Azure for the start and planning for easy migration toward AWS, also GCP eventually)
  • Hadoop (Cloudera Altus), platform building (programmatic resources creation / maintaining)

Deutsche Telekom
Nürnberg (Bonn, Berlin - Remote)
7 Monate
2017-05 - 2017-11

Playing active role into Big Data projects

LEAD CONSULTANT, Big Data Architect, Technical Leader
LEAD CONSULTANT, Big Data Architect, Technical Leader

  • Playing active role into Big Data projects (2 major clients in Frankfurt and Munich)
  • Establishing architecture, deciding on AWS features to be used Evaluating, planning and managing several project aspects: analytics support & Data Lake features (data governance, data security features, data processing?)
  • Leading the on-site work (with colleagues or client's employees)


Technologies:

  • Hadoop stack (Spark / Scala, Python, HIVE, NiFi, HBase?) using HDP / HDF (Hortonworks) on AWS cloud (AWS, massive datasets in S3)

Seven Principles AG
Frankfurt
4 Monate
2016-04 - 2016-07

Playing active role into Big Data projects

LEAD CONSULTANT, Big Data Architect / Technical Leader, Member of Big Data Center of Excellence
LEAD CONSULTANT, Big Data Architect / Technical Leader, Member of Big Data Center of Excellence

  • Playing active role into Big Data projects client acquisition, presenting clients how Big Data solutions can help their business (understanding their struggles and offering solutions, offering RfPs and technical support for on-going Big Data projects) 
  • Internal networking, connecting with the existing Big Data experts from inside the company (CoE), getting to know about the Cognizant Big Data solutions and success stories details for many customers, data security, governance, analytics 
  • On-site work with Cognizant colleagues or client's employees


Technologies:

  • (either Cloudera, Hortonworks, MapR) on premises or 
  • cloud (Azure HDInsight, AWS EMR and other connected technologies, Scala, Java, Python)

    COGNIZANT
    FRANKFURT, GERMANY
    1 Jahr 11 Monate
    2014-05 - 2016-03

    Big Data algorithms design and implementations

    SENIOR IT SPECIALIST, Lead Big Data Engineer, Big Data Architect, Leader of the Big Data Experts Hub Scalding and Spark (Scala) HIVE Cloudera CDH ...
    SENIOR IT SPECIALIST, Lead Big Data Engineer, Big Data Architect, Leader of the Big Data Experts Hub
    • Big Data algorithms design and implementations
    • Significantly optimized several algorithms and flows Picked up technologies for Proof of Concepts & benchmarks & estimations (including cost optimizations)


    Lead the Big Data Experts Hub group, which had as main goals:

    • Realistically and effectively drive the Big Data adoption inside the company / old & new projects
    • Guide toward embracing the correct solutions and new technologies
    • Successfully started a set of new Big Data projects meant to replace obsolete / end of life
    • Offered help during critical phases and turned the focus in the right direction to maintain the quality while reducing the efforts
    • Offered technical guidance to internal and external consultants, PM and data scientists / statisticians
    • Played several roles: technical lead developer, architect for new projects and major changes around ongoing projects (Agile, Scrum methodologies)

      Scalding and Spark (Scala) HIVE Cloudera CDH Data Science & Statistics Tableau AWS S3 / Glacier MongoDB MySQL etc
      GFK
      NUREMBERG, GERMANY
      9 Monate
      2013-08 - 2014-04

      The first employee in the Big Data department

      BIG DATA ARCHITECT & TECHNICAL LEADER Hadoop stack MapReduce V2 Cloudera CDH ...
      BIG DATA ARCHITECT & TECHNICAL LEADER
      • The first employee in the Big Data department, started the first Big Data Proof of Concept in the company, which turned later into a secondary processing capability of the main Oracle based system (mostly used for offloading nightly intensive processing into a Hadoop cluster, storing historical data for the most complex computation logic) resulting in a new faster, cost effective processing capability platform for the Optymyze product, saving costs like the Oracle Enterprise license (was no longer a must, at least for the customers with huge data volumes)
      • Designed the entire architecture: Hadoop cluster + technologies around it (to store / process the data directly from Oracle DBs / via daily input files / from previous days and months of processing on the
      • Hadoop cluster / from the flow definition and metadata) Designed a dynamically user-definable complex data processing flow (involving reusable building blocks which translated on runtime from processing logic metadata into actual pipelines of Hadoop jobs)
      Hadoop stack MapReduce V2 Cloudera CDH Scalding / Cascading / Spark Scala & Java huge Oracle Databases
      OPTYMYZE
      IASI, ROMANIA
      1 Jahr 8 Monate
      2011-12 - 2013-07

      BIG DATA ? SDE II

      LEAD BIG DATA ENGINEER as source) huge farm of Oracle DWHs plus more than 20 other Amazon services Hadoop Map Reduce ...
      LEAD BIG DATA ENGINEER
      • Led a team of 4-8 developers during the Sales Dashboard implementation (offloading the Oracle
      • DWHs processing to a new standalone Hadoop Cluster used just for the Seller Central Analytics team) and while revamping the whole set of Business Reports (complex analytical reports for sellers) to use the same cluster, offloading the Oracle DWH and significantly reducing costs (estimated total saving of $1M+ yearly), performing at scale, reliable and much faster than the previous non-Big Data solutions (while also allowing for many new use-cases and complex features which were not possible in older versions)
      • Designed the processing flows, identified the faster storage solutions (HBase, DynamoDB, S3), performed benchmarks and Proof of Concepts, imagined architecture options and drove the technical discussions; acted as key-contact person toward management upper layer
      • This solution was reused later to create a sort of Reporting Marketplace as a Service to accommodate other team's data and their business report needs
      as source) huge farm of Oracle DWHs plus more than 20 other Amazon services Hadoop Map Reduce HBase AWS (DynamoDB S3 Clickstream Shipping services Payment services SNS SQS) Agile development process
      AMAZON
      IASI, ROMANIA
      3 Jahre
      2008-12 - 2011-11

      TEAM LEADING

      SENIOR MANAGER / JAVA TEAM LEADER
      SENIOR MANAGER / JAVA TEAM LEADER
      • Led the development efforts / Managed multiple teams of engineers
      • Designed the software solution architecture, high and low level design documents for various projects and feature additions
      • Drove all technical discussions related to our team software applications
      ERICSSON
      IASI, ROMANIA / FRANKFURT, GERMANY

      Aus- und Weiterbildung

      2005-07:

      Master of Computer Science (Computational Optimization)

      Master of Science: Computer Science

      "Alexandru Ioan Cuza" University, Iasi, Romania


      2002-07:

      Computer Science

      Bachelor of Science: Computer Science

      "Alexandru Ioan Cuza" University, Iasi, Romania


      Key Focus:

      • Activities: ACM contest, sponsored by IBM (Bucharest - 1998 & 2000)


      1998:

      Computer Science Olympiad - reached National (Country Phase) - each of the 4 years

      High School Diploma

      "Grigore Moisil" Computer Science Highschool, Iasi, Romania


      Certifications & Experience

      • 14+ years of technical management and leadership positions in several big companies / projects
      • ?Leadership & Management training? (CODECS - Romania)
      • ?Communication Training? (CODECS - Romania)
      • ?Leading - the Amazon way? / ?Hiring and develop the best? (Amazon, internal trainings for managers)

      Kompetenzen

      Top-Skills

      AWS Big Data Technical Leading Architekt agiles Projektmanagement Softwarearchitektur Managementberatung Managementerfahrung Beratung Cloud Computing Big Data Analytics

      Schwerpunkte

      Big Data / Hadoop
      HIVE
      MapReduce
      Spark / Spark SQL
      • Analyze requirements, working as a focal point & contact person for project technical discussions
      • Understanding old projects? struggles and offering feasible solutions
      • Propose architecture and design details
      • Picking relevant technologies to be used
      • Technically assist on PoC development
      • (continuously updating) Good overview on Big Data landscape / technologies
      • Spark / Spark SQL
      • HIVE
      • MapReduce (both v1 & v2 on YARN)
      • Cascading / Scalding
      • Complex algorithms design or redesign
      • Processing speed optimizations:
        • from pipeline high overview - after identifying the flow possible optimizations
        • on deep details diving for solving bottlenecks in processing ? after identifying the cause(s) of performance problems
      • Storage optimizations and cost reduction proposals


      SUMMARY 

      • I am a very open person, with a long leadership experience and thus people oriented. Therefore I am always keen to help the others succeed in their roles
      • Therefore, my colleagues consult me whenever there is a complex problem to solve, a decision to make, when they expect to hear worthy advices or even some good jokes
      • I am speaking equally passionate about complex software architectures, high-level technical stuff, projects and accomplishments, my family members, latest good movies or tennis results
      • I hold a Master of Science and a Bachelor of Science degree in Computer Science


      SKILLS

      Played multiple roles around international mixed teams (on-site, near-shore, off-shore):

      • Senior Software Manager / Director
      • Lead Architect (Cloud, AWS, Big Data, Serverless)
      • Head of Data Analytics
      • Head of Software Development
      • Head of Architecture
      • Project Leader
      • Project Manager
      • Technical Team Leadership
      • Budget Development / Budget Management / Cost Optimizations
      • Key Performance Indicators / Decision Making / Data Analytics
      • Work Planning and Prioritization
      • Proposal Writing Hiring and Training / Recruiting and Interviewing
      • Coaching and Mentoring

      Programmiersprachen

      HTML
      Java
      JavaScript
      Scala
      SQL

      Datenbanken

      HBase
      MongoDB
      MySQL
      Oracle
      DataWare Houses
      Phoenix SQL Layer

      Vertrauen Sie auf GULP

      Im Bereich Freelancing
      Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

      Fragen?

      Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

      Das GULP Freelancer-Portal

      Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.