Freelance Software Architect and Consultant - Architecture, Scalability,Performance, Engineering Management
Technical responsibility for a team taking care of Site Reliability & Performance as well as Scalability of backend service infrastructure
Technical responsibility for the architectural decisions within the engineering department mainly focused on backend service architecture & communication and database design
Technical responsibility for the development department of 50 developers, together with another Software Architect in a role as CTO replacement
Some projects I built with different teams
ResearchGate
Infrastructure and Scalability
As ResearchGate usually operates on bare metal the way to flexibility in Infrastructure we chose was to dockerize all services, move completely to continuous deployment within a kubernetes cluster. To effectively leverage all these improvements we also integrated a distributed load balancer and a distributed inter service communication library to handle things like circuit breakers, fault tolerance, monitoring and backpressure mechanisms.
Technologies: Kubernetes, Docker, Linkerd, Java, Hystrix, Consul ?
To cover future growth we replicated and moved all services and data to a second datacenter and restructured rack placement as well as sharding setup of all databases.
Technologies: MongoDB, Postgres ...
Reporting and Statistics
We developed and implemented a reporting infrastructure and format based on activitystreams that enabled our tech teams, data analysts and the product department to easily do any kind of ad hoc analysis, build complex workflows and analytical pipelines on top.
Technologies: Java, Dropwizard, Storm, Flink, Hadoop, Hbase ?
Data platform and workflows
To handle, stabilize and coordinate several hundreds of big data streaming and batch workflows Researchgate is running everyday, we built a python application based on a meta description model that made dependency modeling, data management and running workflows very easy. This does not only drive complex machine learning workflows but also all analytics non technical departments do.
Technologies: Python, Hive, Hadoop, Hive, Azkaban
Monitoring and Alerting
In depth performance and site reliability coverage of researchgate.net as well as of Researchgate?s big data platform. We built a large scale distributed tracing Infrastructure enabling teams to do an in depth analysis of each relevant page and subpart of the page as well as a breakdowns of all involved databases and services. To ensure SLAs and lowest time to react on outages we built alerting, error detection and performance monitoring on a per team basis.
Technologies: Java, PHP, NodeJs, Angular, Graphite, Nginx ...
There are a lot more interesting projects to talk about in case of interest.
2006 - 2007
Brandenburg University of Applied Sciences
Computer Science
Summary
Top Skills
Freelance Software Architect and Consultant - Architecture, Scalability,Performance, Engineering Management
Technical responsibility for a team taking care of Site Reliability & Performance as well as Scalability of backend service infrastructure
Technical responsibility for the architectural decisions within the engineering department mainly focused on backend service architecture & communication and database design
Technical responsibility for the development department of 50 developers, together with another Software Architect in a role as CTO replacement
Some projects I built with different teams
ResearchGate
Infrastructure and Scalability
As ResearchGate usually operates on bare metal the way to flexibility in Infrastructure we chose was to dockerize all services, move completely to continuous deployment within a kubernetes cluster. To effectively leverage all these improvements we also integrated a distributed load balancer and a distributed inter service communication library to handle things like circuit breakers, fault tolerance, monitoring and backpressure mechanisms.
Technologies: Kubernetes, Docker, Linkerd, Java, Hystrix, Consul ?
To cover future growth we replicated and moved all services and data to a second datacenter and restructured rack placement as well as sharding setup of all databases.
Technologies: MongoDB, Postgres ...
Reporting and Statistics
We developed and implemented a reporting infrastructure and format based on activitystreams that enabled our tech teams, data analysts and the product department to easily do any kind of ad hoc analysis, build complex workflows and analytical pipelines on top.
Technologies: Java, Dropwizard, Storm, Flink, Hadoop, Hbase ?
Data platform and workflows
To handle, stabilize and coordinate several hundreds of big data streaming and batch workflows Researchgate is running everyday, we built a python application based on a meta description model that made dependency modeling, data management and running workflows very easy. This does not only drive complex machine learning workflows but also all analytics non technical departments do.
Technologies: Python, Hive, Hadoop, Hive, Azkaban
Monitoring and Alerting
In depth performance and site reliability coverage of researchgate.net as well as of Researchgate?s big data platform. We built a large scale distributed tracing Infrastructure enabling teams to do an in depth analysis of each relevant page and subpart of the page as well as a breakdowns of all involved databases and services. To ensure SLAs and lowest time to react on outages we built alerting, error detection and performance monitoring on a per team basis.
Technologies: Java, PHP, NodeJs, Angular, Graphite, Nginx ...
There are a lot more interesting projects to talk about in case of interest.
2006 - 2007
Brandenburg University of Applied Sciences
Computer Science
Summary
Top Skills
Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.