With 11 years in relational databases and 7 in data engineering, I excel in migration projects, work autonomously, and automate tasks using Python.
Aktualisiert am 15.01.2024
Profil
Freiberufler / Selbstständiger
Remote-Arbeit
Verfügbar ab: 02.01.2024
Verfügbar zu: 100%
davon vor Ort: 10%
Datenbanken
Python
Linux
docker
Cloud
REST API
github actions
sql
PostgreSQL
MySQL
Oracle
PL/SQL
bash
snowflake
Databricks
AWS
GCP
Azure
DWH
PySpark
migration
integration
MSSQL
English
C1
Polish
Fortgeschritten
German
A2

Einsatzorte

Berlin (+10km)
Deutschland
möglich

Projekte

10 months
2023-04 - now

Development of the Predictive Sales Software

Sr. Data / DB Engineer Python Flask SQLAlchemy ...
Sr. Data / DB Engineer
  • Development of the Predictive Sales Software, including but not limited to: DB Engineering, API Development and integrating with other APIs and services, Python / Flask / bash back-end development, JS / Jinja2 / CSS / AJAX / jquery / html front-end development, technical assistance in customer projects
  • Cloud connector development, fetching data from different sources, data mapping, uploading into REST API
  • handling SAP Basis and DB commands and administration in Linux operating system
  • performing different type of client copies and related activities
  • db user management : Creating roles, users, privileges, password management
  • Linux environment SAP system installation and end to end provisioning
  • installing SAP systems of Public cloud
  • SAP Hana backup/restore technologies
  • DB build operations for the sovereign cloud
Python Flask SQLAlchemy pandas SQL Server MySQL Oracle SAP/Hana GNU/Linux github CI/CD (github actions) Azure REST API VMware virtualbox docker JS Jinja2 CSS AJAX jquery html
qymatix remote
9 months
2023-04 - 2023-12

Cloud connector development for Predictive Sales Software

Data Engineer Python Flask Django ...
Data Engineer
Development of the Predictive Sales Software, including but not limited to: DB Engineering, API Development and integrating with other APIs and services, Python / Flask / bash back-end development, JS / Jinja2 / CSS / AJAX / jquery / html front-end development, technical assistance in customer projects.
Cloud connector development, fetching data from different sources, data mapping, uploading into REST API.
Creating wrapper application based on Python PyQt5 that users can run on their PC or laptop (Windows and Linux versions), it creates an SSH tunnel and opens the web app behind ssh in its window automatically.
Writing unit tests (pytest).
Assisting in sales process, creating ssh tunnel, adjusting key-based authentication, preparing mock data, writing documentation, etc.
Preparation of the demo video for customers (GNU/Linux, Simplescreenrecorder, FFmpeg, Gnome-Subtitles, Mkvtoolnix)
Communication with security vendors about false-positive antivirus alerts on our apps.
Python Flask Django SQLAlchemy pandas sshtunnel PyQt5 SQL Server MySQL Oracle SAP/Hana GNU/Linux github CI/CD (github actions) Azure REST API VMware virtualbox docker JS Jinja2 CSS AJAX jquery html
german startup
remote
5 months
2022-11 - 2023-03

Temporary Data Engineering project

Sr. Data Engineer Python SQL Javascript basics ...
Sr. Data Engineer
Temporary Data Engineering project for the local community (fintech). 
  • gathering requirements from customers
  • unstructured documents processing using Bash
  • data quality checking
Python SQL Javascript basics Unix fintech
fintech freelance remote
6 months
2022-06 - 2022-11

Short-term project

Sr.DBA / Engineer AWS (ec2 rds) GCP ...
Sr.DBA / Engineer
Short-term project related to db and pipelines migration: cloud management, monitoring and troubleshooting, DB Ops. A
  • writing Python scripts for checking various parameters of each db host from the inventory ? hundreds of servers
  • ad-hoc monitoring db hosts using UI tools; automating alerting about unexpected events
AWS (ec2 rds) GCP Azure MySQL SQLite advanced GNU Linux related stuff bash Python MONyog Zabbix Pingdom perconatoolkit solarwinds (confio) db monitoring fio db tests db linux servers validation
TCS / SAP Labs remote
2 years
2020-07 - 2022-06

consolidating data from microservices into dwh

Data Engineer Postgres Power BI Stitch (etl tool) ...
Data Engineer
TheGuarantors, fintech company providing innovative insurance products and financial solutions for residential and commercial real estate professionals as well as their residents and tenants.
  • Data Science team
  • AWS (ec2, rds, s3, ses)
  • consolidating data from microservices into dwh
  • creating bi dashboards
  • tuning objects in dwh in order to make them cached
  • Data Modeling
  • dba stuff like creating users, setting access rights on different environments, aws rds db replication
  • looking for missing indexes etc in order to optimize sql queries
  • checking data quality and integrity, creating various concepts for future usage
  • creating star-type dwh
  • creating db functions for financial forecasting
  • migration from Redshift/Periscope into Snowflake/PowerBI
  • various performance testing under high load
  • parsing and joining complex json values in Postgres and Snowflake
  • preparing documentation, presentations for business users, new team members onboarding (basic)


Achievements:

  • created custom ETL process based on Python for handling key-based replication deleted records and for cross-instance data quality checks (Postgres vs Redshift and Postgres vs Snowflake)
  • created custom process based on panda | Python for various data quality checks;
  • created data pipeline alert process based on Python for notifying users about various events in database, integrated with mailjet (email service) and Slack
  • created basic frontend subsystem based on Python & Flask for notifications management
  • created databricks to hubspot API integration using Python
  • created basic web api based on Flask and Google Cloud 
Postgres Power BI Stitch (etl tool) dwh Python + sql coding GNU/Linux unix shell scripting; Anaconda Jupyter Notebook databricks / PySpark basic usage
Dressler remote
1 year 8 months
2019-05 - 2020-12

Data Modeling

Sr. SQL / DWH Dev
Sr. SQL / DWH Dev

  • Short-term healthcare project
  • Data Modeling
  • AWS (ec2, rds, s3)
  • (investigating) PySpark, Parquet, SQLite, Amazon Redshift, Amazon S3 : generating Parquet files using PySpark from different db
  • types, checking result using SQLite locally, uploading into Amazon and making queries;
  • (dba) SQL Server: backup, restore, check and interpret audit tables, create users, grant access rights
  • PostgreSQL RDS and selfhosted instance: enable and configure logical decoding for audit usage
  • (support) MySQL, basic perl scripting: uploading csv files into remote MySQL API using perl, data validation
  • (data integration) preparing backend to store Sendgrid API data in PostgreSQL
  • (dealing with legacy) transforming legacy database into structured and documented one (data science) data cleaning, deduplication, comparing records etc.
  • (migration) SQL Server -> PostgreSQL (custom scripts); Legacy MySQL -> Prod MySQL (mysqldump); Legacy MySQL -> stage
  • PostgreSQL (pgloader)
  • (reporting) dealing with advanced excel-like formulas in Klipfolio in order to pass various input parameters; creating product's
  • dashboard with essential business values
  • (linux infrastructure administrating) obtaining https certificate from Let's Encrypt configuring ssh tunnels to access databases
  • configuring virtual hosting for API

Zealic Solutions remote/hybrid
6 months
2020-01 - 2020-06

Synthetic data / data obfuscation, short-term project

SQL Dev Data Modeling SQL T-SQL ...
SQL Dev
  • Synthetic data / data obfuscation, short-term project.
  • Finance company needs to populate big amount of tables with synthetic/obfuscated data (millions of records) while keeping some of them real, so that its clients are able to continue training without personal data.
  • Soft skills: basic onboarding of new members; involved in basic hr stuf
Data Modeling SQL T-SQL SSIS XML regexp redgate sql data generator PowerShell advanced batch scripting automated testing (tSQLt) in-memory calculations TFS (version control) Microsoft Teams preparing basic documentation
Eleks remote
2 months
2019-04 - 2019-05

designing a database to manage information

Freelance SQL Developer SQL T-SQL SQL Server ...
Freelance SQL Developer
  • Freelance network
  • designing a database to manage information on the collection of various types of taxes writing ad-hoc queries to populate a schema
  • preparing a presentation to demonstrate working code
SQL T-SQL SQL Server Data Modeling
Toptal remote
2 years 8 months
2016-09 - 2019-04

Data integration remote

SQL Developer Oracle SQL Server Postgres ...
SQL Developer
  • AWS (ec2, rds, s3), data integration
  • creating sql connectors: analyse api (rest/soap) in order to estimate the effort, request
  • credentials including refresh token etc, fill data in api/ui in order to see final results if no sandbox present, control deprecation and upgrade connector if needed, create/update documentation, support customers (occasionally as main tasks are development), deploy and test (including in UI), creating mock services.
  • In course of my work I started using Java code for data manipulation using objecttable/teiid.
  • analyzing user?s requirements
  • analyzing external REST API & SOAP API documentation
  • writing connectors code
  • building server and pipeline UI
  • writing connector?s documentation

Oracle SQL Server Postgres MySQL SAP Hana Redshift
1 year 10 months
2014-11 - 2016-08

creating and maintaining Oracle database objects required by business

Oracle PL/SQL Developer Oracle SQL PL/SQL ...
Oracle PL/SQL Developer

  • L3 support of business users
  • creating of Oracle database objects documentation

Oracle SQL PL/SQL bash perl basics DWH
PLS logistics services remote/hybrid
3 years 7 months
2011-04 - 2014-10

migration from SAP BI to Oracle BI

Oracle PL/SQL Developer Oracle SQL PL/SQL ...
Oracle PL/SQL Developer

  • creating BI reports and dashboards
  • developing and supporting a fraud prevention alarm system for internet banking

Oracle SQL PL/SQL SAP BI SAP Hana Oracle BI
Volksbank onsite with remote option

Aus- und Weiterbildung

Polytechnic University (Lviv)


Courses, Trainings, Certification

  • Business English
  • SCRUM
  • ANSI SQL
  • Python

Kompetenzen

Top-Skills

Datenbanken Python Linux docker Cloud REST API github actions sql PostgreSQL MySQL Oracle PL/SQL bash snowflake Databricks AWS GCP Azure DWH PySpark migration integration MSSQL

Produkte / Standards / Erfahrungen / Methoden

Summary
  • Creating RESTful APIs based on Flask/Python/AWS|GCP|Azure and integrating with other APIs and services
  • 10 years of experience as DB Developer
  • 10 years of experience working with vps, hosting, dns
  • 7 years of experience working with clouds - AWS (ec2, rds, s3, ses)
  • 7 years of experience working with REST API integrations
  • understanding of relational database concepts
  • estimation, implementation planning; development, integration and deployment
  • Good knowledge of SQL, PL/SQL and Transact-SQL
  • + sql statements performance tuning
  • + reverse engineering of undocumented sql and pl/sql code
  • Oracle, MS SQL Server, mysql, postgres, sap/hana, redshift, snowflake
  • Oracle BI (repository, analysis, dashboard, agent development) and SAP Business Objects (universe and report development)
  • data quality & validation; unix shell scripting; Linux enthusiast


Skills

  • creating a new instance; installing Postgres from scratch.
  • DB schema modeling
  • obtaining data from the database, saving it as a CSV, and storing it in a password-protected web folder
  • automatic data import into the database from various sources (CSV, REST API services)
  • schema and/or data backup automation
  • Use a self-written ETL process or commercial products (Stitch, Airbyte, etc.) to sync data between different DB ins tances.
  • Various data quality and integrity checks, as well as alerting in the event of an unexpected event (email, SMS, Slack, and so on).
  • automating the retrieval of reports from the database and their transmission via email.
  • automating database data retrieval and transmission to remote REST API services.
  • Using Flask to create a REST API service from a database
  • creating DB functions and procedures
  • automatic monitoring of a large number of database servers (open ports, running services, and so on).
  • data migration from legacy databases
  • automatic table auditing via triggers and/or log-based replication slots (logical decoding)
  • data transfer from DB microservices to DWH
  • DBA tasks such as user creation and access rights assignment to various environments
  • looking for missing DB indexes, etc., in order to optimize SQL queries
  • DB parsing and joining of complex JSON values
  • Creating database and Linux-based system documentation, as well as presentations for business users.
  • DB data cleaning, deduplication, etc.
  • automatic data comparison and alerting about differences between multiple database instances

Branchen

  • Banking
  • Fintech
  • Healthcare
  • Logistics
  • Clouds

Vertrauen Sie auf GULP

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das GULP Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.