Pavel Vasilev

* Project: Data project supporting the company’s core business operations * Brief project description: Protected by NDA * Your responsibilities: development, analysis and production support for data processing * Technologies you used: Scala, Python, Spark, Airflow, AWS (EMR, S3, Databricks platform, Lambda, EKS), Kafka, Neo4j, DBT, Jenkins, Github actions, DataDog, Prometheus, Grafana, Hashikorp Vault, Airbyte, GitHub copilot

* Project: Corporate data platform * Brief project description: ML models based on HDFS/Hive data * Your responsibilities: data processing with spark & airflow, data quality monitoring with Victoria Metrics / Promscale & Grafana * Technologies you used: Scala, Spark, Airflow, Python, Gitlab, Sbt, Victoria Metrics, Grafana, Promscale

* Project: Protected by NDA * Brief project description: Protected by NDA * Your responsibilities: data processing with spark & oozie, development of ETL procedures with NiFi, Sqoop and internal company software, ci/cd, mentoring and support for trainees * Technologies you used: Scala, Java, NiFi, Spark, Oozie, Git, Maven, Jenkins

• Project: Corporate data platform • Brief project description: Protected by NDA • Your responsibilities: development of integration pipelines, core elements, ci/cd code • Technologies you used: Java, Scala, Groovy, Python, NiFi, Spark, Kafka, Git, Maven, Jenkins

• Project: ML models, data marts, standalone web app, internal coaching programme • Brief project description: Protected by NDA • Your responsibilities: Scala development in the Big Data area (machine learning models, internal apps), data processing, full-stack web development, coaching. I developed 2 prototypes of ML models from scratch on my own, participated in development of several other ones as a data engineer. When needed I was performing situational trainings for colleagues like "How to use Git without pain", "Introducing to X", "Regular Expressions". The last one was added to the internal coaching programme of the company and became popular. At the moment more than 200 people have visited that training and rated it as 4.6 out of 5. After years of working with data, I switched to a web app project in the role of team lead • Technologies you used: Scala, Hadoop, Spark, Hive, Mllib, Akka, ScalaJs, React, Git, Sbt, AWS

• Project: Advertisement based on social networks • Brief project description: Building advertisement segments based on open data from facebook and vk • Your responsibilities: Collecting, analysis and enrichment of a data from social networks using Hadoop, Spark, ElasticSearch. I implemented statistics subsystem (which controls size and quality of our data), wrote a lot of Hadoop jobs and bash scripts which moves / transform our data or synchronizes it with our partners, promoted Apache Spark usage in a company (that makes development faster and cheaper). • Technologies you used: Scala, AWS, ElasticSearch, Hadoop, Spark, Java, NSQ, PostgeSQL, Git, Sbt

• Project: development of backends with almost pure Java. • Brief project description: online game server, business CRM, internet shop • Your responsibilities: backend development • Technologies you used: Java, Spring, MySQL, PostgreSQL, Maven, Hadoop (MapReduce), Hbase, SVN, Mercurial