Aida NGOM

Mounting a Sass platform for collecting and processing data in streaming • Deploy an operating system with nikita, Upskill on infrastructure as code with terraform; • Descriptive analysis of file formats (CSV, JSON, AVRO, Parquet, ORC and Protocol buffer ) for a professional article; • Define a pipeline to download, isolate and pre-process simultaneous data in HDFS then Hive engine via bash/Shell and python; • Perform test and validation to find out the difference between file formats in Hive engine through different datasets and requests (SQL) types; • Carry out a Spark routine workflow from GitLab to GCP • Build up a metricbeat and filebeat components which retrieve log and metrics systems from an given environment and send them into kafka then spark