Kubernetes

Description

In today’s complex, distributed systems, effective monitoring is essential for understanding system behavior, identifying performance bottlenecks, and troubleshooting issues. This thesis aims to design, implement, and evaluate a robust metrics, logs, and traces ingestion pipeline within a Kubernetes environment, leveraging popular open-source tools.

Le moderne architetture distribuite, caratterizzate da decentralizzazione e dalla suddivisione in microservizi, pongono sfide rilevanti nella valutazione del comportamento del sistema.

Data la complessità introdotta da tali architetture, vengono richiesti sistemi di monitoraggio avanzati in grado di verificare Proprietà Non-Funzionali per valutare il comportamento dell’infrastruttura. Le soluzioni attuali, sebbene efficaci nella valutazione di performance, risultano limitate quando si tratta di fornire una valutazione olistica e continua di tali sistemi, basata sulla verifica di proprietà non funzionali tramite contratti formali e specifici. 'E sorta quindi la necessità di sistemi di monitoraggio sempre più sofisticati, che possano raccogliere informazioni su molteplici aspetti del sistema in modo da garantire il soddisfacimento di specifiche proprietà.

Distributed systems have become one of the pillars of modern computing, creating the backbone for technologies like cloud computing and the Internet of Things, while supporting many of the services that run on the Internet. However, with the use of this type of systems a unique set of challenges arises, particularly about ensuring properties such as their scalability, performances, reliability, and the detection of issues that could lead to system failures. Effective monitoring of such systems in complex environments is essential to maintain these properties.

In the constantly evolving landscape of continuously integrated cloud-native applications, the process of security assurance has a consistently increasing importance. In order to ensure that systems are secure and behave as expected, the assurance process has to be included in the whole software lifecycle, from development to operations.

The idea behind this thesis originates from the perceived need in various sectors of the Italian economy to establish a data platform that can manage, organize, and connect different company information assets, making them available to internal or external expertise through contracts. The requirement is for a ``single point of truth’’ capable of connecting Proof of Concepts (PoCs) developed over the years, including pre-existing on-premise source systems and cloud production architectures, into a single, comprehensive, and expandable structure. Given this ambitious goal, it was decided to build an architecture that could demonstrate feasibility by first analyzing the available technological stack, stack synergy, and strategically selecting components to maintain a structure that is both streamlined and comprehensive.