Diseño de un marco de trabajo para la implementación de procesos ETL

Abstract

The design of this ETL framework is based on a detailed review of the last five years of academic literature, using institutional databases to identify the most common challenges in managing large volumes of information. This analysis aims to understand the limitations of traditional methods and propose a more efficient framework that meets current demands. As part of the development, simulated data stored in a .csv file will be processed in a test environment configured as a database. Through this environment, the stages of extraction, transformation, and loading will be carried out, aiming to optimize processing times and ensure flexibility in data handling. To achieve these objectives, modern tools like Python will be integrated, allowing for the automation of data analysis and processing. This framework is not only designed to enhance efficiency but also to provide practical solutions for companies managing large volumes of information by ensuring security, identifying key data, and generating actionable results for decision-making. In summary, this project aims to offer an innovative response to current challenges in data management, providing scalability and efficiency across various business contexts.