In this project, a system was created to visualize and analyze data collected on websites. Two ways were configured to collect data from the internet:

• API: Collecting data from websites that provides an Application Programming Interface to access the information.

• Web-Scrapping: When the website does not offer an API service, it is possible to create a process to extract content and data from a website.

Projects that use this configuration:

• Solar data collection: Project to obtain data from the solar energy management system, predict production and identify problems.

• Image collection: Project to collect images from open databases.

• Environmental data: Data collection project from meteorological websites.

Software and technologies used:

• Ubuntu: Operational system.

• Docker: Containerize applications.

• Django: Web system.

• Python: Scripts to collect and analyze data.