National Repository of Grey Literature 1 records found  Search took 0.01 seconds. 
Web page analyzer for scraping
Christozov, Valentín ; Macková, Kateřina (advisor) ; Petříček, Tomáš (referee)
Web scraping is a technique used for a variety of applications to extract data from the web. To create a scraper, a developer needs to perform an analysis of the scraped website using tools like web devtools or Postman. This analysis is necessary to locate the data and to determine an effective way to scrape the website. The structure of websites varies greatly and the process of analysis is tedious and time-consuming. The goal of this project is to create a tool, that a non-developer could use to get an insight into where the data is stored on the website and how it can be scraped. An analysis is performed on the input website. Results of the analysis are presented in a minimalist user interface. Output of the analysis can be used as a guide for no code web scraping tools configuration as well as a baseline for a web scraper development.

Interested in being notified about new results for this query?
Subscribe to the RSS feed.