For Price Comparison Pro, I would like to have a detailed view of which URLs it is trying to scrape but also what happens when it doesn’t scrape a URL or when the scrape process is stuck in an infinite loop.

The details of the scrape logging could also be provide in a .txt or .csv format as we could then be able to pinpoint any faulty URLs.

This allows us to further troubleshoot the scrape process and also provide best practices based on our findings.