• Hot
  • Top
  • New
1
votes

You have ... votes left in this category for this week!

Advanced logging feature of scraping process

Sebastiaan Bruinsma shared this feature

December 7, 2020

For Price Comparison Pro, I would like to have a detailed view of which URLs it is trying to scrape but also what happens when it doesn’t scrape a URL or when the scrape process is stuck in an infinite loop.

The details of the scrape logging could also be provide in a .txt or .csv format as we could then be able to pinpoint any faulty URLs.

This allows us to further troubleshoot the scrape process and also provide best practices based on our findings.

Leave a Reply

Your email address will not be published. Required fields are marked *

Subscribe!

We publish performance optimisation guides regularly.

Subscribe so you never miss out.

We use cookies

We use cookies for various things on our site, including our on-site chat bubble (if you use it), our comment forms (if you use them) and for session handling (if you log in).

Other than that, we use cookies to identify where traffic came from to help us understand which traffic turns into sales, we use a cookie for Google Analytics traffic analysis and we use a cookie to customise adverts for our own products we think you'll be interested in.

You can read more detail in our privacy policy page. Please click 'Accept' or 'Decline' to continue.