Price Comparison Pro – Price Scraping Issue

WP Intense Q & ACategory: Price Comparison ProPrice Comparison Pro – Price Scraping Issue
Annie Amusu asked 6 months ago

Hello,

I'm having some issues scraping ecommerce stores for my websites - especially wordpress/woocommerce stores.

At the moment, I find that either:-

  • The site doesn't get scraped at all
  • The site gets scrapped sometimes but not every time (i.e. Amazon)
  • The site gets scrapped but the price is wrong (in some cases I can't even find the price that the plugin scrapped on the page)

Would it be easier to request a quote to scrape my requested websites? or take out the web scraping service - As I've watched a few screencasts and supprot answers, and I am still having an issue.

I would really appreicate it if you could come back to me

1 Answers
Dave Hilditch Staff answered 5 months ago

If you can edit your question and provide some URLs that you’re struggling to scrape I’ll provide you the CSS or xPath to scrape what you need.

Note: If a website is failing to scrape, you can click the ‘recheck price’ button and then use the JavaScript console to see the debug output.

If the wrong price is being scraped, then your selector is wrong – you should use the SelectorGadget chrome extension to ensure your CSS only matches one price on the page.

If it’s not scraping at all, it may be your server got blocked – it depends on how many scrapes you are trying to perform. In these cases, our proxy solution or the Scraper API solution will get around this.

Black Friday!

This is the only time of year when we have our biggest discount ever!

Use coupon code BF2020 for a massive 50% discount.

Get 50% off any plugins or plugin packs! Use coupon BF2020. First 100 only.

We use cookies

We use cookies for various things on our site, including our on-site chat bubble (if you use it), our comment forms (if you use them) and for session handling (if you log in).

Other than that, we use cookies to identify where traffic came from to help us understand which traffic turns into sales, we use a cookie for Google Analytics traffic analysis and we use a cookie to customise adverts for our own products we think you'll be interested in.

You can read more detail in our privacy policy page. Please click 'Accept' or 'Decline' to continue.