This scraping service allows you to scrape prices from any website, even websites using ajax to load their prices.
We have a Node.js installation running PhantomJS which simulates a user-browser, meaning you get whatever prices your users see.
How do you tell if a website is using Ajax to display its prices?
Here are the steps to take if you think a website may be using Ajax to display its prices:
- Load the page in your browser and locate the price you wish to scrape on screen, e.g. $1,250
- View the page source – use CTRL+U or CMD+U
- Search for the price – e.g. CTRL+F or CMD+F then 1,250 or 1250 (exclude currency as it may be in a different HTML cell)
- If you find the price, the page is NOT using ajax
- If you can’t find the price, and you searched for 1,250 and 1250 (or your price in your example) then the page is most likely using ajax
If the page is using Ajax, you should subscribe to this service to scrape prices from those pages.
After purchase, visit your /my-account/ page and locate your API key. Copy this API key and paste it into the API Key box at the bottom of the Price Comparison Pro settings page.
Make sure you also check the radio box to use PhantomJS – basic if you are not proxying, or advanced if you are proxying AND using phantomjs.
Now when you scrape, the scrapes will happen through our PhantomJS scraping service using a ‘headless browser’ which means you get prices even if th