Scraping prices from walmart.com

phopinder p. asked 3 years ago

HiWe are having difficulty scraping prices from walmart.com. The xPath works in our spreadsheet (that uses the ImportFromWeb add-on for Chrome) but the same doesn;t seem to work in your plugin. We\'ve also not been able to get it using the CSS selector. Both types return a 444 error. We\'ve tried the following amongst other variations:xPath: //*[@id=”price”]/div/span[1]/span/span[2]CSS: #price > div > span.hide-content.display-inline-block-m > span > span.visuallyhiddenHere is an example of a URL that we would like to scrape the price from:https://www.walmart.com/ip/2004-W-4-Coin-Proof-American-Gold-Eagle-Coin-Set-w-Box-COA/839202624Note that the other sites we\'ve scraped have worked ok - it just seems to be Walmart that we are struggling with!Kind regardsMatt

1 Answers
Dave Hilditch Staff answered 3 years ago

For Walmart, the #price CSS selector works for me:

https://i.imgur.com/JqMBvCx.png

If this is not working for you, Walmart may be bot-blocking your site. If so, I recommend you check out the Scraping API linked in the plugin as they use multiple rotating proxies to avoid bot blocking.

Your Answer


Super Speedy Plugins
Logo