Web scraping cars from any website

WP Intense Q & ACategory: Price Comparison ProWeb scraping cars from any website
support-1741 asked 6 months ago

Good morning,

I have a question, we are a website where car companies and private sellers can sell cars. But we want to automaticly scrape cars from any website and post it on ours. So we need the titles, images, some custom fields and the content.

Is that possible with your plug-in?

1 Answers
Dave Hilditch Staff answered 6 months ago

There is a search comparison shortcode in the plugin that let’s you show search results from multiple websites directly on your own site, each product with their own affiliate deep link.

This does not load the third-party content to your site, instead it’s searching the third-party websites as the users search.

You can see it in practice in this demo here where it searches amazon and ebay:

https://foundthru.com/search-comparison-dynamic-search/

If you want to scrape products into your store, that’s not yet possible in the plugin – it allows you to scrape prices and images to keep those parts updated. To populate, currently, you can use WP All Import if you can create an API against your scrape target using one of the third-party scraping sites.

I am planning to make use of the functionality from within the ‘search comparison’ widget to make it possible to import products to your store and to automatically figure out the correct deeplink URLs to attach to each product. Typically each product would have 5+ merchants where the item can be purchased, and I intend to make discovering and setting all those URLs as automatic as possible.

We use cookies

We use cookies for various things on our site, including our on-site chat bubble (if you use it), our comment forms (if you use them) and for session handling (if you log in).

Other than that, we use cookies to identify where traffic came from to help us understand which traffic turns into sales, we use a cookie for Google Analytics traffic analysis and we use a cookie to customise adverts for our own products we think you'll be interested in.

You can read more detail in our privacy policy page. Please click 'Accept' or 'Decline' to continue.