ScrapingBee is a Web Scraping API that handles proxies and Headless browser for you, so you can focus on extracting the data you want, and nothing else.
Allows you to scrape search results pages in real-time.
- Organic results
- Query - The text you would put in the Google search bar.
- Country Geolocation - The country from which you would like the request to come from.
- Displayed URL
- Visual URL
Allows you to extract content from a webpage using regex or XPath.
Add from Manager
The ScrapingBee Connector is available in the Connectors Manager in the top ribbon:
Head over to the Scraping Category and install AWR:
To use the Connector you need a ScrapingBee account. Copy your key and paste it in the Settings menu inside the ScrapingBee connector.
This connector suite is open-sourced on GitHub.