WebScraping.AI

WebScraping.ai provides a web scraping API service. You can add proxy parameters to route your scraping requests through your proxy IP. Follow the steps below to complete the proxy setup.

Before configuring the proxy, you need to obtain proxies credentials. Click here to learn how to obtain proxies credentials.

---

1

Obtain WebScraping.ai API Key

1. Visit the WebScraping.ai official website to register or log in to your account.

2. Find your API key in the control panel.

2

Build an API Request with Proxies

The WebScraping.ai API supports specifying a proxy via the custom_proxy parameter. The request format is as follows:

curl "https://api.webscraping.ai/html?url=https://target-website.com&api_key=YOUR_API_KEY&custom_proxy=protocol://username:password@host:port"

Parameter Description

• url: The address of the target website to scrape.

• api_key: The API key you obtained in Step 1.

• custom_proxy: Your proxy information, formatted as protocol://username:password@host:port

3

Verify the Proxy

Enter your real credentials into the command constructed in step 2. After executing the command, WebScraping.ai will return the crawled page content. Since the target URL is ipinfo.io/json, the returned JSON data should contain IP information.

---