Beta WebExtrator Extract API
POSThttps://api.worldai.chat/webextrator/extract

Extract structured content (title, body, images, product fields) from the given URL, with automatic page type detection.

Agent integrations

Request Headers

acceptstring
Specify the response format returned by the server.
Please select
authorizationstring
Bearer token

Request Body

urlstringRequired parameter
Need to extract the URL of the webpage content.
expected_typestring
Indicate the expected page type to optimize extraction results.
Please select
enable_llmboolean
Whether to enable optional LLM-based semantic normalization processing at the final stage of the extraction process.
Please select
wait_untilstring
Page load wait conditions, supporting load, domcontentloaded, networkidle, and commit, with load as the default.
Please select
timeoutinteger
Single navigation timeout, in positive integer seconds, default 30 seconds.
delayinteger
Additional waiting time after the page has finished loading, in non-negative integer seconds.
wait_for_selectorstring
Wait for the CSS selector to appear before starting the extraction.
block_resourcesarray
Resource types to be intercepted during page loading to speed up extraction.
headersobject
Additional HTTP request headers sent along with the page request.
user_agentstring
Override the default `User-Agent` request header.
asyncboolean
Whether to process in asynchronous mode. When set to `true`, the interface immediately returns `task_id`, without the need to provide `callback_url`, and then the result can be obtained by polling the corresponding task query interface; if `callback_url` is also provided, the result will be pushed to that callback address.
Please select
cookiesarray
List of Cookies to inject before navigation. Each item must include name, value, domain.
bypass_cacheboolean
Skip reading from the cache and fetch a new page; the result of this request can still be written to the cache.
Please select
callback_urlstring
If this parameter is provided, the request will be processed asynchronously, and the final result will be sent to this URL via a POST request.
cache_ttl_secondsinteger
The cache validity period for this result, in integer seconds. 0 indicates that this result is not cached; the default is 3600 seconds.

Response

Integration guide

Shell

Python

JavaScript

Java

Go

PHP

Kind reminder: For streaming requests, the above code may not be fully applicable. Please refer to the integration documentation for changes.

WebExtrator Web Render & Extract
Allow Use General Balance

When 'Allow General Balance' is enabled, the general balance is used automatically if an app's balance is insufficient.