Options
No options requiredArguments
string
required
The URL of the webpage to be queried and from which content should be extracted.Example:
Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
The Web Crawl connector enables the automatic crawling and extraction of content from a single URL. With this connector, you can process data from a website.
The address of the website (e.g. https://example.com/examplepage)
