@slates-integrations/scrapfly
v0.2.1
Published
Scrape web pages with anti-bot bypass, proxy rotation, and JavaScript rendering. Capture full-page or targeted screenshots, extract structured document data, and crawl websites with configurable depth and URL filtering. Monitor or cancel crawls, retrieve
Readme
Scrapfly
Scrape web pages with anti-bot bypass, proxy rotation, and JavaScript rendering. Capture full-page or targeted screenshots, extract structured document data, and crawl websites with configurable depth and URL filtering. Monitor or cancel crawls, retrieve paginated content, download WARC or HAR archives, and inspect account usage and subscription details.
Tools
scrape_webpage: Retrieve page content and optional structured extraction.capture_screenshot: Capture a screenshot and provide a downloadable image.extract_data: Extract structured data from document content.start_crawl: Start a recursive website crawl.get_crawl_status: Inspect crawl progress and completion state.get_crawl_results: List up to 50 URL records and retrieve paginated page content.cancel_crawl: Stop a crawl while preserving collected results.download_crawl_artifact: Download a finalized WARC or HAR archive.get_account_info: Inspect the account, project, usage, and subscription.
License
This integration is licensed under the FSL-1.1.
