Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.2Bright Data is a web data platform that provides tools for scraping, searching, and extracting structured data from any website at scale without IP blocks. This toolkit enables Arcade agents to access web content, run search engine queries, and pull structured records from major platforms.
Capabilities
- Web scraping: Fetch any public webpage and receive clean Markdown output, suitable for downstream parsing or LLM consumption.
- Multi-engine search: Query Google, Bing, or Yandex with configurable parameters including result count, search type (web/images), and country targeting.
- Structured data extraction: Pull normalized JSON records from 20+ source types across Amazon, LinkedIn, Instagram, Facebook, X, YouTube, Zillow, Booking.com, and ZoomInfo — no custom scraping logic required.
Secrets
This toolkit requires no OAuth flow. Authentication is handled entirely via secrets passed at call time.
-
BRIGHTDATA_API_KEY— Your Bright Data account API key, used to authenticate all requests. Obtain it from the Bright Data dashboard under Account Settings → API Token. A paid Bright Data account is required; free trials may have restricted access. -
BRIGHTDATA_ZONE— The name of a Bright Data proxy zone (also called a "scraping browser" or "residential proxy" zone depending on your plan). Zones are created and managed in the Bright Data control panel. The zone must be active and configured for the type of traffic you intend to route (e.g., residential, datacenter, or scraping browser). Use the exact zone name string shown in the dashboard.
For guidance on storing secrets in Arcade, see the Arcade secrets documentation. You can also manage secrets directly at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |