Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.2Bright Data is a web data platform that enables large-scale scraping, searching, and structured data extraction without getting blocked. The Arcade toolkit exposes Bright Data's infrastructure for retrieving web content, search results, and platform-specific data feeds.
Capabilities
- Web scraping: Fetch any public webpage and receive clean Markdown output, suitable for LLM ingestion or content pipelines.
- Multi-engine search: Query Google, Bing, or Yandex with configurable parameters including result count, country code, and search type (web, images, etc.).
- Structured data feeds: Extract pre-structured JSON from 20+ named sources across e-commerce (Amazon), professional networks (LinkedIn, ZoomInfo), social media (Instagram, Facebook, X), real estate (Zillow), hospitality (Booking.com), and video (YouTube).
Secrets
This toolkit requires no OAuth flow but does require two secrets configured in Arcade.
BRIGHTDATA_API_KEY
Your Bright Data API key authenticates all requests to the Bright Data platform. Obtain it from the Bright Data control panel under Account Settings → API Token. Any Bright Data account tier provides access, but the operations available depend on which products (proxies, scraping browser, datasets) are active on your account.
BRIGHTDATA_ZONE
A Bright Data zone identifies the specific proxy or scraping zone to route requests through (e.g., a Web Unlocker zone or Scraping Browser zone). Create or find zone names in the Bright Data control panel under Proxies & Scraping Infrastructure → Zones. The zone must be active and compatible with the scraping method used by the toolkit.
For guidance on adding secrets to Arcade, see the Arcade secrets documentation. You can manage your configured secrets at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |