Fetch API

Turn any public URL into Markdown, plain text, raw HTML and JSON-LD with one API call. Bright Data handles proxies, CAPTCHAs and blocking, so you get page content ready for your LLM or parser.

5K free records/month · Credit card not required
How it works

From URL to clean data in 3 steps

No proxies to configure, no infrastructure to manage. Connect, send a URL, and read the page.
  1. Pass your URLs

    Provide the public URLs you want to fetch.

  2. Call the API

    One API call with up to 5,000 target URLs. Python and Node.js SDKs, CLI, MCP server, or any HTTP client.

  3. Get the page back

    Receive the page as clean Markdown, raw HTML, or JSON, with blocks, CAPTCHAs, and retries handled for you.

Pricing

Fetch API Pricing

Only pay for what’s successfully delivered. No hidden fees, no charges for failed deliveries.

CALCULATE YOUR COST
Records per month: 5K
$/mo
$ per 1,000 records
Your whole bill. Proxies, unblocking, parsing included.
始めましょう
5K
10K
50K
100K
500K
1M
5M
  • 成功した場合のみ課金、隠れた費用なし
  • 毎月5,000クレジットで無料開始
  • 初期費用なし、いつでも解約可能
  • 24時間年中無休の専門サポートとエンタープライズ機能
無料トライアル
5K
records
Start free
  • 月あたり5K記録
  • クレジットカード不要
  • 専門サポート
従量課金プラン
$1.5/1Kレコード
Start free
  • 成功報酬のみ支払い
  • 月間支出制限を設定
  • 無制限の同時実行
  • 専門サポート
スケール
$499 /月
Start free
  • 含まれるレコード:384,000
  • $1.3/1K additional records
  • 無制限の同時実行
  • いつでもキャンセル可能
  • 専門サポート
エンタープライズ
カスタム
営業に相談
  • ボリューム割引
  • アカウントマネージャー
  • プレミアムSLA
  • 優先サポート
  • SSO
Compute / runtime units
commonly billed per scraper runtime hour or compute unit
含まれる
Residential proxy bandwidth
commonly billed per GB
含まれる
Storage & dataset retention
commonly billed per GB-month
含まれる
Data transfer / egress
commonly billed per GB out
含まれる
Unblocking & CAPTCHA solving
commonly a paid add-on
含まれる
Parsing to structured JSON
commonly your own code
含まれる
これらの支払い方法を受け付けています:
スクレーパーAPI呼び出し
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://example.com"},{"url":"https://example.com/1"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_m6gjtfmeh43we6cqc&format=json&uncompressed_webhook=true"
レスポンスペイロード
[
  {
    "timestamp": "2025-02-24",
    "markdown": null,
    "url": "https:\/\/www.mindat.org\/loc-419686.html",
    "final_url": null,
    "html2text": null,
    "page_html": "\u003C!DOCTYPE html\u003E\n\u003Chtml\u003E\u003Chead\u003E\n  \u003CMETA HTTP-EQUIV=\u0022Content-Type\u0022 CONTENT=\u0022text\/html; charset=UTF-8\u0022\u003E\n  \u003Clink rel=\u0022appl...",
    "ld_json": null,
    "page_title": null
  },
  {
    "timestamp": "2025-04-20",
    "markdown": null,
    "url": "https:\/\/www.thesoullux.com\/",
    "final_url": null,
    "html2text": null,
    "page_html": "\u003C!doctype html\u003E\r\n\u003Chtml lang=\u0022en-US\u0022\u003E\r\n\u003Chead\u003E\r\n  \u003Cmeta charset=\u0022UTF-8\u0022\u003E\r\n  \u003Cmeta name=\u0022viewport\u0022 content=\u0022width=devic...",
    "ld_json": null,
    "page_title": null
  },
  {
    "timestamp": "2025-02-24",
    "markdown": null,
    "url": "https:\/\/www.mindat.org\/loc-416126.html",
    "final_url": null,
    "html2text": null,
    "page_html": "\u003C!DOCTYPE html\u003E\n\u003Chtml\u003E\u003Chead\u003E\n  \u003CMETA HTTP-EQUIV=\u0022Content-Type\u0022 CONTENT=\u0022text\/html; charset=UTF-8\u0022\u003E\n  \u003Clink rel=\u0022appl...",
    "ld_json": null,
    "page_title": null
  },
  {
    "timestamp": "2025-03-31",
    "markdown": "[Skip to content](#theme-main) \n\n[ ![](https:\/\/www.senuto.com\/wp-content\/themes\/picostrap5\/assets\/img\/senuto-logo-black....",
    "url": "https:\/\/www.senuto.com\/pl\/blog\/promocja-sklepu-internetowego\/",
    "final_url": null,
    "html2text": null,
    "page_html": null,
    "ld_json": null,
    "page_title": null
  },
  {
    "timestamp": "2025-04-16",
    "markdown": null,
    "url": "https:\/\/www.indiamart.com\/panchal-healthcare\/",
    "final_url": null,
    "html2text": null,
    "page_html": "\u003C!DOCTYPE HTML\u003E\r\n\u003Chtml lang=\u0022en\u0022 id=\u0022html_job\u0022\u003E\r\n\u003Chead\u003E\r\n\u003Clink rel=\u0022dns-prefetch\u0022 href=\u0022https:\/\/utils.imimg.com\/\u0022\u003E\r\n\u003Clin...",
    "ld_json": null,
    "page_title": null
  }
]
Start free

Web Scraper API Library

Fetching the same sites again and again? There's probably a scraper for that already. Pick one and get parsed JSON, with output fields, delivery volume, and live success rate listed up front.

Explore thousands of production-ready scrapers

Pay only for successful results, no surprises – Proxies, unlocking, browsers and retries are built in.

TERMINAL

Tell your agent:

Read https://brightdata.com/SKILL.md and use Fetch to read this Nike Vomero Plus product page as Markdown: https://www.nike.com/t/vomero-plus-mens-road-running-shoes-5npsVBwT/IM8336-100

Or run it yourself:

npx -p @brightdata/cli bdata scrape "https://www.nike.com/t/vomero-plus-mens-road-running-shoes-5npsVBwT/IM8336-100" -f markdown

Or connect over MCP:

https://mcp.brightdata.com/mcp?token=YOUR_API_KEY
Get your token-filled URL in the control panel
For coding Agents

Give your agent the whole web with Fetch API

Your agent passes any URL to Fetch API and gets the page back clean, ready to read. Bright Data handles blocks, CAPTCHAs and retries, so every call returns real-time web data instead of an error page. Works in Claude Code, Codex, Cursor and any other coding agent.

  • Runs with npx, nothing to install
  • bdata login opens browser auth, no key to paste
  • Name a scraper, get JSON back
  • Delivers to AWS · GCP · Azure · Snowflake · Webhook
compliance

Leading the way in ethical web data collection

Only publicly available data. ISO 27001 certified, SOC 2 controls, GDPR & CCPA compliant. Every use case is reviewed by a dedicated Compliance & Ethics team, backed by a documented Know Your Customer process and Acceptable Use Policy.



World's #1 scraping platform

Everything you need, built in

You pay for results. Proxies, rendering, concurrency, and delivery are always included, on every plan.

Go straight to the source

Every request runs on Bright Data infrastructure. 400M+ IPs, unlocking and browsers are built in.

Scale to millions of pages instantly

Send unlimited concurrent requests - no infrastructure to manage, no configs to change.

Scrapers auto-fix when sites change

AI-powered self-healing detects site changes and repairs scrapers. Your pipelines keep running.

Thousands of verified scrapers

Every scraper is built, tested, and maintained by Bright Data. No community guesswork.

Pay per result, nothing extra

One price per record . Proxies, retries, rendering, unblocking - all included, no surprises.

Compliant and fully supported

GDPR & CCPA compliant. 24/7 human support on every plan, including free.
Compare Bright Data to others

Fetch API vs other providers

機能
他のスクレーピングプロバイダー
自動スケーリングインフラ
無制限
部分的
ボット対策&CAPTCHA回避
内蔵
部分的
レジデンシャルプロキシネットワーク
4億以上のIP
限定プール
事前構築されたスクレーパー
1400以上
50~200
自動メンテナンス(サイトの変更対応)
24時間365日
作成者次第
価格モデル
レコードごとの一括価格
計算、プロキシ、ストレージは別々に計測される
失敗したリクエスト
無料、成功時のみ課金
頻繁に請求される
カスタムサイト(事前に作成されたスクレーパーなし)
AIが数分で構築し、自己修復も含む
コミュニティ作成のスクレーパー、SLAなし
コンプライアンス(GDPR、CCPA、SOC 2)
完全版
部分的
構造化出力(JSON/CSV)
自動
サポート
無料プランでも24/7の専門家サポート
コミュニティフォーラム
無料プラン
月間5,000件の記録
変動する
Bright Data is used by world's top brands

Fetch API FAQ

Fetch API (formerly Crawl API) turns any public URL into Markdown, plain text, raw HTML and JSON-LD in a single record. Bright Data handles proxies, CAPTCHAs and blocking, and returns page content ready for an LLM or a parser.

Both unblock public web pages. They differ in how you call them and what you get back:

  • Web Unlocker API is called at /request with a Web Unlocker zone and returns the target page's raw response.
  • Fetch API is called at /datasets/v3/scrape or /datasets/v3/trigger with a dataset ID and needs no zone. Each URL comes back as one record with Markdown, plain text, raw HTML and JSON-LD together, and it works with Scraper API batch jobs and delivery options.

Each record includes markdown (headings, lists and links kept), html2text (visible text only), page_html (the full HTML source) and ld_json (schema.org metadata, when the page has any), plus url, final_url, page_title and country. Results can be downloaded as JSON, NDJSON, JSON lines, CSV or Parquet.

We recommend single URL request use synchronous request. For larger volumes, use the async /trigger endpoint, which accepts unlimited URLs (up to 1 GB of input per job).

Yes. Every request fetches the live page, with no cached copy. A synchronous request waits up to 1 minute. If the fetch takes longer, it returns a snapshot_id and finishes in the background.

Yes. Add a two-letter country code in uppercase, for example US or DE, to any input URL, and the page is fetched from that country.

Any public URL on any domain. Fetch API returns page content, not site-specific fields such as prices or follower counts. For those fields, use one of our pre-built scrapers.

No. Fetch API returns page content from a URL. If you need to control a browser with Puppeteer, Playwright or similar tools, check out our Browser API.

You pay only for successful records. New accounts get 5,000 free credits every month, with no credit card required.

Yes. Proxies, CAPTCHAs and blocking are handled automatically on every request, with no configuration needed on your side.