Crawl API

Automate content extraction from any domain. Simply define the root URL and retrieve the full website content as Markdown, Text, HTML, or JSON files.

クレジットカードは必要ありません
20,000+ 人以上のお客様に世界中で信頼されています

                              const options = {
  method: 'POST',
  headers: {Authorization: 'Bearer ', 'Content-Type': 'application/json'},
  body: '[{"url":"https://il.linkedin.com/company/bright-data"}]'
};

fetch('https://api.brightdata.com/datasets/v3/trigger', options)
  .then(response => response.json())
  .then(response => console.log(response))
  .catch(err => console.error(err));






                              
                            
                              import requests

url = "https://api.brightdata.com/datasets/v3/trigger"

payload = [{"url": "https://il.linkedin.com/company/bright-data"}]
headers = {
    "Authorization": "Bearer ",
    "Content-Type": "application/json"
}

response = requests.request("POST", url, json=payload, headers=headers)

print(response.text)
                              
                            

Easy to start, easier to scale

  1. Choose target domain
    Define target URL and connect to the API with a single line of code
  2. Send request
    Edit crawl parameters and insert your custom logic using Python or JavaScript
  3. Get your data
    Retrieve website data as Markdown, Text, HTML, or JSON files
Read documentation

Developer-first experience

Quick Start

Connect to the Crawl API with a single line of code, or use the control panel to get results directly through the Control Panel.

Custom Collection

Use request parameters to customize collection and delivery, including pagination, scheduling and log collection.

Data Parsing

Efficiently converts raw HTML into structured data files, delivered as Markdown, Text, HTML, or JSON, directly to your database.

Crawl API pricing

pay as you go plan icon
従量制プラン
$1.5 /1K RECORDS
月額固定契約なし
Start free trial

月額契約なしの従量課金制
25% OFF
2nd plan icon
ビジネス拡大プラン
$1.27
$0.95 /1K RECORDS
$499 Billed monthly
Start free trial
Use this coupon code: APIS25

業務を拡大したいチーム向けに調整
25% OFF
3rd plan icon
企業向け
$1.12
$0.84 /1K RECORDS
$999 Billed monthly
Start free trial
Use this coupon code: APIS25

幅広い運用ニーズのある大規模チーム向けに設計
25% OFF
4th plan icon
プレミアム
$1.05
$0.79 /1K RECORDS
$1999 Billed monthly
Start free trial
Use this coupon code: APIS25

重要な操作のための高度なサポートと機能
エンタープライズ
業界リーダー向け: トップティアのビジネス要件に対するエリートデータサービス.
お問い合わせ
  • アカウントマネージャー
  • カスタムパッケージ
  • プレミアムSLA
  • 優先サポート
  • カスタマイズされた オンボーディング
  • SSO
  • カスタマイズ
  • 監査ログ
Compliant proxies

Leading the way in ethical web data collection

Bright Data sets the gold standard in compliance, effectively self-regulating the industry. With transparent operations validated by top security firms, clear peer consent, and pioneering compliance units, we ensure legitimate and safe data collection. Upholding international privacy laws and utilizing tools like BrightBot, we minimize your legal exposure, making partnership with us a strategic move to curtail legal risks and associated costs.

Start free trial

Every 15 minutes, our customers scrape enough data to train ChatGPT from scratch.