Web Crawler
Crawl websites and extract public data from the most popular websites. With over 1500 crawlers, collecting web data has never been easier.
1846 スクレイパー
- Retrieve real-time data via API
- Pay only for successfully delivered results
- Bulk request handling, up to 5K URLs
- Retrieve results in multiple formats
世界中の50,000+人のお客様から信頼されています。
Web Crawler API
Web Crawler API Library
Remove the need to develop and maintain the infrastructure. Simply extract high volume web data, and ensure scalability and reliability using our Web Scraper API.
Web Crawler Pricing
Only pay for what’s successfully delivered. No hidden fees, no charges for failed deliveries.
これらの支払い方法を受け付けています:
すべてのプランで完全アクセス可能 - スケールに応じて1レコードあたりのコストを削減
データ収集
- 自動プロキシ管理
- 完全なブラウザレンダリング
- CAPTCHA解決
大規模なパフォーマンス
- 無制限の同時実行性
- バッチ&スケジュール収集
- ジョブ管理API
データ配信
- データ検証&発見
- データ解析(JSONまたはCSV)
- WebhookまたはAPI配信
CODE EXAMPLES
Dedicated endpoints for 800+ domains.
入力
JSON
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.linkedin.com/in/elad-moshe-05a90413/"},{"url":"https://www.linkedin.com/in/jonathan-myrvik-3baa01109"},{"url":"https://www.linkedin.com/in/aviv-tal-75b81/"},{"url":"https://www.linkedin.com/in/bulentakar/"},{"url":"https://www.linkedin.com/in/nnikolaev/"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_l1viktl72bvl7bjuj0&format=json&uncompressed_webhook=true"
出力
JSON
[
{
"timestamp": "2026-10-08",
"id": "ped***alc***-ab*********",
"name": "Pedro A****o",
"city": "Belém, Pará, Brazil",
"country_code": "BR",
"position": null,
"about": null,
"posts": null
},
{
"timestamp": "2026-10-08",
"id": "pau***ee-***",
"name": "Paul ***",
"city": "New York, New York, United States",
"country_code": "US",
"position": null,
"about": "Int***sts***uil*********lyt*********************one******************************************",
"posts": null
},
{
"timestamp": "2026-10-08",
"id": "cha***a-s***har*********",
"name": "Chandra S*****r",
"city": "New Delhi, Delhi, India",
"country_code": "IN",
"position": null,
"about": null,
"posts": null
},
{
"timestamp": "2026-10-08",
"id": "ayi***i-g***iel*********3",
"name": "Ayideji G*****l",
"city": "Nigeria",
"country_code": "NG",
"position": null,
"about": null,
"posts": null
},
{
"timestamp": "2026-10-08",
"id": "zak***a-m***ouh*********3",
"name": "Zakaria M*****h",
"city": "Casablanca, Casablanca-Settat, Morocco",
"country_code": "MA",
"position": null,
"about": null,
"posts": null
}
]
入力
JSON
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.amazon.com/Quencher-FlowState-Stainless-Insulated-Smoothie/dp/B0CRMZHDG8","asin":"B0CRMZHDG8","origin_url":"https://www.amazon.com/Quencher-FlowState-Stainless-Insulated-Smoothie/dp/B0CRMZHDG8","zipcode":"94107","language":""},{"url":"https://www.amazon.com/KitchenAid-Protective-Dishwasher-Stainless-8-72-Inch/dp/B07PZF3QS3","asin":"B07PZF3QS3","zipcode":"","language":""},{"url":"https://www.amazon.com/TruSkin-Naturals-Vitamin-Topical-Hyaluronic/dp/B01M4MCUAF","asin":"","origin_url":"https://www.amazon.com/TruSkin-Naturals-Vitamin-Topical-Hyaluronic/dp/B01M4MCUAF","zipcode":"94124","language":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_l7q7dkf244hwjntr0&format=json&uncompressed_webhook=true"
出力
JSON
[
{
"timestamp": "2026-10-08",
"title": "Sennelier Abstract Acrylic Satin, Cadmium Yellow Medium Hue, 120ml",
"seller_name": "Amazon **",
"brand": "Sennelier",
"description": "Dive into the vibrant world of colour with the Sennelier Abstract Acrylic Paint, Satin Cadmium Yellow Medium Hue. This 1...",
"initial_price": 12,
"currency": "AUD",
"availability": "Only 2 left in stock (more on the way)."
},
{
"timestamp": "2026-10-08",
"title": "Sennelier Abstract Acrylic Satin, Burnt Sienna, 120ml",
"seller_name": "Amazon **",
"brand": "Sennelier",
"description": "Experience the joy of painting with the Sennelier Abstract Acrylic Paint in Satin Burnt Sienna. This 120 ml tube of Qual...",
"initial_price": 12,
"currency": "AUD",
"availability": "Only 3 left in stock (more on the way)."
},
{
"timestamp": "2026-10-08",
"title": "Sennelier Large Oil Pastel, Transparent Blue",
"seller_name": "Amazon **",
"brand": "Sennelier",
"description": "Bring your artwork to life with Sennelier Oil Pastels in Transparent Blue, designed to deliver rich colour and a smooth,...",
"initial_price": 28.18,
"currency": "AUD",
"availability": "Temporarily out of stock. Order now and we\u0027ll deliver when available. We\u0027ll e-mail you with an estimated delivery date a..."
},
{
"timestamp": "2026-10-08",
"title": "Speedball Water-Based Printing Ink Yellow, 37ml, Produces Bold, Vibrant Colours, Can Be Printed Over Acrylic Paint - Ide...",
"seller_name": "Amazon **",
"brand": "Speedball",
"description": "Experience the thrill of creating stunning prints with the Speedball Water Based Block Printing Ink. This Speedball ink ...",
"initial_price": 18.39,
"currency": "AUD",
"availability": "Usually dispatched within 1 to 2 months"
},
{
"timestamp": "2026-10-08",
"title": "Sennelier Oil Paint, 40ml, Series S1, Cassel Earth",
"seller_name": "Amazon **",
"brand": "Sennelier",
"description": "Bring depth and expression to your artwork with Sennelier Oil Paint in Cassel Earth. Designed for artists who want colou...",
"initial_price": 26,
"currency": "AUD",
"availability": "Usually dispatched within 1 to 2 months"
}
]
入力
JSON
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.zillow.com/homedetails/2506-Gordon-Cir-South-Bend-IN-46635/77050198_zpid/?t=for_sale"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lfqkr8wm13ixtbd8f5&format=json&uncompressed_webhook=true"
出力
JSON
[
{
"timestamp": "2026-10-08",
"zpid": 84745759,
"city": "Rosenberg",
"state": "TX",
"homeStatus": "OTHER",
"address:city": "Rosenberg",
"address:streetAddress": "3138 Fern Brook Ln",
"address:zipcode": "77471"
},
{
"timestamp": "2026-10-08",
"zpid": 103146147,
"city": "Pt Charlotte",
"state": "FL",
"homeStatus": "FOR_SALE",
"address:city": "Pt Charlotte",
"address:streetAddress": "183 Presque Isle Dr",
"address:zipcode": "33954"
},
{
"timestamp": "2026-10-08",
"zpid": 83300660,
"city": "Tuscaloosa",
"state": "AL",
"homeStatus": "OTHER",
"address:city": "Tuscaloosa",
"address:streetAddress": "24 Ridgeland",
"address:zipcode": "35406"
},
{
"timestamp": "2026-10-08",
"zpid": 2058674280,
"city": "Margate City",
"state": "NJ",
"homeStatus": "OTHER",
"address:city": "Margate City",
"address:streetAddress": "109 S Newport Elevator",
"address:zipcode": "08402"
},
{
"timestamp": "2026-10-08",
"zpid": 458925398,
"city": "Troutman",
"state": "NC",
"homeStatus": "SOLD",
"address:city": "Troutman",
"address:streetAddress": "186 Hudson Point Dr",
"address:zipcode": "28166"
}
]
入力
JSON
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.instagram.com/p/Cuf4s0MNqNr","country":""},{"url":"https://www.instagram.com/p/DP861NijuwE","country":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lk5ns7kz21pck8jpis&format=json&uncompressed_webhook=true"
出力
JSON
[
{
"timestamp": "2026-10-07",
"url": "https:\/\/www.instagram.com\/p\/DSYCKFSAWDO\/",
"user_posted": "planetbeer1",
"description": "Beer Cap Wisdom! 😏 #WednesdayWisdom",
"hashtags": [
"#WednesdayWisdom"
],
"num_comments": 0,
"date_posted": "2025-12-17T19:00:26.000Z",
"likes": 24
},
{
"timestamp": "2026-10-07",
"url": "https:\/\/www.instagram.com\/p\/DSsGci4jzdy\/",
"user_posted": "planetbeer1",
"description": "MERRY XMAS!!!! 🎄🍺🫵🎅 #Christmas #Beer",
"hashtags": [
"#Christmas",
"#Beer"
],
"num_comments": 1,
"date_posted": "2025-12-25T14:02:42.000Z",
"likes": 27
},
{
"timestamp": "2026-10-07",
"url": "https:\/\/www.instagram.com\/p\/DSQoaOciPW6\/",
"user_posted": "planetbeer1",
"description": "Happy Hanukkah! 🕎🍻 #Hanukkah",
"hashtags": [
"#Hanukkah"
],
"num_comments": 0,
"date_posted": "2025-12-14T22:00:46.000Z",
"likes": 126
},
{
"timestamp": "2026-10-07",
"url": "https:\/\/www.instagram.com\/p\/DSs2OjbiHpe\/",
"user_posted": "planetbeer1",
"description": "Beer Of The Day! 🎄........ Schlafly Christmas Ale #Christmas",
"hashtags": [
"#Christmas"
],
"num_comments": 1,
"date_posted": "2025-12-25T21:00:14.000Z",
"likes": 24
},
{
"timestamp": "2026-10-07",
"url": "https:\/\/www.instagram.com\/p\/DSat5lfDNZU\/",
"user_posted": "planetbeer1",
"description": "Some day! 🍺❤️😒 #Beer #Love",
"hashtags": [
"#Beer",
"#Love"
],
"num_comments": 0,
"date_posted": "2025-12-18T20:01:07.000Z",
"likes": 28
}
]
最高峰の DX
簡単に開始可能。容易にスケーリング可能。
比類のない安定性
世界をリードするプロキシインフラストラクチャを利用することで、一貫したパフォーマンスを確保し、障害を最小限に抑えることができます。
Web スクレイピングをシンプルに
本番環境に対応した API でスクレイピングを自動化することで、リソースを節約し、メンテナンスの手間を減らせます。
無限のスケーラビリティ
最適なパフォーマンスを維持しつつ、データ需要に合わせてスクレイピングプロジェクトを簡単にスケーリングできます。
仕組み
プロキシとCAPTCHAの心配はもう不要
- 自動IP ローテーション
- CAPTCHAソルバー
- ユーザーエージェントのローテーション
- カスタムヘッダー
- JavaScriptレンダリング
- レジデンシャルプロキシ
シームレスなWeb CrawlerデータアクセスのためのAPI
包括的でスケーラブル、かつ準拠したウェブデータ抽出
シームレスなWeb CrawlerデータアクセスのためのAPI
包括的でスケーラブル、かつ準拠したウェブデータ抽出
ワークフローに合わせたカスタマイズ
WebhookまたはAPI配信を通じて、JSON、NDJSON、またはCSVファイルで構造化データを取得。
組み込みのインフラとブロック解除
プロキシとブロック解除インフラを維持することなく、最大限のコントロールと柔軟性を実現。CAPTCHAやブロックを回避しながら、あらゆる地域からデータを簡単にスクレイピング。
実績あるインフラ
Bright Dataのプラットフォームは世界中の20,000社以上を支え、99.99%の稼働率と195カ国をカバーする1億5,000万以上の実ユーザーIPへのアクセスで安心を提供。
業界をリードするコンプライアンス
当社のプライバシー慣行は、EUデータ保護規制フレームワーク、GDPR、CCPAを含むデータ保護法に準拠しています。
シームレスなWeb CrawlerデータアクセスのためのAPI
包括的でスケーラブル、かつ準拠したウェブデータ抽出
フレキシブル
ワークフローに合わせたカスタマイズ
WebhookまたはAPI配信を通じて、JSON、NDJSON、またはCSVファイルで構造化データを取得。スケーラブル
組み込みのインフラとブロック解除
プロキシとブロック解除インフラを維持することなく、最大限のコントロールと柔軟性を実現。CAPTCHAやブロックを回避しながら、あらゆる地域からデータを簡単にスクレイピング。安定
実績あるインフラ
Bright Dataのプラットフォームは世界中の20,000社以上を支え、99.99%の稼働率と195カ国をカバーする1億5,000万以上の実ユーザーIPへのアクセスで安心を提供。準拠
業界をリードするコンプライアンス
当社のプライバシー慣行は、EUデータ保護規制フレームワーク、GDPR、CCPAを含むデータ保護法に準拠しています。Bright Dataは世界トップブランドに利用されています