Web Crawler
Crawl websites and extract public data from the most popular websites. With over 1500 crawlers, collecting web data has never been easier.
1714 スクレイパー
- Retrieve real-time data via API
- Pay only for successfully delivered results
- Bulk request handling, up to 5K URLs
- Retrieve results in multiple formats
世界中の50,000+人のお客様から信頼されています。
Web Crawler API
Web Crawler API Library
Remove the need to develop and maintain the infrastructure. Simply extract high volume web data, and ensure scalability and reliability using our Web Scraper API.
Web Crawler Pricing
Only pay for what’s successfully delivered. No hidden fees, no charges for failed deliveries.
これらの支払い方法を受け付けています:
すべてのプランで完全アクセス可能 - スケールに応じて1レコードあたりのコストを削減
データ収集
- 自動プロキシ管理
- 完全なブラウザレンダリング
- CAPTCHA解決
大規模なパフォーマンス
- 無制限の同時実行性
- バッチ&スケジュール収集
- ジョブ管理API
データ配信
- データ検証&発見
- データ解析(JSONまたはCSV)
- WebhookまたはAPI配信
CODE EXAMPLES
Dedicated endpoints for 800+ domains.
入力
JSON
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.linkedin.com/in/elad-moshe-05a90413/"},{"url":"https://www.linkedin.com/in/jonathan-myrvik-3baa01109"},{"url":"https://www.linkedin.com/in/aviv-tal-75b81/"},{"url":"https://www.linkedin.com/in/bulentakar/"},{"url":"https://www.linkedin.com/in/nnikolaev/"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_l1viktl72bvl7bjuj0&format=json&uncompressed_webhook=true"
出力
JSON
[
{
"db_source": "1789608697830",
"timestamp": "2026-09-17",
"id": "lil***-ot***o-1*********",
"name": "Lilian O****o",
"city": "Kenya",
"country_code": "KE",
"position": "Marketting Executive at Standard Chartered Bank",
"about": null
},
{
"db_source": "1789608697830",
"timestamp": "2026-09-17",
"id": "die***ham***0ba******",
"name": "Diep P**m",
"city": "Greater Sydney Area",
"country_code": "AU",
"position": "Acting Process Leader at Australia Post",
"about": null
},
{
"db_source": "1789608697830",
"timestamp": "2026-09-17",
"id": "夏-空***171***8",
"name": "******",
"city": "Guangzhou, Guangdong, China",
"country_code": "CN",
"position": "Renaissance Technologies LLC",
"about": null
},
{
"db_source": "1789608697830",
"timestamp": "2026-09-17",
"id": "nur***ami***che*********b61***",
"name": "Nurul A***a *** ***",
"city": "Pahang, Malaysia",
"country_code": "MY",
"position": "Assistant It Manager at Pusat Internet 1Malaysia",
"about": null
},
{
"db_source": "1789608697830",
"timestamp": "2026-09-17",
"id": "olg***eat***-ma*********b4a******",
"name": "Olga B*****z M*****a",
"city": "Buenos Aires, Buenos Aires Province, Argentina",
"country_code": "AR",
"position": "--",
"about": null
}
]
入力
JSON
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.amazon.com/Quencher-FlowState-Stainless-Insulated-Smoothie/dp/B0CRMZHDG8","asin":"B0CRMZHDG8","origin_url":"https://www.amazon.com/Quencher-FlowState-Stainless-Insulated-Smoothie/dp/B0CRMZHDG8","zipcode":"94107","language":""},{"url":"https://www.amazon.com/KitchenAid-Protective-Dishwasher-Stainless-8-72-Inch/dp/B07PZF3QS3","asin":"B07PZF3QS3","zipcode":"","language":""},{"url":"https://www.amazon.com/TruSkin-Naturals-Vitamin-Topical-Hyaluronic/dp/B01M4MCUAF","asin":"","origin_url":"https://www.amazon.com/TruSkin-Naturals-Vitamin-Topical-Hyaluronic/dp/B01M4MCUAF","zipcode":"94124","language":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_l7q7dkf244hwjntr0&format=json&uncompressed_webhook=true"
出力
JSON
[
{
"timestamp": "2026-09-17",
"title": "PEUTIER 3D Carved Tooth Fairy Box, Wood Tooth Storage Box for Lost Teeth",
"seller_name": "PAR***ON",
"brand": "PEUTIER",
"description": "About this item Package List: You will receive 1 piece of tooth fairy box, suitable for boys and girls who are changing ...",
"initial_price": 6.99,
"currency": "USD",
"availability": "In Stock"
},
{
"timestamp": "2026-09-17",
"title": "Cradle Cap Brush for Babies, Set of 5 Baby Bath Essentials with Bath Sponge Silicone Scrubber Long Handle Comb for Newbo...",
"seller_name": "******",
"brand": "YESYBC",
"description": "Gentle \u0026 Safe Grooming: This kit includes two bath sponges and bristle brushes, two silicone cradle cap brushes, and a f...",
"initial_price": 6.99,
"currency": "USD",
"availability": "In Stock"
},
{
"timestamp": "2026-09-17",
"title": "URMYWO Baby Tissue Box Toy - Montessori Baby Toys for 6-12 Months 1 Year Old Boy Girl - Soft Crinkle Sensory Toys for In...",
"seller_name": "******",
"brand": "URMYWO",
"description": "polyster Fun Montessori Toys: Babies and young children are naturally curious and inquisitive about the world around the...",
"initial_price": 9.99,
"currency": "USD",
"availability": "In Stock"
},
{
"timestamp": "2026-09-17",
"title": "Sesame Street Elmo’s Sing \u0026 Learn Playphone",
"seller_name": "Ama***.co***",
"brand": "Sesame Street",
"description": "Get ready for giggles and engaging conversation with the Sesame Street Sing and Learn Playphone. This pretend play phone...",
"initial_price": 36.57,
"currency": "USD",
"availability": "In Stock"
},
{
"timestamp": "2026-09-17",
"title": "Mioglrie Toddler Baby Girl Fall Winter Clothes Long Sleeve Sweatsuit 3-24M",
"seller_name": "Baby M******e",
"brand": "Mioglrie",
"description": "Baby girl clothes is soft, comfortable and breathable, ensuring that your baby stays cozy all day long. Toddler girls sw...",
"initial_price": 24.98,
"currency": "USD",
"availability": "In Stock"
}
]
入力
JSON
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.zillow.com/homedetails/2506-Gordon-Cir-South-Bend-IN-46635/77050198_zpid/?t=for_sale"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lfqkr8wm13ixtbd8f5&format=json&uncompressed_webhook=true"
出力
JSON
[
{
"db_source": "1789357753648",
"timestamp": "2026-09-14",
"zpid": 89387956,
"city": "Canadensis",
"state": "PA",
"homeStatus": "OTHER",
"address:city": "Canadensis",
"address:streetAddress": "189 Mozzette Rd"
},
{
"db_source": "1789357753648",
"timestamp": "2026-09-14",
"zpid": 60807724,
"city": "Green Bay",
"state": "WI",
"homeStatus": "OTHER",
"address:city": "Green Bay",
"address:streetAddress": "401 13th Ave"
},
{
"db_source": "1789357753648",
"timestamp": "2026-09-14",
"zpid": 68012101,
"city": "Clearfield",
"state": "UT",
"homeStatus": "OTHER",
"address:city": "Clearfield",
"address:streetAddress": "59 Villa Dr"
},
{
"db_source": "1789357753648",
"timestamp": "2026-09-14",
"zpid": 441176909,
"city": "Wellington",
"state": "FL",
"homeStatus": "FOR_SALE",
"address:city": "Wellington",
"address:streetAddress": "11122 Polo Park Trail"
},
{
"db_source": "1789357753648",
"timestamp": "2026-09-14",
"zpid": 2062951799,
"city": "Jersey City",
"state": "NJ",
"homeStatus": "OTHER",
"address:city": "Jersey City",
"address:streetAddress": "93 Bayview Ave #2E"
}
]
入力
JSON
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.instagram.com/p/Cuf4s0MNqNr","country":""},{"url":"https://www.instagram.com/p/DP861NijuwE","country":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lk5ns7kz21pck8jpis&format=json&uncompressed_webhook=true"
出力
JSON
[
{
"db_source": "1789600973253",
"timestamp": "2026-09-16",
"url": "https:\/\/www.instagram.com\/p\/DbOCJ7VCITL\/",
"user_posted": "hodgetwins",
"description": "New reporting has linked Sahra Noor, the sister of Rep. Ilhan Omar, to Minnesota’s massive Feeding Our Future fraud sche...",
"hashtags": null,
"num_comments": 379,
"date_posted": "2026-07-25T14:30:34.000Z"
},
{
"db_source": "1789600973253",
"timestamp": "2026-09-16",
"url": "https:\/\/www.instagram.com\/p\/DdEWN0PFqZ8\/",
"user_posted": "abbie_hathcock",
"description": "We’re getting married!!!! \n\nThe Lord is so faithful and His timing is perfect! I can’t wait to spend all my days with my...",
"hashtags": null,
"num_comments": 237,
"date_posted": "2026-09-09T13:16:13.000Z"
},
{
"db_source": "1789600973253",
"timestamp": "2026-09-16",
"url": "https:\/\/www.instagram.com\/reel\/CrrbuVAsQmF\/",
"user_posted": "_reddickk",
"description": "Every day, in every way, I’m getting better and better.",
"hashtags": null,
"num_comments": 8,
"date_posted": "2023-04-30T23:26:56.000Z"
},
{
"db_source": "1789600973253",
"timestamp": "2026-09-16",
"url": "https:\/\/www.instagram.com\/reel\/DdXIZJLlV5D\/",
"user_posted": "kienyke",
"description": "Un perro se convirtió en protagonista de un intento de robo ocurrido en el barrio Primero de Mayo, en la localidad de Sa...",
"hashtags": [
"#Robo",
"#SanCristóbal",
"#Perro"
],
"num_comments": 3,
"date_posted": "2026-09-16T20:21:39.000Z"
},
{
"db_source": "1789600973253",
"timestamp": "2026-09-16",
"url": "https:\/\/www.instagram.com\/reel\/Dcv8c2sDmu9\/",
"user_posted": "iam_bnotehunned",
"description": "SELF LOVE #wordsoftheday",
"hashtags": [
"#wordsoftheday"
],
"num_comments": 1,
"date_posted": "2026-09-01T15:06:19.000Z"
}
]
最高峰の DX
簡単に開始可能。容易にスケーリング可能。
比類のない安定性
世界をリードするプロキシインフラストラクチャを利用することで、一貫したパフォーマンスを確保し、障害を最小限に抑えることができます。
Web スクレイピングをシンプルに
本番環境に対応した API でスクレイピングを自動化することで、リソースを節約し、メンテナンスの手間を減らせます。
無限のスケーラビリティ
最適なパフォーマンスを維持しつつ、データ需要に合わせてスクレイピングプロジェクトを簡単にスケーリングできます。
仕組み
プロキシとCAPTCHAの心配はもう不要
- 自動IP ローテーション
- CAPTCHAソルバー
- ユーザーエージェントのローテーション
- カスタムヘッダー
- JavaScriptレンダリング
- レジデンシャルプロキシ
シームレスなWeb CrawlerデータアクセスのためのAPI
包括的でスケーラブル、かつ準拠したウェブデータ抽出
シームレスなWeb CrawlerデータアクセスのためのAPI
包括的でスケーラブル、かつ準拠したウェブデータ抽出
ワークフローに合わせたカスタマイズ
WebhookまたはAPI配信を通じて、JSON、NDJSON、またはCSVファイルで構造化データを取得。
組み込みのインフラとブロック解除
プロキシとブロック解除インフラを維持することなく、最大限のコントロールと柔軟性を実現。CAPTCHAやブロックを回避しながら、あらゆる地域からデータを簡単にスクレイピング。
実績あるインフラ
Bright Dataのプラットフォームは世界中の20,000社以上を支え、99.99%の稼働率と195カ国をカバーする1億5,000万以上の実ユーザーIPへのアクセスで安心を提供。
業界をリードするコンプライアンス
当社のプライバシー慣行は、EUデータ保護規制フレームワーク、GDPR、CCPAを含むデータ保護法に準拠しています。
シームレスなWeb CrawlerデータアクセスのためのAPI
包括的でスケーラブル、かつ準拠したウェブデータ抽出
フレキシブル
ワークフローに合わせたカスタマイズ
WebhookまたはAPI配信を通じて、JSON、NDJSON、またはCSVファイルで構造化データを取得。スケーラブル
組み込みのインフラとブロック解除
プロキシとブロック解除インフラを維持することなく、最大限のコントロールと柔軟性を実現。CAPTCHAやブロックを回避しながら、あらゆる地域からデータを簡単にスクレイピング。安定
実績あるインフラ
Bright Dataのプラットフォームは世界中の20,000社以上を支え、99.99%の稼働率と195カ国をカバーする1億5,000万以上の実ユーザーIPへのアクセスで安心を提供。準拠
業界をリードするコンプライアンス
当社のプライバシー慣行は、EUデータ保護規制フレームワーク、GDPR、CCPAを含むデータ保護法に準拠しています。Bright Dataは世界トップブランドに利用されています