Twitter Scraper

Twitter Scraper

Twitter をスクレイピングし、Twitter のプロフィール、URL、ツイート、リツイート、会話スレッド、フォロワー/フォロー、場所などのデータを収集します。

無料トライアルを開始する
Twitter scraper

Bright Data の データコレクター を使用するか、
Twitter のデータセットを購入します

  • Twitter をスクレイピングして消費者マインドをモニタリングします
  • 新たなインフルエンサーを発掘し、人気度の推移をモニタリングします
  • ユーザーの会話をキャプチャしてブランドイメージを守ります
  • 新しいトレンドトピックを簡単に把握します

Twitter Scraper 概要

  • コーディング不要の簡単なデータスクレイピング
  • 独自技術を使用してサイトのロックを解除します
  • サイトの変更に対応:Twitter がサイト構造を変更すると、データコレクターもそれに対応します
  • 無限のスケーラブル – 必要なだけのデータを素早く完全に収集します
  • 業界のベストプラクティスとプライバシー規定に完全に準拠しています
無料トライアルを開始する

Twitter tweets

Sample Input
url
https://twitter.com/billieeilish/status/1288974168399069185
Sample Output
                
                    {
    "post_id": [
        "1448695234561380352"
    ],
    "post_url": "https:\/\/twitter.com\/NYUABetterTech\/status\/1448695234561380352",
    "post_text": "Happening now! Join @NaDomagala, @maria_axente, Dave Tarrant, Olivia Gambelin and hear responsible technology professionals from different sectors sharing what skills they have found the most useful when working in technology and data ethics.",
    "post_time": "Thu Oct 14 17:00:34 +0000 2021",
    "retweets": 0,
    "comments": 0,
    "likes": 1,
    "status": "Ok"
}                
              

Twitter keyword or hashtag

Sample Input
search
#love
Sample Output
                
                    {
    "created_at": "Wed Jul 21 07:21:25 +0000 2021",
    "id_str": "1417746521731133443",
    "full_text": "All my heart to this movie💫🍃❤️ #love #selfcare #WEALLHUMAN https:\/\/t.co\/m1lwyJNGF4",
    "truncated": false,
    "source": "\u003Ca href=\u0022http:\/\/twitter.com\/download\/iphone\u0022 rel=\u0022nofollow\u0022\u003ETwitter for iPhone\u003C\/a\u003E",
    "in_reply_to_status_id": null,
    "in_reply_to_status_id_str": null,
    "in_reply_to_user_id": null,
    "in_reply_to_user_id_str": null,
    "in_reply_to_screen_name": null,
    "user_id_str": "1414891075982880770",
    "geo": null,
    "coordinates": null,
    "contributors": null,
    "is_quote_status": false,
    "retweet_count": 0,
    "favorite_count": 0,
    "reply_count": 0,
    "quote_count": 0,
    "conversation_id_str": "1417746521731133443",
    "favorited": false,
    "retweeted": false,
    "possibly_sensitive": false,
    "lang": "en",
    "supplemental_language": null,
    "username": "Meenu_Mania",
    "post_url": "https:\/\/twitter.com\/Meenu_Mania\/status\/1417746521731133443"
}                
              

Twitter profile

Sample Input
url
https://twitter.com/billieeilish
number_of_tweets
70
Sample Output
                
                    {
    "profile_name": "Netflix",
    "isVerified": true,
    "bio": "Newton is a very handsome boy.",
    "location": "California, USA",
    "following": 2067,
    "followers": 17192867,
    "website_url": "http:\/\/spotify.link\/NetflixHub",
    "posts": 43328,
    "media_count": 10778,
    "profile_background_image_url": "https:\/\/pbs.twimg.com\/profile_banners\/16573941\/1648216530",
    "profile_image_url": "https:\/\/pbs.twimg.com\/profile_images\/1235992718171467776\/PaX2Bz1S_normal.jpg",
    "created": "Fri Oct 03 04:16:17 +0000 2008",
    "handle": "netflix",
    "collected_number_of_posts": 20,
    "posts_info": [
        {
            "text": "BRIDGERTON Season 2 said “bops only!” https:\/\/t.co\/dfRuC2G77y",
            "time": "Wed Mar 30 03:54:27 +0000 2022",
            "id": "1509016175421710337",
            "replies": 0,
            "retweets": 645,
            "likes": 0,
            "hashtags": [],
            "tagged_users": "Most",
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1509016175421710337",
            "owner_url": "https:\/\/twitter.com\/Most",
            "media_type": "photo",
            "media_url": "https:\/\/pbs.twimg.com\/media\/FO_mCPAXoAIC7ZY.jpg",
            "isRetweeted": true,
            "retweeted_post_handle": "@Most"
        },
        {
            "text": "THE UMBRELLA ACADEMY IS BACK IN 85 DAYS",
            "time": "Wed Mar 30 03:54:16 +0000 2022",
            "id": "1509016129498333187",
            "replies": 0,
            "retweets": 1517,
            "likes": 0,
            "hashtags": [],
            "tagged_users": "Netflix_CA",
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1509016129498333187",
            "owner_url": "https:\/\/twitter.com\/Netflix_CA",
            "media_type": "text",
            "isRetweeted": true,
            "retweeted_post_handle": "@Netflix_CA"
        },
        {
            "text": "Alice in Borderland Season 2 premieres this December — and the 10 characters who survived Season 1 are back to face even more difficult challenges in Season 2. https:\/\/t.co\/na0RBuhrFX",
            "time": "Tue Mar 29 21:00:00 +0000 2022",
            "id": "1508911878692642822",
            "replies": 515,
            "retweets": 8357,
            "likes": 24972,
            "hashtags": [],
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508911878692642822",
            "owner_url": "https:\/\/twitter.com\/netflix",
            "media_type": "video",
            "media_url": "https:\/\/video.twimg.com\/amplify_video\/1508850517908213762\/vid\/480x270\/NNO9UdzaCLNEWwYb.mp4?tag=14",
            "cover_url": "https:\/\/pbs.twimg.com\/media\/FPCPGyAVEAIsYK2.jpg",
            "views": 527362,
            "isRetweeted": false
        },
        {
            "text": "ben would be proud. ♥️ https:\/\/t.co\/1a3a0FT58e",
            "time": "Tue Mar 29 20:06:36 +0000 2022",
            "id": "1508898439500730372",
            "replies": 0,
            "retweets": 1202,
            "likes": 0,
            "hashtags": [],
            "tagged_users": "justinhmin",
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508898439500730372",
            "owner_url": "https:\/\/twitter.com\/justinhmin",
            "media_type": "text",
            "isRetweeted": true,
            "retweeted_post_handle": "@justinhmin"
        },
        {
            "text": "Welcome to the family, Viktor — we’re so happy you’re here ❤️   https:\/\/t.co\/hQwD4Vvlkd",
            "time": "Tue Mar 29 20:01:23 +0000 2022",
            "id": "1508897125702115332",
            "replies": 64,
            "retweets": 650,
            "likes": 7322,
            "hashtags": [],
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508897125702115332",
            "owner_url": "https:\/\/twitter.com\/netflix",
            "media_type": "text",
            "isRetweeted": false
        },
        {
            "text": "props to everyone in #Bridgerton but charitha chandran acted her little ass off in EVERY episode",
            "time": "Tue Mar 29 19:58:10 +0000 2022",
            "id": "1508896316365045760",
            "replies": 0,
            "retweets": 15,
            "likes": 0,
            "hashtags": [
                "Bridgerton"
            ],
            "tagged_users": "evielavorre",
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508896316365045760",
            "owner_url": "https:\/\/twitter.com\/evielavorre",
            "media_type": "text",
            "isRetweeted": true,
            "retweeted_post_handle": "@evielavorre"
        },
        {
            "text": "And also Charithra Chandran???  How she managed Edwina\u0027s subtle growth without completely flipping who the character was. Was…",
            "time": "Tue Mar 29 19:06:23 +0000 2022",
            "id": "1508883284456927235",
            "replies": 0,
            "retweets": 180,
            "likes": 0,
            "hashtags": [],
            "tagged_users": "BeeBabs",
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508883284456927235",
            "owner_url": "https:\/\/twitter.com\/BeeBabs",
            "media_type": "text",
            "isRetweeted": true,
            "retweeted_post_handle": "@BeeBabs"
        },
        {
            "text": "Kate And Lady Danbury had one of the most wholesome relationship This Season. I loved every scene of them 💘\n#Bridgerton https…",
            "time": "Tue Mar 29 19:06:19 +0000 2022",
            "id": "1508883269848236032",
            "replies": 0,
            "retweets": 367,
            "likes": 0,
            "hashtags": [
                "Bridgerton"
            ],
            "tagged_users": "schofiaa",
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508883269848236032",
            "owner_url": "https:\/\/twitter.com\/schofiaa",
            "media_type": "text",
            "isRetweeted": true,
            "retweeted_post_handle": "@schofiaa"
        },
        {
            "text": "It has been unseasonably warm. Some may say the Viscount is to blame for that. https:\/\/t.co\/VkaRbji4w6",
            "time": "Tue Mar 29 19:06:12 +0000 2022",
            "id": "1508883239045267456",
            "replies": 0,
            "retweets": 4131,
            "likes": 0,
            "hashtags": [],
            "tagged_users": "bridgerton",
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508883239045267456",
            "owner_url": "https:\/\/twitter.com\/bridgerton",
            "media_type": "photo",
            "media_url": "https:\/\/pbs.twimg.com\/media\/FO-Z-S5XoAcqSXk.jpg",
            "isRetweeted": true,
            "retweeted_post_handle": "@bridgerton"
        },
        {
            "text": "If you\u0027ve ever dreamt of Anthony Bridgerton — or Jonathan Bailey, for that matter — seductively whispering in your ear, this was made just for you. \n\nOh, and wear headphones for an extra special sensory experience 🎧 https:\/\/t.co\/qQbQIsVaYl",
            "time": "Tue Mar 29 17:00:03 +0000 2022",
            "id": "1508851490286309384",
            "replies": 220,
            "retweets": 1384,
            "likes": 8889,
            "hashtags": [],
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508851490286309384",
            "owner_url": "https:\/\/twitter.com\/netflix",
            "media_type": "video",
            "media_url": "https:\/\/video.twimg.com\/amplify_video\/1508808431670632448\/vid\/480x270\/LzElpcz1Kn-3UVm9.mp4?tag=14",
            "cover_url": "https:\/\/pbs.twimg.com\/media\/FPBev_bXEAEr-qO.jpg",
            "views": 171682,
            "isRetweeted": false
        },
        {
            "text": "That’s it… that’s the season #Bridgerton #bridgertonS2 #Kanthony https:\/\/t.co\/efRK2cKHHv",
            "time": "Tue Mar 29 16:52:06 +0000 2022",
            "id": "1508849491046150146",
            "replies": 0,
            "retweets": 685,
            "likes": 0,
            "hashtags": [
                "Bridgerton",
                "bridgertonS2",
                "Kanthony"
            ],
            "tagged_users": "DinaTAttia",
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508849491046150146",
            "owner_url": "https:\/\/twitter.com\/DinaTAttia",
            "media_type": "photo",
            "media_url": "https:\/\/pbs.twimg.com\/media\/FO5SgB2WQAIRY6Y.jpg",
            "isRetweeted": true,
            "retweeted_post_handle": "@DinaTAttia"
        },
        {
            "text": "The end justifies the means. \n\nOzark Season 4 Part 2 — the final episodes — premieres April 29 https:\/\/t.co\/AbT2iE3zF0",
            "time": "Tue Mar 29 16:00:00 +0000 2022",
            "id": "1508836378934538246",
            "replies": 270,
            "retweets": 3162,
            "likes": 9007,
            "hashtags": [],
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508836378934538246",
            "owner_url": "https:\/\/twitter.com\/netflix",
            "media_type": "video",
            "media_url": "https:\/\/video.twimg.com\/amplify_video\/1508620386308530177\/vid\/640x360\/NsjfvjxhNRnVQzMC.mp4?tag=14",
            "cover_url": "https:\/\/pbs.twimg.com\/media\/FPBg9LaWQAUUkmR.jpg",
            "views": 323821,
            "isRetweeted": false
        },
        {
            "text": "They’re not ready to marry their current partner — but someone else might be! \n\nSix couples are given eight weeks to commit to marriage or move on… potentially with someone else! From the creators of Love is Blind, The Ultimatum premieres April 6. https:\/\/t.co\/5exZIShRnk",
            "time": "Tue Mar 29 14:37:40 +0000 2022",
            "id": "1508815659307868161",
            "replies": 32,
            "retweets": 69,
            "likes": 675,
            "hashtags": [],
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508815659307868161",
            "owner_url": "https:\/\/twitter.com\/netflix",
            "media_type": "video",
            "media_url": "https:\/\/video.twimg.com\/amplify_video\/1508620386312753155\/vid\/1280x720\/M6fwSOqDR1sjMjn2.mp4?tag=14",
            "cover_url": "https:\/\/pbs.twimg.com\/media\/FPBgrJzWYA8awlR.jpg",
            "views": 67544,
            "isRetweeted": false
        },
        {
            "text": "Photo credit: Richard Phibbs",
            "time": "Tue Mar 29 14:31:59 +0000 2022",
            "id": "1508814229800984580",
            "replies": 5,
            "retweets": 16,
            "likes": 363,
            "hashtags": [],
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508814229800984580",
            "owner_url": "https:\/\/twitter.com\/netflix",
            "media_type": "text",
            "isRetweeted": false
        },
        {
            "text": "The endlessly brilliant Gillian Anderson has signed a first-look deal with Netflix, through which she will produce new TV shows! https:\/\/t.co\/3NfDxEvXUs",
            "time": "Tue Mar 29 14:20:52 +0000 2022",
            "id": "1508811432955158539",
            "replies": 143,
            "retweets": 692,
            "likes": 8964,
            "hashtags": [],
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508811432955158539",
            "owner_url": "https:\/\/twitter.com\/netflix",
            "media_type": "photo",
            "media_url": "https:\/\/pbs.twimg.com\/media\/FPBf9oEWUA8cv-8.png",
            "isRetweeted": false
        },
        {
            "text": "When two friends pressed play on this long-lost survival game from the 1980s, a murderous curse was unleashed. \n\nNow Asa Butterfield (@asabfb) and Iola Evans must Choose Or Die, a new horror movie premiering April 15. https:\/\/t.co\/EZXRnbBriU",
            "time": "Tue Mar 29 13:00:02 +0000 2022",
            "id": "1508791091797106689",
            "replies": 38,
            "retweets": 216,
            "likes": 1327,
            "hashtags": [],
            "tagged_users": "asabfb",
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508791091797106689",
            "owner_url": "https:\/\/twitter.com\/netflix",
            "media_type": "video",
            "media_url": "https:\/\/video.twimg.com\/amplify_video\/1508653881613426704\/vid\/480x270\/ecAttxA6kkRkHm4-.mp4?tag=14",
            "cover_url": "https:\/\/pbs.twimg.com\/media\/FO_fTGkUcAAuezn.jpg",
            "views": 133835,
            "isRetweeted": false
        },
        {
            "text": "Appreciation post for Nam Joo-Hyuk’s signature pose™ ✨\n\n(📺: Twenty Five Twenty One) https:\/\/t.co\/w8Tjy36Dvu",
            "time": "Mon Mar 28 23:04:27 +0000 2022",
            "id": "1508580807421485058",
            "replies": 100,
            "retweets": 4209,
            "likes": 14680,
            "hashtags": [],
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508580807421485058",
            "owner_url": "https:\/\/twitter.com\/netflix",
            "media_type": "photo",
            "media_url": "https:\/\/pbs.twimg.com\/media\/FO-OOpwVUAAtpFq.jpg",
            "isRetweeted": false
        },
        {
            "text": "My favorite moment of the #Oscars is my mom- the real Linda Mitchell- meeting Maya Rudolph- who is just a national treas…",
            "time": "Mon Mar 28 21:09:34 +0000 2022",
            "id": "1508551897287782400",
            "replies": 0,
            "retweets": 391,
            "likes": 0,
            "hashtags": [
                "Oscars"
            ],
            "tagged_users": "michaelrianda",
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508551897287782400",
            "owner_url": "https:\/\/twitter.com\/michaelrianda",
            "media_type": "text",
            "isRetweeted": true,
            "retweeted_post_handle": "@michaelrianda"
        },
        {
            "text": "i\u0027m connecting the dots... https:\/\/t.co\/MrjUKfNy8P",
            "time": "Mon Mar 28 21:06:43 +0000 2022",
            "id": "1508551178413490179",
            "replies": 0,
            "retweets": 804,
            "likes": 0,
            "hashtags": [],
            "tagged_users": "NetflixGeeked",
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508551178413490179",
            "owner_url": "https:\/\/twitter.com\/NetflixGeeked",
            "media_type": "photo",
            "media_url": "https:\/\/pbs.twimg.com\/media\/FO9hv9kXoAM0l9p.jpg",
            "isRetweeted": true,
            "retweeted_post_handle": "@NetflixGeeked"
        },
        {
            "text": "When my car and another car reach an intersection at the same time. https:\/\/t.co\/VLD7MDelO0",
            "time": "Mon Mar 28 19:14:43 +0000 2022",
            "id": "1508522992879341568",
            "replies": 56,
            "retweets": 562,
            "likes": 6402,
            "hashtags": [],
            "post_url": "https:\/\/twitter.com\/netflix\/status\/1508522992879341568",
            "owner_url": "https:\/\/twitter.com\/netflix",
            "media_type": "photo",
            "media_url": "https:\/\/pbs.twimg.com\/media\/FO9Zpw9VgAAvXAT.jpg",
            "isRetweeted": false
        }
    ]
}                
              

Twitter Scraper を以下の用途に活用可能できます:

  • 次のトレンドを先取りし、次の流行やファッションを予測し、消費者マインドの追跡を継続します
  • 投資判断の材料となるニュースやオピニオンデータを収集します
  • 関連するディスカッションをモニタリングして、ブランドを保護および強化します
  • ツイートやハッシュタグなどから予測される新たなトレンドに基づいて新製品を開発します
  • 競合他社とその顧客について学び、インサイトと優位性を獲得します
無料トライアルを開始する

データコレクターの仕組み

ステップ1

収集する先のウェブサイトを選択します。
Target website icons

ステップ2

頻度を選びます。リアルタイムか指定したスケジュールスケジュール。出力する形式を選択:JSON、CSV、HTML、XSLS。
Format and frequency for data extraction

ステップ3

データの送信先を決めます:webhook、メール、Amazon S3、Google Cloud、Microsoft Azure、SFTP、API

データ取得に関するご相談:

弊社データエキスパートに、取得されたい内容や具体的なご要望をお気軽にご相談ください

無料トライアルを開始する