GitHub Scraper API

Name: Bright Data
Rating: 4.6 (795 reviews)

Githubをスクレイピングして、ユーザー名、略歴、所有しているリポジトリ、アクティビティ、作成日、説明などの公開データを収集します。インフラストラクチャやプロキシサーバー、ブロックの心配なしに、完全な制御、柔軟性、拡張性を維持できます。

クレジットを入手し、無料でお試しください。
専用のアカウントマネージャー
複数の形式で結果を取得
迅速な開発を可能にするノーコードインターフェース

Start free trial Start free with Google

クレジットカードは必要ありません

20,000+ 人以上のお客様に世界中で信頼されています

Githubのデータのみをご希望であれば、スクレイピングの必要はありません。Githubデータセットをご購入いただけます

コードの例

ブロックされる心配なくGitHubデータを簡単にスクレイピングできます。

Input

JSON

curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://github.com/TheAlgorithms/Python/blob/master/divide_and_conquer/power.py"},{"url":"https://github.com/AkarshSatija/msSync/blob/master/index.js"},{"url":"https://github.com/WerWolv/ImHex/blob/master/main/gui/source/main.cpp"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lyrexgxc24b3d4imjt&format=json&uncompressed_webhook=true"

Output

JSON

[
  {
    "timestamp": "2025-01-27",
    "url": "https:\/\/github.com\/cloudxlab\/ml\/blob\/master\/.gitignore?raw=true",
    "id": "[email protected]",
    "code_language": "Ignore List",
    "code": [
      "projects\/deploy_mnist\/venv\/",
      "projects\/deploy_mnist\/__pycache__\/",
      "projects\/deploy_mnist\/trained_models\/*.pkl",
      "projects\/deploy_mnist\/flask_app\/__pycache__\/"
    ],
    "num_lines": 4,
    "user_name": "cloudxlab",
    "user_url": "https:\/\/github.com\/cloudxlab"
  },
  {
    "timestamp": "2025-01-03",
    "url": "https:\/\/github.com\/termux\/termux-packages\/blob\/master\/disabled-packages\/gimp3\/gimp-2.99.12-libheif-1.13.patch?raw=true",
    "id": "37346186@disabled-packages\/gimp3\/gimp-2.99.12-libheif-1.13.patch",
    "code_language": "Diff",
    "code": [
      "https:\/\/gitlab.gnome.org\/GNOME\/gimp\/-\/commit\/a61299ddb184babca015a846c72bf3e1a57faf2a",
      "",
      "From a61299ddb184babca015a846c72bf3e1a57faf2a Mon Sep 17 00:00:00 2001",
      "From: =?UTF-8?q?Daniel=20Novomesk=C3=BD?= \[email protected]\u003E",
      "Date: Sat, 3 Sep 2022 13:19:33 +0200",
      "Subject: [PATCH] plug-ins: fix builing with libheif 1.13.0+",
      "",
      "---"
    ],
    "num_lines": 76,
    "user_name": "termux",
    "user_url": "https:\/\/github.com\/termux"
  },
  {
    "timestamp": "2025-01-02",
    "url": "https:\/\/github.com\/quadratichq\/quadratic\/blob\/qa\/quadratic-client\/public\/pyodide\/cssselect-1.2.0-py2.py3-none-any.whl.me...",
    "id": "426848256@quadratic-client\/public\/pyodide\/cssselect-1.2.0-py2.py3-none-any.whl.metadata",
    "code_language": null,
    "code": [
      "Metadata-Version: 2.1",
      "Name: cssselect",
      "Version: 1.2.0",
      "Summary: cssselect parses CSS3 Selectors and translates them to XPath 1.0",
      "Home-page: https:\/\/github.com\/scrapy\/cssselect",
      "Author: Ian Bicking",
      "Author-email: [email protected]",
      "Maintainer: Paul Tremberth"
    ],
    "num_lines": 63,
    "user_name": "quadratichq",
    "user_url": "https:\/\/github.com\/quadratichq"
  },
  {
    "timestamp": "2025-01-06",
    "url": "https:\/\/github.com\/LRH1993\/android_interview\/blob\/master\/node_modules\/throttleit\/package.json?raw=true",
    "id": "98419904@node_modules\/throttleit\/package.json",
    "code_language": "JSON",
    "code": [
      "{",
      "  \u0022_args\u0022: [",
      "  [",
      "    {",
      "    \u0022name\u0022: \u0022throttleit\u0022,",
      "    \u0022raw\u0022: \u0022throttleit@^1.0.0\u0022,",
      "    \u0022rawSpec\u0022: \u0022^1.0.0\u0022,",
      "    \u0022scope\u0022: null,"
    ],
    "num_lines": 179,
    "user_name": "LRH1993",
    "user_url": "https:\/\/github.com\/LRH1993"
  },
  {
    "timestamp": "2025-01-27",
    "url": "https:\/\/github.com\/apachecn\/ailearning\/blob\/master\/.gitignore?raw=true",
    "id": "[email protected]",
    "code_language": "Ignore List",
    "code": [
      "# Byte-compiled \/ optimized \/ DLL files",
      "__pycache__\/",
      "*.py[cod]",
      "*$py.class",
      ".vscode",
      "data",
      "",
      "# C extensions"
    ],
    "num_lines": 108,
    "user_name": "apachecn",
    "user_url": "https:\/\/github.com\/apachecn"
  }
]