GitHub Scraper API

Name: Bright Data
Rating: 4.6 (816 reviews)

Githubをスクレイピングして、ユーザー名、略歴、所有しているリポジトリ、アクティビティ、作成日、説明などの公開データを収集します。インフラストラクチャやプロキシサーバー、ブロックの心配なしに、完全な制御、柔軟性、拡張性を維持できます。

クレジットを入手し、無料でお試しください。
専用のアカウントマネージャー
複数の形式で結果を取得
迅速な開発を可能にするノーコードインターフェース

Start free trial Start free with Google

クレジットカードは必要ありません

20,000+ 人以上のお客様に世界中で信頼されています

Githubのデータのみをご希望であれば、スクレイピングの必要はありません。Githubデータセットをご購入いただけます

コードの例

ブロックされる心配なくGitHubデータを簡単にスクレイピングできます。

Input

JSON

curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://github.com/TheAlgorithms/Python/blob/master/divide_and_conquer/power.py"},{"url":"https://github.com/AkarshSatija/msSync/blob/master/index.js"},{"url":"https://github.com/WerWolv/ImHex/blob/master/main/gui/source/main.cpp"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lyrexgxc24b3d4imjt&format=json&uncompressed_webhook=true"

Output

JSON

[
  {
    "db_source": "1742826943410",
    "timestamp": "2025-03-24",
    "url": "https:\/\/github.com\/conan-io\/conan-center-index\/blob\/master\/recipes\/ade\/all\/test_package\/conanfile.py?raw=true",
    "id": "204671232@recipes\/ade\/all\/test_package\/conanfile.py",
    "code_language": "Python",
    "code": [
      "from conan import ConanFile",
      "from conan.tools.build import can_run",
      "from conan.tools.cmake import CMake, cmake_layout",
      "import os",
      "",
      "",
      "class TestPackageConan(ConanFile):",
      "  settings = \u0022os\u0022, \u0022arch\u0022, \u0022compiler\u0022, \u0022build_type\u0022"
    ],
    "num_lines": 26,
    "user_name": "conan-io"
  },
  {
    "db_source": "1742826943410",
    "timestamp": "2025-03-24",
    "url": "https:\/\/github.com\/xkcoding\/spring-boot-demo\/blob\/master\/demo-orm-beetlsql\/src\/main\/java\/com\/xkcoding\/orm\/beetlsql\/entit...",
    "id": "110211147@demo-orm-beetlsql\/src\/main\/java\/com\/xkcoding\/orm\/beetlsql\/entity\/User.java",
    "code_language": "Java",
    "code": [
      "package com.xkcoding.orm.beetlsql.entity;",
      "",
      "import lombok.AllArgsConstructor;",
      "import lombok.Builder;",
      "import lombok.Data;",
      "import lombok.NoArgsConstructor;",
      "import org.beetl.sql.core.annotatoin.Table;",
      ""
    ],
    "num_lines": 77,
    "user_name": "xkcoding"
  },
  {
    "db_source": "1742826943410",
    "timestamp": "2025-03-24",
    "url": "https:\/\/github.com\/spamegg1\/reviews\/blob\/master\/courses\/FullstackOpen\/p10\/part3\/solution\/src\/graphql\/fragments.js?raw=tr...",
    "id": "271197263@courses\/FullstackOpen\/p10\/part3\/solution\/src\/graphql\/fragments.js",
    "code_language": "JavaScript",
    "code": [
      "import { gql } from \u0027apollo-boost\u0027;",
      "",
      "export const REPOSITORY_BASE_FIELDS = gql`",
      "  fragment RepositoryBaseFields on Repository {",
      "  id",
      "  name",
      "  ownerName",
      "  fullName"
    ],
    "num_lines": 25,
    "user_name": "spamegg1"
  },
  {
    "db_source": "1742826943410",
    "timestamp": "2025-03-24",
    "url": "https:\/\/github.com\/facebook\/buck\/blob\/main\/src\/com\/facebook\/buck\/core\/rulekey\/CustomFieldDepsTag.java?raw=true",
    "id": "9504214@src\/com\/facebook\/buck\/core\/rulekey\/CustomFieldDepsTag.java",
    "code_language": "Java",
    "code": [
      "\/*",
      " * Copyright (c) Facebook, Inc. and its affiliates.",
      " *",
      " * Licensed under the Apache License, Version 2.0 (the \u0022License\u0022);",
      " * you may not use this file except in compliance with the License.",
      " * You may obtain a copy of the License at",
      " *",
      " *   http:\/\/www.apache.org\/licenses\/LICENSE-2.0"
    ],
    "num_lines": 20,
    "user_name": "facebook"
  },
  {
    "db_source": "1742826943410",
    "timestamp": "2025-03-24",
    "url": "https:\/\/github.com\/abhpd\/hacktoberfest2021\/blob\/main\/Python\/Polynomial%20Regression\/polynomial_regression.py?raw=true",
    "id": "302575005@Python\/Polynomial Regression\/polynomial_regression.py",
    "code_language": "Python",
    "code": [
      "# Polynomial Regression",
      "",
      "# Importing the libraries",
      "import numpy as np",
      "import matplotlib.pyplot as plt",
      "import pandas as pd",
      "",
      "# Importing the dataset"
    ],
    "num_lines": 66,
    "user_name": "abhpd"
  }
]