Why `rubinius ` is always cloned and failed?

[zhangysh1995]

The errors:

zhangysh1995@ubuntu-zhangyushao:~$ crawld -c crawld.conf 
E0314 10:19:15.173304    6197 crawld.go:79] impossible to clone https://github.com/rubinius/rubinius.git in /var/crawld/c/rubinius/rubinius (network error) skipping
E0314 10:19:16.711802    6197 github.go:253] GET https://api.github.com/search/repositories?per_page=100&q=language%3Ac&sort=stars: 401 Bad credentials []
E0314 10:19:17.156407    6197 github.go:253] GET https://api.github.com/search/repositories?per_page=100&q=language%3Acpp&sort=stars: 401 Bad credentials []

After these two lines of information, the program is running but cannot see any outputs.

My configuration file:

Details

{
    "database": {
        "hostname": "localhost",
        "port": 5432,
        "username": "crawler",
        "password": "crawler",
        "dbname": "crawler",
        "ssl_mode": "disable"
    },
    "clone_dir": "/var/crawld",
    "crawling_time_interval": "1h",
    "fetch_time_interval": "5m",
    "fetch_languages": [
        "c",
        "cpp"
    ],
    "tar_repositories": false,
    "tmp_dir": "/ramdisk",
    "tmp_dir_file_size_limit": 2.0,
    "max_fetcher_workers": 2,
    "throttler_wait_time": 900,
    "throttler_sliding_window_size": 60,
    "throttler_leak_interval": 1000,
    "crawlers": [
        {
            "type": "github",
            "languages": [
                "c",
                "cpp"
            ],
            "limit": 0,
            "since_id": 0,
            "fork": false,
            "oauth_access_token": "token here",
            "use_search_api": true 
        }
    ]
}

[rolinh]

Hi @zhangysh1995,

Not sure. I haven't used this project for about 2 years. I'll try to give it a shot one of these days and figure out the issue.