Scripts for getting the full list of Github users (get_all_github_users.py) and for retrieving the details of these users (get_github_user_details.py) using the Github API.

100%

Scripts for getting the full list of Github users (get_all_github_users.py) and for retrieving the details of these users (get_github_user_details.py) using the Github API.

✓ Published0🌍 Public

Last edited Jul 26, 2013

Created on Jul 26, 2013

Two Python scripts demonstrate how to query the GitHub API for a complete list of all user accounts. The first script, `get_all_github_users.py`, paginates through `https://api.github.com/users` using the `requests` library, handling rate limits and writing each user ID to a JSON file. The second, `get_github_user_details.py`, uses `multiprocessing` with a pool of five processes to fetch detailed profile information for each user via HTTPS connections to `api.github.com`, saving the results incrementally. Together they show batch data harvesting from a REST API with concurrency and rate-limit awareness.

AI-generated description

Similar vizzes

Loading thumbnail…

Gist 7a408ae6b97507c83e6613316e32a9c7

This example contrasts two JavaScript approaches for fetching GitHub user data from the GitHub REST API. It uses the Fetch API to request `https://api.github.com/users/mistyblunch` and logs the resulting JSON. The first method chains `.then()` callbacks in a Promise-based function, while the second defines an `async` function that uses `await` to handle the response and return the parsed JSON object. Neither function performs any visualization or rendering—only console output.

MMistyBlunch

59% match

Loading thumbnail…

A script to download all of a user's tweets into a csv

This script downloads a user’s entire tweet history into a CSV file, preserving each tweet’s ID, creation timestamp, and text. It demonstrates the Twitter API’s pagination limits by repeatedly fetching batches of 200 tweets via Tweepy’s `user_timeline` method, using the `max_id` parameter to retrieve older tweets until none remain. The final output is written with Python’s built-in `csv` module, encoding text as UTF-8. The example relies on Tweepy for API authentication and data retrieval, and shows a practical pattern for handling rate-limited, cursor-based API responses.

BBenHeubl

59% match

Loading thumbnail…

Requesting data from the Github API

This example demonstrates the complete workflow of fetching repository data from the GitHub API and rendering it as an HTML list. It uses a raw XMLHttpRequest to request JSON from `https://api.github.com/users/razpudding/repos`, parses the response with `JSON.parse`, and then dynamically creates a `<ul>` element with `<li>` items for each repository name using the DOM methods `document.createElement` and `appendChild`. The visualization highlights the data pipeline from an asynchronous API call to interactive webpage content.

LLaurens

58% match

Loading thumbnail…

A Bash script to download files of a Gist answered by Gemini model

This example demonstrates a Bash script that downloads all files from a specified GitHub Gist using its unique ID. It first fetches the Gist’s metadata as JSON via the GitHub API with `curl`, then extracts raw file URLs using `jq`’s `.files[].raw_url` filter. The script iterates over each URL, extracts the filename with `basename`, and downloads the file into a chosen directory using a second `curl` call, printing a confirmation for each download. The rendering approach is purely command-line based, relying on the GitHub REST API and standard Unix text-processing tools.

VVioletVivirand

57% match

Loading thumbnail…

The Gist to Clone All Gists

This example demonstrates a practical workflow for backing up or synchronizing a GitHub user’s public gists. It first clones every gist from a specified GitHub account over SSH, using a paginated API fetch to retrieve the list of gists and the Node.js `https` module to authenticate via an OAuth token. It then shows a complementary bash script that iterates through local directories, committing any changes with an empty message and pushing them back to their remote origins. The visualization highlights the interplay between the GitHub REST API and command-line Git operations for batch repository management.

Mmbostock

56% match

Loading thumbnail…

Gist a99d287be62c6d73536521c0e5e74e58

This example scrapes Instagram profile and post data to track follower counts, likes, comments, captions, and post dates for selected users, associating each entry with an industry topic. The script uses Selenium to automate login and search, BeautifulSoup to parse the page source, and the Instagram GraphQL data embedded in `window._sharedData` to extract metrics. It writes the collected records to a CSV via pandas, pausing with random sleeps to avoid detection. The visualization highlights how social-media engagement varies across profiles and industries over time.

AArizonaTay

56% match

Loading thumbnail…

A vanilla py-script to download all Pocket.com data via API.

This example demonstrates how to download a complete archive of all Pocket.com saved articles using the Pocket API. It shows the OAuth authentication flow, which opens a browser for user approval, then retrieves every article in batches of ten, displaying each article’s title and URL as it processes them. The script uses Python’s `requests` library to make HTTP POST calls to the Pocket API endpoints, along with the `json` module to parse responses and `subprocess` to trigger browser opening. It saves the full article list as a JSON file.

BBastiTee

56% match

Loading thumbnail…

Gist 859941ebbbd6686689c4c870c1e5cf18

This example demonstrates a chained asynchronous workflow that reads a GitHub username from a local file, fetches the corresponding GitHub profile via the GitHub API, and writes the profile data as JSON to another file. It uses the Promise-based functions `pluckFirstLineFromFile`, `getGitHubProfileAsync`, and `asynWrite`, structured with `then` and `catch` handlers to manage data flow and error logging. The code illustrates how to sequence file I/O and network requests without callback nesting, relying on async/await-style chaining through native JavaScript Promises.

MMailnickko

55% match