Skip to main content
SimilarExport ZIP
100%

A little bit of JavaScript that helps setup a box on ScraperWiki for tools inside that box

✓ Published0🌍 Public
IIanHopkinson
Last edited Aug 20, 2013
Created on Aug 20, 2013

This example shows how to automate the setup of a tool environment on ScraperWiki by writing a dataset URL to a file and launching an installation script. The code uses ScraperWiki’s `scraperwiki.exec` and `scraperwiki.readSettings` APIs to run shell commands, while jQuery’s `$(function(){})` triggers the two setup functions on page load. It writes the target URL into `~/tool/dataset_url.txt` and runs `run-one tool/runonce.R` with logging to `tool/log.txt`. No data source or rendering is involved; the focus is purely on command-line orchestration within ScraperWiki’s execution context.

AI-generated description

Similar vizzes

Loading thumbnail…

Some R to knit a view on ScraperWiki

This example demonstrates how to knit an R view of ScraperWiki data into a static HTML report. The script uses the `knitr` library to render an Rhtml file, processing embedded R code and visualizations into a final web page. It relies on `render_html()` to generate the output and writes the result to an index.html file, making the data view portable and shareable. The code highlights a workflow for automating data-report generation from a ScraperWiki source.

IIanHopkinson
59% match
Loading thumbnail…

random shell stuff

This example demonstrates a shell-scripting workflow for scaffolding interactive data-visualization projects, showing how to automate the setup of a project directory structure and download essential JavaScript libraries. The script creates nested folders for images, stylesheets, scripts, and CoffeeScript sources, then fetches libraries such as d3.js, polymaps.js, underscore.js, and backbone.js via curl. It also generates a CoffeeScript starter file and a Rakefile with a watch task for compiling CoffeeScript to JavaScript. The visualization itself is not rendered; instead, the code focuses on environment preparation and dependency management.

CCaged
57% match
Loading thumbnail…

Gist 030abf753f0ac606724c658e17188739

This example automates the creation of training teams on the Sorare fantasy football platform, showing a scripted workflow that logs into the site and iteratively assembles lineups from available player cards. The code uses Selenium WebDriver to drive a Chrome browser, with helper functions that toggle filter settings (such as excluding or including "Commons" and "Next Game" availability) and click through the interface to select players. The process runs until no more valid teams can be formed, then moves to the next matchday. The visualization demonstrates browser automation for repetitive data-entry tasks, relying on explicit XPath selectors and timed waits to interact with dynamic page elements.

CConorAspell
52% match
Loading thumbnail…

Gist 7b6855736feac8b45cbec16c5b9c2fba

This example demonstrates a simple environment setup routine for installing Miniconda on a Linux system via a shell script. It uses `wget` to download the installer, `chmod` to make it executable, and `sudo` to run the installation into `/opt/conda`, followed by permission changes and symbolic links for `conda`, `activate`, and `deactivate` commands. The script shows a procedural, command-line-based workflow without any graphical or interactive visualization, relying purely on Bash scripting and system utilities.

MMistyBlunch
52% match
Loading thumbnail…

R used to generate views of ScraperWiki's Twitter Search tool

This example visualizes the frequency of tweets over time, showing the number of tweets per minute from a ScraperWiki Twitter search dataset. The chart displays a histogram of tweet timestamps, with the x-axis representing dates and the y-axis showing tweet counts, capped at 40,000 tweets. The R script uses the `ggplot2` and `scales` libraries to bin the timestamps into 60-second intervals and render the plot. It queries data via ScraperWiki’s SQL interface, converts the `created_at` strings to POSIX date objects, and uses `qplot` and `ggplot_build` to construct and refine the histogram. The visualization highlights temporal activity patterns in the collected tweets.

IIanHopkinson
52% match
Loading thumbnail…

Gist 7d257dfb3e98658c4943dbf2e599e5b7

This example demonstrates a Raspberry Pi setup process for creating isolated Python environments. The code shows a sequence of shell commands that install `virtualenv` and `virtualenvwrapper`, configure the user's profile to initialize these tools, and then create a new virtual environment named `envname`. The visualization highlights the command-line interface as a data source, rendering each terminal command as a text-based flow. It uses the system's package manager (`pip`) and shell environment variables (`WORKON_HOME`) to establish the workflow. The example focuses on the setup steps, not on graphical data plotting.

JJWTappert
52% match
Loading thumbnail…

Gist 58c79c81e9a950a0cdafc7d2d0275742

This example shows a dynamic, browser-automated web-scraping workflow that captures rendered page content. It uses Selenium’s `webdriver` to launch a Chrome browser, wait for elements via `WebDriverWait` and `expected_conditions`, and then extracts page HTML with BeautifulSoup. The script programmatically sends keyboard inputs via `Keys`, and also employs the `requests` library for direct HTTP calls. It parses the returned data with `json`, timestamps actions with `datetime`, and structures results into a pandas DataFrame. The process includes randomized delays (`random` and `time`) to mimic human browsing behavior, though no explicit visualization or rendering library is used beyond the raw captured markup.

AArizonaTay
51% match
Loading thumbnail…

Gist 4621876

This example demonstrates how to automate the setup of a Go workspace and package installation via a shell script, following the official Go documentation. The script creates a temporary directory structure with a `src/newmath` folder and writes a custom `sqrt.go` file implementing a basic square root function. It then runs `go install example/newmath` to compile and install the package, verifying the result by checking for zero output or errors. The code relies on the Go command-line tool and standard shell utilities like `echo` and `mkdir`; no external visualization libraries are involved.

HHoffmannP
51% match