Some R to knit a view on ScraperWiki

100%

Some R to knit a view on ScraperWiki

✓ Published0🌍 Public

Last edited Aug 20, 2013

Created on Aug 20, 2013

This example demonstrates how to knit an R view of ScraperWiki data into a static HTML report. The script uses the `knitr` library to render an Rhtml file, processing embedded R code and visualizations into a final web page. It relies on `render_html()` to generate the output and writes the result to an index.html file, making the data view portable and shareable. The code highlights a workflow for automating data-report generation from a ScraperWiki source.

AI-generated description

Similar vizzes

Loading thumbnail…

R used to generate views of ScraperWiki's Twitter Search tool

This example visualizes the frequency of tweets over time, showing the number of tweets per minute from a ScraperWiki Twitter search dataset. The chart displays a histogram of tweet timestamps, with the x-axis representing dates and the y-axis showing tweet counts, capped at 40,000 tweets. The R script uses the `ggplot2` and `scales` libraries to bin the timestamps into 60-second intervals and render the plot. It queries data via ScraperWiki’s SQL interface, converts the `created_at` strings to POSIX date objects, and uses `qplot` and `ggplot_build` to construct and refine the histogram. The visualization highlights temporal activity patterns in the collected tweets.

IIanHopkinson

66% match

Loading thumbnail…

A gist in R showing how to plot twitter data from ScraperWiki as a smoothScatter plot

This example shows the relationship between follower and following counts for a subset of Twitter users, revealing a dense clustering pattern near the origin with sparse outliers at higher values. The R code first retrieves JSON data from a ScraperWiki SQL endpoint, converts it into a data frame using the `rjson` package, and then renders a smoothScatter plot—a base R function that uses hexagonal binning and color density to visualize overlapping points. The plot is restricted to a 0–5000 range on both axes to focus on the majority of users while still exposing the distribution’s shape. The approach highlights typical user behavior rather than individual outliers.

IIanHopkinson

61% match

Loading thumbnail…

Make the figures click-able in your RMarkdown=>HTML reports.

This example demonstrates how to make figures clickable in an RMarkdown-generated HTML report, allowing readers to open images in full resolution in a new browser tab. It shows the integration of JavaScript with RMarkdown's HTML output to enhance interactivity. The code uses jQuery to select all images wrapped in figure elements, then wraps each image in an anchor tag that references the image source as the link URL. The script sets the link's title attribute to the image's alt text and adds `target="_blank"` to open the link in a new tab. The implementation relies on jQuery's `wrap` function and attribute manipulation methods.

DDougManuel

59% match

Loading thumbnail…

A little bit of JavaScript that helps setup a box on ScraperWiki for tools inside that box

This example shows how to automate the setup of a tool environment on ScraperWiki by writing a dataset URL to a file and launching an installation script. The code uses ScraperWiki’s `scraperwiki.exec` and `scraperwiki.readSettings` APIs to run shell commands, while jQuery’s `$(function(){})` triggers the two setup functions on page load. It writes the target URL into `~/tool/dataset_url.txt` and runs `run-one tool/runonce.R` with logging to `tool/log.txt`. No data source or rendering is involved; the focus is purely on command-line orchestration within ScraperWiki’s execution context.

IIanHopkinson

59% match

Loading thumbnail…

Gist f72a3553521c158f0eb0dccbe774455e

This example demonstrates a web scraper that extracts detailed trail information from a hiking website. It shows how structured data can be programmatically retrieved from HTML pages, specifically pulling out features, overview, and description sections. The code uses the Nokogiri library to parse the document and XPath queries to locate the relevant heading elements. After extracting each section, it cleans the text by removing newlines and excess whitespace. The scraper returns a hash containing the three descriptive fields, making the data readily accessible for further processing or visualization.

WWill Carter

59% match

Loading thumbnail…

HTML Report

This example renders a minimal HTML report as a static web page. It displays a single "Report" heading in the browser, using the built-in HTML document structure with a title and body. The visualization is purely declarative, relying on the browser’s default rendering of semantic HTML elements—no external libraries or APIs are used. The source is a simple static file with no interactive or data-driven features, serving as a bare-bones template for a report layout.

AAndrew Boeckh

59% match

Loading thumbnail…

HTML Cars Report

This HTML Cars Report presents a simple webpage that embeds an HTML snippet, though the specific visualization code is not included in the provided files. The example relies on a static HTML structure with a title, containing no external data source or rendering library. It demonstrates a minimal webpage setup, likely intended to display a car-themed report using basic markup. The page loads without dynamic elements, offering a static view of the content as defined by the source files.

HHLgorithm

58% match

Loading thumbnail…

Gist 5ea363dfe112d08281a8c89a3f31bcff

This example scrapes trail data from a website, extracting features, overview, and description sections into a structured hash. It uses Nokogiri to parse the HTML and XPath queries to locate the relevant headings and their adjacent content, cleaning the text by removing line breaks. The code demonstrates a straightforward scraping pattern for capturing semantic sections, though it does not include visualization logic or rendering libraries. The data source is a single trail page URL, and the output is a formatted description ready for further processing or display.

WWill Carter

57% match