example random access formats

100%

example random access formats

✓ Published0🌍 Public

Last edited Aug 27, 2024

Created on Dec 15, 2023

This example compares random-access file formats for geospatial and tabular data, using a table that evaluates Nimble, Lance v2, Apache Avro, Parquet, ORC, SQLite, Arrow, NetCDF, Zarr, FlatGeoBuf, and PMTiles across criteria like indexing, sharding, compression, and performance. The visualization, built with D3.js, renders each format as a row with colored cells encoding metrics, while hover interactions reveal details via tooltips. It draws from a Markdown source file by andrewxhill, highlighting trade-offs between formats for Basin-specific use cases.

AI-generated description

Similar vizzes

Loading thumbnail…

D3 data formats

D3 data formats is a gallery of examples that demonstrates how D3 handles diverse dataset formats. It shows both tabular formats like CSV, with examples including stock prices, population demographics, and car specifications, and hierarchical or relational JSON structures like nested node trees and network graphs. The examples showcase D3's parsing methods for these formats, with various charts such as bar , parallel coordinate, and geographic visualizations.

RRichMorin

61% match

Loading thumbnail…

test

This example uses D3.js to visualize the contents of SAP kernel archive (SAR) files. The visualization displays a brown rectangle as a backdrop and a row of small purple squares, one for each unique SARFILE value, positioned along the x-axis. The code loads a CSV dataset containing file components and their sizes, then uses d3.nest() to group the data by SARFILE. A nested data join appends rectangles for each group, though the current implementation primarily shows the grouping structure rather than encoding size or other quantitative values. The example serves as a basic demonstration of data loading, nesting, and SVG binding in D3.

CCBasis

60% match

Loading thumbnail…

Gist 6114786

This example implements a private torque-style time-series visualization for geospatial data using PostgreSQL and PostGIS. It defines custom SQL functions that aggregate point features into web-Mercator grid cells, grouping counts by time steps and returning arrays of values and dates for rendering. The code uses `ST_SnapToGrid`, `CDB_XYZ_Resolution`, and `CDB_XYZ_Extent` to tile data at a given zoom level, with two variants: a standard response for instantaneous counts and a cumulative response that includes expiration dates for each cell. A metadata function returns the spatial bounds and time range from the source table, supporting both timestamped and numeric columns.

Aandrewxhill

59% match

Loading thumbnail…

Identifying 3 Datasets

This example identifies three datasets by displaying their descriptive names and metadata in large text. It shows the dataset titles—Baseball Standard Hitting, Wayne Gretzky Goals, and Chess Federation Transfers—along with their file sizes, row counts, and column counts. The code loads each CSV from a remote URL using `d3.csv`, then formats the data with `d3.csvFormat` to calculate size. The results are appended as separate spans inside a pre element, presenting the information in a clear, text-based layout.

PPatrick-Houlihan

58% match

Loading thumbnail…

Loading and Parsing Arrow Data

This example demonstrates the loading and parsing of Apache Arrow data in the browser. It fetches a remote `.arrow` file, parses it with `Arrow.Table.from`, and displays summary statistics—including file size, row count, column count, and chunk count—in a large `<pre>` element. The code highlights the schema and performs a filtered query using `Arrow.predicate.col('userName').eq('az')`, while relying on `d3.sum` to aggregate chunk byte lengths and `d3` for general utilities.

Tt829702

58% match

Loading thumbnail…

Loading data with D3

This example demonstrates how to load and inspect a remote CSV dataset using D3. It fetches a tidy version of the Anscombe’s quartet from a GitHub gist and displays three summary metrics in large text: the file size in kilobytes, the number of rows, and the number of columns. The code uses `d3.csv` to asynchronously parse the data, `d3.csvFormat` to calculate the raw size, and the `data.length` and `data.columns.length` properties to report the dataset’s dimensions.

Rrvdv

57% match

Loading thumbnail…

Fork of Fork of Fork of Data Table Summary

This example displays a quick statistical summary of a diabetes survey dataset, showing the total row count, column count, and file size in kilobytes, followed by a preview of the first ten rows in JSON format. It uses D3 v5’s `csv` method to load the external data and `csvFormat` to compute its size, while the document body is styled with custom CSS that includes a khaki background, a GIF image, and dotted borders. The SVG in the HTML contains a background image and links to the raw data file.

VVineela Reddy

57% match

Loading thumbnail…

Ramen Rating

This example displays a summary of a ramen-rating dataset, reporting its approximate file size in kilobytes, number of rows, and number of columns in large text. It loads the CSV from a GitHub gist using `d3.csv`, then formats the parsed data with `d3.csvFormat` to measure its size. The code also includes commented alternatives using `fetch`, `async/await`, and `d3.csvParse`, though only the primary `d3.csv` path runs. The visualization is minimal, focusing on data loading and parsing rather than graphical encoding.

Hhotdoujiang

57% match