Gist 8be3539eabe0a1c2e07e749fb3ee6372

100%

Gist 8be3539eabe0a1c2e07e749fb3ee6372

✓ Published0🌍 Public

Last edited Mar 10, 2022

Created on Mar 11, 2022

This example compares the performance of spatial joins using Dask-GeoPandas, PostGIS, and GPU-based RAPIDS.AI. It downloads Philadelphia parking violation data from CARTO and neighborhood shapefiles, then benchmarks how quickly Dask-GeoPandas processes the spatial join on a local cluster with eight workers. The notebook uses `dask_geopandas`, `dask.dataframe`, and `distributed.Client` to set up parallel processing. It reproduces Paul Ramsey's original benchmark to evaluate Dask-based execution speed against the other technologies.

AI-generated description

Similar vizzes

Loading thumbnail…

Gist 9bd5ca69fc039cff50383b3a3459858b

This example shows how to render a spatial distribution of data points on a map using D3.js. It uses `d3.geoPath` to draw geographic boundaries and `d3.forceSimulation` to position overlapping points, while Canvas `getImageData` is used to read pixel data for collision detection. The visualization reads from a PGP-encrypted text file, suggesting the underlying dataset is not directly accessible. The code relies on D3’s selection and transition APIs to animate point movements, and it appears to use a projection to convert latitude and longitude coordinates into screen positions. The result is an interactive scatterplot overlaid on a map, with points dynamically adjusting to avoid overlap.

CCliffordAnderson

58% match

Loading thumbnail…

Gist 05f4cffac50217bd0c33a538cb013563

This example visualizes geographic routing and geocoding workflows in R, showing how spatial data can be processed and mapped. It installs and loads packages for text mining, word clouds, and interactive map viewing, including `ggplot2`, `tm`, `wordcloud`, and `RColorBrewer` for static and corpus-based visualizations. The code also integrates the `photon` and `osrm` packages via `devtools` to access geocoding and routing APIs, enabling point-and-route calculations. The visualization pipeline combines spatial operations with text analytics, demonstrating a multi-step data enrichment and mapping process.

RRCura

57% match

Loading thumbnail…

Gist 9ea11dbcc52b4bb1c048

This example shows performance analysis for a data engineering capstone project, comparing a legacy Python log parser against a proposed Scala implementation on Spark and Mesos. The visualization tracks transfer metrics from ASCP log data, specifically examining throughput and packet rates. Using d3.js for charting, it evaluates how efficiently the new streaming solution handles regex parsing of unstructured logs. The project also demonstrates integration with Redis for persistent storage and FaspStream for live data ingestion, with the D3 visualizations presenting benchmark results from test log datasets.

BBBischof

57% match

Loading thumbnail…

Gist 652595e55960a8e04a29

This example visualizes the spatial relationships between metropolitan statistical areas and their constituent counties, townships, and other administrative geometries. The code first builds a combined geometry table using SQL, merging overlapping regions across multiple spatial layers while excluding special cases like Boston. It then renders these shapes using D3.js, likely leveraging `d3.geoPath` for projection and canvas or SVG drawing. The query explicitly handles hierarchical and overlapping geographies, prioritizing township-level detail where available and falling back to county unions for other areas. The final visualization shows how different government boundaries interlock within U.S. metropolitan regions, with the SQL preprocessing ensuring no duplicated or missing polygons.

CCaged

57% match

Loading thumbnail…

just a bookmark of random psql queries.

This example visualizes spatial relationships between neighborhoods, city blocks, and demographic data in Portland and Laurelhurst through a series of SQL queries. The code shows how geographic joins and intersections are performed using PostGIS functions like `ST_Intersects`, combining building footprints, block polygons, and census block-group data. The queries calculate race-based percentages, such as percent white and percent black, from census fields like `h7x002` and `h7x003`, while filtering for specific places and positive population counts. The gist demonstrates iterative query building for choropleth-style analysis, revealing how raw geographic and tabular data are merged to support subsequent mapping or charting in a visualization tool.

CCaged

57% match

Loading thumbnail…

Comparing the performances of various DBMS using dplyr for large-ish data

This example compares the execution times of data manipulation operations across different database management systems using the `dplyr` and `dbplyr` R packages. It benchmarks a `group_by` with `summarise` and a `left_join` with `mutate` on a 50-million-row tibble, running the same queries against in-memory data frames, SQLite databases (in-memory and file-based), and PostgreSQL. The code uses `system.time` to measure the elapsed user and system times for each operation, recording results in a benchmark summary table. The visualization highlights performance differences across database backends for typical data wrangling tasks.

RRCura

57% match

Loading thumbnail…

Query remote Geoparquet in browser

This example demonstrates querying a remote GeoParquet file directly from a web browser using DuckDB-Wasm. The interactive map displays French priority neighborhoods (QPVs) and identifies which one contains a specific geographic point (2.389798, 48.909514). It uses DuckDB-Wasm’s SQL engine with the spatial extension to run an `ST_contains` query, filtering results by geometric intersection. The workflow converts the matched polygons to GeoJSON via the GDAL driver and exports them as a downloadable file. The dataset was prepared from a government GeoJSON source using DuckDB and gpio utilities.

TThomasG77

56% match

Loading thumbnail…

Gist 8f728d205de3c03b7c142233a826e3ab

This example displays a WebGL heatmap of a large simulated point cloud centered on Paris, using 100,000 generated longitude and latitude coordinates. It shows density distribution through a glowing overlay on a dark CartoDB.DarkMatter tile map. The visualization is rendered with the `leaflet` and `leaflet.extras` R packages, specifically `addWebGLHeatmap`, which leverages WebGL for efficient GPU-accelerated rendering. The data is produced via `rnorm` and `sample_n` from `dplyr`, highlighting performance with large spatial datasets.

RRCura

56% match