Get datasets/ressources from demo.data.gouv.fr

100%

Get datasets/ressources from demo.data.gouv.fr

✓ Published0🌍 Public

Last edited Nov 28, 2022

Created on Nov 28, 2022

This visualization shows the complete catalog of datasets and their associated resources harvested from the demo.data.gouv.fr API. It displays the aggregated collection of every resource linked to each dataset, compiled from all paginated API responses. The code uses a shell script with `curl` to repeatedly request pages of 500 datasets until the `next_page` field returns `null`, then pipes the results through `jq` to extract and compile all nested `resources[]` arrays from the combined JSON files. The final output is a flat JSON file containing every resource entry.

AI-generated description

Similar vizzes

Loading thumbnail…

Gist 349fc7fda8932252cbcb4ee8a0b605c8

This example tracks the availability and licensing of the French IGN’s BD TOPO® departmental datasets by organizing URLs for both December 2021 and March 2021 releases. It shows a structured index of geographic data files, with each entry linking to a specific departmental Shapefile resource. The visualization uses a data-driven list format, likely rendered with JavaScript’s `fetch` to parse the provided CSV or JSON and display the sorted URLs. It highlights the variation in resource IDs across departments and time periods, emphasizing the dataset’s scope without mapping or spatial rendering.

TThomasG77

64% match

Loading thumbnail…

Gist d64af23db4c1bd6bbacbe72ef137865e

This visualization shows the extraction and tabularization of French Business Tax Service (SIE) locations. It first filters the full public service dataset, downloaded as a JSON tarball via `wget`, using `jq` to select only SIE entries. It then validates the filtered results against the official website's paginated listing, scraped with `pup`. Finally, the code converts the filtered JSON into a simple CSV file using `jq` to output fields like id, name, and postal address, working within the Linux command-line environment.

TThomasG77

63% match

Loading thumbnail…

Consommation CSW Observatoire des territoires

This visualization catalogs the datasets available from the French government’s Observatoire des Territoires geospatial service. It displays a table of metadata—titles like “ZRR - Zone de revitalisation rurale” and “QPV - Quartiers prioritaires”—paired with their identifiers and direct URLs. Built with a Python script using the OWSLib library’s `CatalogueServiceWeb`, it queries the CSW endpoint, paginates through records, and exports the results to a CSV. The output is then presented in a Vue.js interface, showing the structured list of available territorial indicators.

TThomasG77

62% match

Loading thumbnail…

Gist edaa46d0ee945829befb88a9e719f0e0

This visualization maps the number of certified organic food operators across French administrative departments, using a choropleth-style representation to reveal regional disparities in organic agriculture density. The data is sourced from the Agence Bio public API, which is queried via a shell script that iterates through department codes. The script uses `curl` and `jq` to extract the `nbTotal` count for each department, storing results in a semicolon-delimited text file. The final map likely employs `d3.geoPath` for rendering the department boundaries, with color intensity or a similar visual encoding driven by the fetched counts.

TThomasG77

60% match

Loading thumbnail…

Gist c8b3e33ae90180e985646e1ef4876dfe

This example demonstrates how to convert tabular JSON data containing longitude and latitude fields into a GeoJSON FeatureCollection using the command-line tool jq, making it ready for map-based visualization. The dataset covers digital mediation locations in the Auvergne-Rhône-Alpes region of France, sourced from data.gouv.fr. The transformation maps each original record into a GeoJSON Feature, preserving properties like name, address, services, and accessibility conditions, while constructing Point geometry from the coordinate pair. The code includes a preview image showing the resulting spatial distribution of these locations, though the visualization itself uses no specific JavaScript mapping library or framework beyond the jq conversion process.

TThomasG77

57% match

Loading thumbnail…

Gist e6f4c2723682e0180ff0bbf59f417beb

This interactive map of French dams displays their locations as points across the country, with each point linking to a detailed information page. The visualization is built from a GeoJSON FeatureCollection of dam properties, including height, reservoir volume, river, and owner. The data was cleaned and enriched using shell scripting and the `jq` command-line tool, with the final map likely rendered using a library such as Leaflet or Mapbox. The code shows the use of `ogrinfo` and `ogr2ogr` for geospatial data processing and SQL queries to transform the attributes.

TThomasG77

57% match

Loading thumbnail…

Recipe to transform latest RNA data to parquet or download data (for 2nd case, uncomment line starting with #)

This example shows how to extract the two most recent RNA datasets from the French open-data platform data.gouv.fr and convert them into compressed Parquet files for efficient analysis. It uses the data.gouv.fr API to fetch dataset metadata, filtering resources by type and sorting by creation date to select the latest files. The scripts then leverage DuckDB’s `read_csv` function with the community `zipfs` extension to read CSV files directly from remote ZIP archives, and write the result to Parquet with Zstandard compression. Equivalent implementations are provided in Bash using `curl`, `jq`, and the DuckDB CLI, and in Python using the `duckdb` library and `urllib`.

TThomasG77

56% match

Loading thumbnail…

Gist 28a1d2e30c530c6a170ff5f68798b235

This example curates a set of GeoJSON-based specifications and extensions, organizing them by how they add keys, use multiple files, or serialize for streaming. It lists linked resources such as geojson-t, geocodejson-spec, geojson-ld, and the OGC Features API, alongside STAC and Mapbox simplestyle. It also covers the IMDF format for indoor data and the GeoJSON Text Sequences proposal, presenting a structured reference rather than a rendered map or interactive chart, with no code libraries or visualization APIs involved.

TThomasG77

56% match