sf only supports request paging for ESRI’s hosted feature service, not for WFS

100%

sf only supports request paging for ESRI’s hosted feature service, not for WFS

✓ Published0🌍 Public

Last edited Sep 17, 2018

Created on Sep 17, 2018

This example compares pagination behavior in R’s `sf` package for two web service types. It demonstrates that while `sf` automatically pages through ESRI hosted feature services, fetching all records, it does not for WFS endpoints, where only the first batch of records is retrieved despite the presence of a `next` URL in the response. The analysis uses live API queries to BAG WFS and ArcGIS services, with code in R and visualizations rendered via R Markdown. The title and author metadata are shown at the top.

AI-generated description

Similar vizzes

Loading thumbnail…

R script om te demonstreren hoe je WFS paging kunt implementeren in R

This example shows how to retrieve all Dutch address objects (verblijfsobjecten) in the town of Zuidhorn from the BAG Web Feature Service (WFS) using paging to handle large result sets. The code first queries the server’s maximum page size via GetCapabilities, then counts matching features, and finally fetches them page by page using `startindex` while sorting by identifier. It uses the `httr`, `xml2`, and `sf` R packages to parse the WFS responses and convert the resulting GeoJSON into simple features, which are then mapped with the `tmap` package. The data source is the national georegister’s BAG WFS endpoint.

FFrieseWoudloper

68% match

Loading thumbnail…

ArcGIS Online hosted feature service in lezen in R

This example demonstrates how to read and visualize the Dutch national heritage register (Rijksmonumenten) from an ArcGIS Online hosted feature service. It shows the full workflow of querying the service's metadata, counting features, and paginating through all 64,020 records, then maps them with `tmap` and `sf`. The code uses the `httr` and `jsonlite` packages to construct URL requests and parse JSON, while `sf::st_read()` reads the GeoJSON response. It explicitly checks pagination support via the service’s `advancedQueryCapabilities` and explains an anomaly where the initial page returns more records than `maxRecordCount` suggests. The final map is rendered with `qtm()`, and summary statistics (min/max OBJECTID) are computed via the service’s `outStatistics` parameter.

FFrieseWoudloper

66% match

Loading thumbnail…

Adapted the script by Yonhah: https://github.com/yonghah/esri2sf/blob/master/R/esri2sf.R

This example demonstrates how to fetch GIS feature data from an ArcGIS REST server and convert it into simple features for spatial analysis in R. It shows a workflow that queries a specified layer, retrieves object IDs, and then pulls the corresponding attributes and geometries as GeoJSON. The code relies on the `httr` package for HTTP requests, `jsonlite` for parsing JSON responses, and `sf` for handling spatial data. It also includes a helper function to generate authentication tokens when the server requires login. The implementation uses the ArcGIS REST API's `query` endpoint to request data in batches of 500 IDs, ensuring efficient retrieval of large datasets.

FFrieseWoudloper

65% match

Loading thumbnail…

Parse WFS response in R

This example demonstrates how to inspect a WFS service’s capabilities and identify its supported output formats and available feature types, along with the server’s maximum result limit. The R script uses the `XML` package to parse the `GetCapabilities` response from the Dutch national georegister’s CBS boundary service, applying XPath queries to extract `ows:Value` texts and `wfs:Name` entries. It also reads the `CountDefault` constraint to determine the per-request cap. The output shows the parsed metadata as character and integer vectors, revealing the service’s configuration without fetching any actual geographic data.

FFrieseWoudloper

62% match

Loading thumbnail…

modified for voronoi

This example visualizes SFPD incidents by neighborhood in 2016, combining both a bar chart of average incidents and a line chart showing incident trends over time. Each neighborhood’s bar and corresponding line are linked, with mouseover highlighting the active district and click filtering to show only that district’s line. The code uses d3.nest() to aggregate data by district, d3.scaleBand for the bars, d3.scaleTime for the date axis, and d3 transitions for interactive animations. The data is loaded from the SF Open Data JSON API, and the visualization renders with SVG.

GGoomble

56% match

Loading thumbnail…

Homework 3

This example maps tree maintenance requests in San Francisco for February 2020. It shows a choropleth-style basemap of Analysis Neighborhoods with individual requests overlaid as green circular points, using a Conic Equal-Area projection. The code loads GeoJSON boundaries and streets via D3’s `d3.json`, queries the SF 311 Cases SODA API endpoint with date filters, and renders everything as SVG using `d3.geoPath` and D3 v5.

Pphemmati

55% match

Loading thumbnail…

[Working with spatial data](https://github.com/enjalot/wwsd)

This example demonstrates how to map geospatial data using d3.js projections. It renders a world map with a custom cylindrical projection and highlights two points with red circles, including one at San Francisco’s coordinates. The code uses `d3.geo.projection`, `d3.geo.path`, and `d3.geo.mercator`, along with TopoJSON to load world-110m GeoJSON data. The map and points are drawn as SVG elements, with the projection scale and translation set explicitly.

KKristinHenry

55% match

Loading thumbnail…

Map Practice HTML Starter

This example displays an interactive map centered on San Francisco using the ArcGIS API for JavaScript, with an “arcgis-light-gray” basemap loaded from ArcGIS services. The MapView is configured with a specific longitude, latitude, and zoom level to frame the initial view. The page relies on the ArcGIS `esri/Map` and `esri/views/MapView` modules, while a basic HTML structure and CSS ensure the map fills the viewport. A simple JavaScript console log statement demonstrates basic interactivity for developers.

AAndre J Denais

54% match