Produces word frequences for any given sequence of text nodes

100%

Produces word frequences for any given sequence of text nodes

✓ Published0🌍 Public

Last edited Mar 23, 2015

Created on Mar 23, 2015

This visualization shows word frequencies extracted from a sequence of text nodes, displaying each unique word with its frequency count. The XQuery code collects text from the TEI-encoded source document, normalizes tokens by removing punctuation and lowercasing, then counts occurrences of each distinct word. It returns an ordered dictionary element with word-frequency pairs sorted in descending order. The example uses the XQuery 3.0 specification, including functions like `fn:tokenize`, `fn:distinct-values`, and `fn:count`, to process the remote XML data.

AI-generated description

Similar vizzes

Loading thumbnail…

This set of functions produces word frequencies for any given sequence of text nodes.

This example computes word frequencies from a sequence of text nodes and returns them as an ordered list of word elements. It first shows the frequency-ranked vocabulary by normalizing the input—converting to lowercase, stripping punctuation, and tokenizing—before counting occurrences of each distinct token. The code uses XQuery 3.0 with functions like `fn:tokenize`, `fn:distinct-values`, and `fn:count` to group and sort the results. The final output is an XML `<words>` element containing individual `<word>` elements with a `frequency` attribute, ordered from most to least frequent. The data source is the `//tei:l` elements from a TEI-encoded text.

CCliffordAnderson

90% match

Loading thumbnail…

For XQuery4Humanists

This example visualizes the frequency and distribution of words extracted from a TEI-encoded poem, processing the text to remove punctuation, normalize case, and tokenize it into a list. The visualization shows the resulting word list as a simple textual display, highlighting the raw output of the XQuery processing pipeline. The code uses XQuery 3.0 functions like `fn:tokenize`, `fn:lower-case`, and `fn:replace` to clean the data, pulling the source directly from a remote XML file hosted on GitHub. The rendering relies solely on the XQuery return, with no additional JavaScript or charting libraries involved.

CCliffordAnderson

80% match

Loading thumbnail…

Example from Programming4Humanists

This example visualizes word frequency in a text by processing the poem’s lines and filtering out common stopwords. It shows a ranked list of words by their occurrence count, displayed in descending order. The code uses XQuery 3.0 with functions like `fn:tokenize`, `fn:distinct-values`, and `fn:count` to compute frequencies, while reading the source text and stopword list from gist URLs. The rendering approach is a simple textual output of word elements, each carrying a `frequency` attribute, rather than a graphical chart.

CCliffordAnderson

77% match

Loading thumbnail…

Produces word frequency list for speakers in Much Ado about Nothing.

This example uses XQuery 3.0 with the TEI namespace to generate a per-speaker word frequency list from Shakespeare’s *Much Ado about Nothing*. It processes the TEI-encoded XML document, iterating over distinct speakers and counting each word’s occurrences within their spoken lines, then outputs a sequence of `<word>` elements with the speaker, type, count, and weighted frequency. The query relies on `fn:distinct-values`, `fn:count`, and an `order by` clause to rank terms.

CCliffordAnderson

74% match

Loading thumbnail…

Exploring your Collection

This visualization shows a collection of TEI-encoded texts by querying their titles and full-text content, highlighting matches for terms like “vin” or co-occurring words like “mal” and “je” within the same sentence. It first demonstrates how to list all titles in the collection, then filters those titles using XQuery Full-Text expressions via the `contains text` operator. The code uses the BaseX or eXist-db XQuery 3.0 engine, leveraging the `fn:collection()` function to access documents and the TEI namespace for element traversal, with no external visualization libraries—the output is plain text.

CCliffordAnderson

65% match

Loading thumbnail…

XQuery Full Text

This example demonstrates the evolution of text search in XQuery, from basic string matching to full-text querying with linguistic processing. It shows how `fn:contains` and `fn:matches` perform literal pattern matching, while the XQuery Full Text 3.1 features—`contains text`, `using stemming`, `ft:mark`, and the `score` clause—enable case-insensitive, stem-aware, ranked search results. The code queries a collection of TEI-encoded texts (`vwwp_tei`) and returns matched paragraphs, with scoring wrapped in XML output and string formatting via `format-number`.

CCliffordAnderson

64% match

Loading thumbnail…

XQuery Full-Text Examples

This example demonstrates XQuery Full-Text search and scoring over the TEI-encoded poems of *Les Fleurs du Mal*. It shows basic text matching with the `contains text` operator, then extends to counting results via `ft:count()`, highlighting matches with `ft:mark()`, extracting snippets with `ft:extract()`, and ranking hits by relevance using `ft:score()` with descending order. The final `search.xqy` combines scoring, marking, and base-URI display, filtering out a specific document. The code uses the XQuery 3.1 `=>` arrow operator for function chaining, and relies on the `fn:collection()` function to access the poem corpus.

CCliffordAnderson

62% match

Loading thumbnail…

facets

This example visualizes a faceted breakdown of book metadata, displaying each facet as a distinct element with its value and count. It shows the distribution of terms across the dataset before explaining the mechanism: the XQuery script uses `fetch:text` and `csv:parse` to load and structure the CSV data, then groups books by each specified field path from an external XML file. The `local:get_facet` function dynamically builds facet elements, ordering results by frequency. The visualization relies on the BaseX XQuery processor’s string and sequence functions, not a client-side library, and renders the output as structured XML data.

CCliffordAnderson

62% match