Gist ccc08dae693660d7aa1b8cf2708fd13d

100%

Gist ccc08dae693660d7aa1b8cf2708fd13d

✓ Published0🌍 Public

Last edited Nov 18, 2016

Created on Nov 18, 2016

This example demonstrates how to query and highlight text passages in the Victorian Women Writers Project TEI corpus using XQuery 3.1. It shows a progression from simple full-text searches for repeated terms to fuzzy matching via `ft:search` and `ft:extract`, and finally visualizes results by marking hits with `ft:mark` and segmenting them into tumbling windows. The code relies on BaseX’s full-text and windowing capabilities to extract and structure paragraph-level matches containing “garden” or “house.”

AI-generated description

Similar vizzes

Loading thumbnail…

Code snippets for XQuery Working Group (Text Mining at Scale)

This example demonstrates a text-mining workflow for querying the Victorian Women Writers Project corpus stored in a BaseX database, using XQuery and XPath Full Text 1.0. It walks through creating structured records from TEI XML, saving them to a new database, and running full-text searches with scoring, stemming, and thesaurus-based matching. The code exercises functions like `db:replace`, `ft:mark`, and `ft:extract` to highlight matching text, while also showing stop-word filtering and boolean operators for queries.

CCliffordAnderson

81% match

Loading thumbnail…

Gist 162dbae87c5cab9f59fd433e235bafb2

This example demonstrates how to extract and collate poems from the Victorian Women Writers Project, a corpus of TEI P5-encoded texts. It shows the process of filtering documents by genre, retrieving individual poems, and normalizing their text. The code uses XQuery 3.1 with the BaseX database and its `fn:collection`, `fn:doc`, and `fn:normalize-space` functions. It outputs the results as CSV using BaseX's serialization options, specifying comma separators and headers, while converting poem text to lowercase.

CCliffordAnderson

74% match

Loading thumbnail…

XQuery Full Text

This example demonstrates the evolution of text search in XQuery, from basic string matching to full-text querying with linguistic processing. It shows how `fn:contains` and `fn:matches` perform literal pattern matching, while the XQuery Full Text 3.1 features—`contains text`, `using stemming`, `ft:mark`, and the `score` clause—enable case-insensitive, stem-aware, ranked search results. The code queries a collection of TEI-encoded texts (`vwwp_tei`) and returns matched paragraphs, with scoring wrapped in XML output and string formatting via `format-number`.

CCliffordAnderson

74% match

Loading thumbnail…

XQuery Full-Text Examples

This example demonstrates XQuery Full-Text search and scoring over the TEI-encoded poems of *Les Fleurs du Mal*. It shows basic text matching with the `contains text` operator, then extends to counting results via `ft:count()`, highlighting matches with `ft:mark()`, extracting snippets with `ft:extract()`, and ranking hits by relevance using `ft:score()` with descending order. The final `search.xqy` combines scoring, marking, and base-URI display, filtering out a specific document. The code uses the XQuery 3.1 `=>` arrow operator for function chaining, and relies on the `fn:collection()` function to access the poem corpus.

CCliffordAnderson

73% match

Loading thumbnail…

Exploring your Collection

This visualization shows a collection of TEI-encoded texts by querying their titles and full-text content, highlighting matches for terms like “vin” or co-occurring words like “mal” and “je” within the same sentence. It first demonstrates how to list all titles in the collection, then filters those titles using XQuery Full-Text expressions via the `contains text` operator. The code uses the BaseX or eXist-db XQuery 3.0 engine, leveraging the `fn:collection()` function to access documents and the TEI namespace for element traversal, with no external visualization libraries—the output is plain text.

CCliffordAnderson

69% match

Loading thumbnail…

For XQuery4Humanists

This example visualizes the frequency and distribution of words extracted from a TEI-encoded poem, processing the text to remove punctuation, normalize case, and tokenize it into a list. The visualization shows the resulting word list as a simple textual display, highlighting the raw output of the XQuery processing pipeline. The code uses XQuery 3.0 functions like `fn:tokenize`, `fn:lower-case`, and `fn:replace` to clean the data, pulling the source directly from a remote XML file hosted on GitHub. The rendering relies solely on the XQuery return, with no additional JavaScript or charting libraries involved.

CCliffordAnderson

68% match

Loading thumbnail…

XQuery Full Text

This example demonstrates how XQuery 3.1 can perform full-text search and fuzzy string matching directly within a query. It shows four distinct text-processing capabilities: proximity-based word matching using the `contains text` operator with distance constraints, stop-word filtering, Levenshtein distance calculation via the `strings:levenshtein` function, and phonetic comparison using `strings:soundex`. The code relies on the XQuery standard library functions for string operations rather than external visualization libraries, highlighting the language's built-in text analytics power.

CCliffordAnderson

67% match

Loading thumbnail…

XPath Examples - Mellon Institute

This example demonstrates how XPath queries navigate and extract specific content from a TEI-encoded document of the Mellon Institute at Vanderbilt. It shows the progression from simple absolute paths to descendant-or-self axes, then to predicate-based filtering, and finally to more complex relational paths. The code uses the XPath API to select titles, names, sex attributes, and speaker-related paragraphs, referencing the updated TEI Guidelines for the sex element. The example is presented as a gist authored by CliffordAnderson, with the source data being the structured XML markup of the institute’s records, illustrating query patterns for text extraction and attribute matching.

CCliffordAnderson

65% match