Blue Mountain Project - Dividing Up Languages

100%

Blue Mountain Project - Dividing Up Languages

✓ Published0🌍 Public

Last edited Mar 31, 2017

Created on Mar 30, 2017

This example shows how XQuery processes TEI-encoded periodical documents from the Blue Mountain Project, splitting them into individual articles for database storage. The code traverses document collections with `fn:collection` and `fn:doc`, prunes unwanted elements and attributes using the `copy`/`modify` XQuery Update Facility, and reconstructs TEI structures. It uses the `db:create` function from the eXist-db API to build a new database collection from the transformed articles, demonstrating a pipeline for dividing source documents into discrete, queryable units.

AI-generated description

Similar vizzes

Loading thumbnail…

XQuery for Partitioning the Blue Mountain Project

This example demonstrates a pipeline for cleaning, partitioning, and exporting articles from the Blue Mountain Project’s TEI transcriptions into language-specific databases. It shows how XQuery 3.1 scripts transform raw periodical XML by removing facsimile and hyphenation artifacts, splitting documents into individual articles, and grouping them by `mainLang` attributes into new databases. The workflow then exports French-language texts as plain .txt files, and R code using the `tm` and `SnowballC` libraries performs text mining, including term-document matrices and stemming.

CCliffordAnderson

85% match

Loading thumbnail…

XQuery Samples for Blue Mountain Project

This example shows a sequence of XQuery scripts that analyze the language metadata of TEI-encoded journals from the Blue Mountain Project, a digital archive of avant-garde publications. The scripts query a collection called `bluemountain-transcriptions` using the `fn:collection` function, counting documents, extracting distinct languages from `tei:langUsage`, and identifying journals with multiple `tei:textLang/@mainLang` attributes. Later scripts partition documents by language, using `db:create` to store French texts in a new database, and verify the results by listing the URIs of the partitioned files. The code relies on the XQuery 3.1 standard and the eXist-db database API for collection access and database creation.

CCliffordAnderson

85% match

Loading thumbnail…

XQuery Blue Mountain Project - Part III

This example shows a pipeline for transforming a single TEI XML document from the Blue Mountain Project—a digitized 1920 issue of the French journal *Action*—into clean, article-level TEI files. The first script removes facsimile elements, end-hyphenation markers, and line breaks, replacing `<lb>` elements with spaces. A second script extracts metadata and article content into a fresh TEI template, while a third builds individual TEI files for each article. The code uses XQuery 3.1 with the `fn:doc` API for document access and node operations like `copy`, `modify`, and `replace node`.

CCliffordAnderson

84% match

Loading thumbnail…

Code snippets for XQuery Working Group (Text Mining at Scale)

This example demonstrates a text-mining workflow for querying the Victorian Women Writers Project corpus stored in a BaseX database, using XQuery and XPath Full Text 1.0. It walks through creating structured records from TEI XML, saving them to a new database, and running full-text searches with scoring, stemming, and thesaurus-based matching. The code exercises functions like `db:replace`, `ft:mark`, and `ft:extract` to highlight matching text, while also showing stop-word filtering and boolean operators for queries.

CCliffordAnderson

67% match

Loading thumbnail…

For XQuery4Humanists

This example visualizes the frequency and distribution of words extracted from a TEI-encoded poem, processing the text to remove punctuation, normalize case, and tokenize it into a list. The visualization shows the resulting word list as a simple textual display, highlighting the raw output of the XQuery processing pipeline. The code uses XQuery 3.0 functions like `fn:tokenize`, `fn:lower-case`, and `fn:replace` to clean the data, pulling the source directly from a remote XML file hosted on GitHub. The rendering relies solely on the XQuery return, with no additional JavaScript or charting libraries involved.

CCliffordAnderson

65% match

Loading thumbnail…

Gist 162dbae87c5cab9f59fd433e235bafb2

This example demonstrates how to extract and collate poems from the Victorian Women Writers Project, a corpus of TEI P5-encoded texts. It shows the process of filtering documents by genre, retrieving individual poems, and normalizing their text. The code uses XQuery 3.1 with the BaseX database and its `fn:collection`, `fn:doc`, and `fn:normalize-space` functions. It outputs the results as CSV using BaseX's serialization options, specifying comma separators and headers, while converting poem text to lowercase.

CCliffordAnderson

65% match

Loading thumbnail…

Query across collections in ExistDB

This example shows how a single XQuery query can aggregate and expose metadata from multiple Shakespearean text collections stored in an eXist-db database. The query uses the `fn:collection()` function to traverse the `db/shakespeare` path, selecting all `tei:seriesStmt` elements from the TEI namespace, which describe series-level publication information. The visualization renders the resulting XML as a structured graph, with nodes and edges built from the query output using D3.js’s `d3.forceSimulation` for layout. The concrete approach relies on eXist-db’s native XQuery engine to fetch and return the TEI data, which is then parsed and bound to visual elements, demonstrating a direct pipeline from database query to interactive graphic.

CCliffordAnderson

64% match

Loading thumbnail…

XQuery Working Group Challenge

This example transforms the PROIEL treebank’s Latin New Testament XML into a sequence of verse elements, each tagged with its citation and concatenated token forms. It fetches the remote XML via `fn:doc`, extracts distinct citation parts, and filters tokens by matching `@citation-part` to build structured verses. The code uses XQuery 3.1’s element constructors and `fn:data` to output text, demonstrating a direct pipeline from hierarchical treebank data to flat verse-like text.

CCliffordAnderson

64% match