Skip to main content
100%

Gist 8583392

✓ Published0🌍 Public
Aamundo
Last edited Jan 23, 2014
Created on Jan 23, 2014

This example displays the frequency of personal pronouns in the Brown Corpus news category as a crude text bar chart. Using NLTK, it loads the news texts, tokenizes them, and applies `FreqDist` to count lowercase pronoun occurrences. The output prints each pronoun followed by a row of asterisks, where every asterisk represents 20 occurrences, alongside the raw count. The visualization intentionally uses a simple, non-graphical format, showing relative frequencies such as “he” dominating with 642 mentions and “us” appearing only 13 times.

AI-generated description

Similar vizzes

Loading thumbnail…

This is a simplistic comparison of pronoun frequencies in (a) the Brown corpus under the 'news' category and (b) the whole of the Reuters corpus.

This visualization compares pronoun frequency distributions between the Brown corpus news category and the entire Reuters corpus using simple text-based star bars. The code loads both corpora via the NLTK `brown` and `reuters` modules, computes `FreqDist` objects for lowercase words, and prints a row per pronoun where each star represents a fixed count (10 for Brown, 200 for Reuters) followed by the raw frequency. The output reveals stark contrasts, such as "it" and "its" dominating Reuters while "he" and "his" are more prominent in Brown news, with zero occurrences of "I" in both datasets.

Aamundo
76% match
Loading thumbnail…

Example from Programming4Humanists

This example visualizes word frequency in a text by processing the poem’s lines and filtering out common stopwords. It shows a ranked list of words by their occurrence count, displayed in descending order. The code uses XQuery 3.0 with functions like `fn:tokenize`, `fn:distinct-values`, and `fn:count` to compute frequencies, while reading the source text and stopword list from gist URLs. The rendering approach is a simple textual output of word elements, each carrying a `frequency` attribute, rather than a graphical chart.

CCliffordAnderson
61% match
Loading thumbnail…

Gist 2116a7bda7ef9a6364f3

This example demonstrates how to use NLTK’s frequency distribution object to analyze word frequencies in the pre‑loaded text of Monty Python and the Holy Grail. It first displays the top 50 most frequent words, then guides the viewer through tasks that involve examining the raw text, modifying it, and rerunning the frequency calculation. A cumulative frequency plot is generated, and a list comprehension isolates words longer than five characters that occur at least five times, sorted alphabetically. The code relies on NLTK’s `FreqDist` and the `nltk.book` collection.

MMartiHearst
61% match
Loading thumbnail…

Gist 4be75194a32c761f2a20

This example demonstrates how to use NLTK's frequency distribution object to analyze word frequencies in the Monty Python and the Holy Grail text (text6). The code imports the NLTK book module, creates a FreqDist from the text, and displays the top 50 word-frequency pairs, revealing unexpected results. The notebook then poses tasks for modifying the text and generating cumulative frequency plots, while also showing list comprehensions to filter words by length and frequency. The analysis relies on NLTK's FreqDist and the pre-loaded text corpus from the nltk.book module.

MMartiHearst
60% match
Loading thumbnail…

Gist 288417

This visualization displays the frequency of every character in a text file, sorted from least to most common. The Python script reads the file’s contents, counts each Unicode character’s occurrences in a dictionary, then prints the character alongside its count. It uses the `codecs` module to handle UTF-8 output and standard file reading to load the source text. The result is a plain textual ranking, not a graphical chart, with each line showing a character and its frequency.

Aamundo
59% match
Loading thumbnail…

Gist af6ed0a95b476ea7f82b0576a93a2306

This visualization displays the 30 most common words from a dataset of cleaned captions, using a frequency distribution to show which terms appear most often. The code filters out common exclusions like "1," "2," and "3" before processing, then relies on the Natural Language Toolkit’s `FreqDist` to count word occurrences. A bar chart is generated with `matplotlib.pyplot`, where the horizontal axis lists the top words and the vertical axis shows their raw frequencies. The plot is sized at 14 by 6 inches for readability, and the resulting figure is displayed directly via `plt.show()`, with the source being an internal data frame of cleaned captions.

AArizonaTay
59% match
Loading thumbnail…

Gist 285672

This example demonstrates a language identification system by modeling text as bigram frequencies. It shows the most common two-letter sequences from a given input text, sorted by frequency. The Python code builds a bigram model using `ngrams` and `bigrams` functions, counts occurrences with a `defaultdict`, and removes rare bigrams below a threshold. It relies on the `collections` module and `operator.itemgetter` for sorting. The program reads a UTF-8 text file from the command line and prints the top ten bigrams with their counts.

Aamundo
57% match
Loading thumbnail…

Gist fbc8e33e01b5be01bc6c1ab2d1d08cfc

The visualization displays the 30 most frequently occurring words from a set of cleaned Instagram captions, plotted as a bar chart that ranks terms by raw count. It shows a sharp drop-off in frequency after the top few words, highlighting the long-tail distribution common in text data. The chart is generated using Python’s matplotlib, with the caption data loaded into a pandas DataFrame and tokenized via the Natural Language Toolkit (nltk). Frequencies are computed with `nltk.FreqDist`, and the top 30 entries are selected for plotting, with a filter excluding the characters ‘1’, ‘2’, and ‘3’ from the hashtag tokens. The figure is sized at 14 by 6 inches for readability.

AArizonaTay
56% match