Skip to main content
100%

Gist 288417

✓ Published0🌍 Public
Aamundo
Last edited Jan 28, 2010
Created on Jan 28, 2010

This visualization displays the frequency of every character in a text file, sorted from least to most common. The Python script reads the file’s contents, counts each Unicode character’s occurrences in a dictionary, then prints the character alongside its count. It uses the `codecs` module to handle UTF-8 output and standard file reading to load the source text. The result is a plain textual ranking, not a graphical chart, with each line showing a character and its frequency.

AI-generated description

Similar vizzes

Loading thumbnail…

Gist 285672

This example demonstrates a language identification system by modeling text as bigram frequencies. It shows the most common two-letter sequences from a given input text, sorted by frequency. The Python code builds a bigram model using `ngrams` and `bigrams` functions, counts occurrences with a `defaultdict`, and removes rare bigrams below a threshold. It relies on the `collections` module and `operator.itemgetter` for sorting. The program reads a UTF-8 text file from the command line and prints the top ten bigrams with their counts.

Aamundo
71% match
Loading thumbnail…

Gist 1305262

This visualization maps the distribution of Besemah-language text lines extracted from a source file. It uses Python’s `collections.Counter` to count the occurrence of each line, then renders the data as a visual plot, likely showing frequency or positional patterns. The code reads a UTF-8 encoded `Texts.txt`, splits it into lines, and filters for lines starting with `\tx` (excluding the bare marker), building a list of Besemah lines for analysis. The rendering approach is not specified in the visible code, but the example demonstrates text-data parsing and counting using standard Python libraries.

Aamundo
65% match
Loading thumbnail…

look up names of characters in text

This example maps the characters of UTF-8 text to their Unicode names. Reading input from standard input, the script decodes the text and iterates through each letter, using Python’s `unicodedata.name` to retrieve the official character name and printing it alongside the character, its code point in hexadecimal, and a Unicode escape sequence. Characters without a name are silently skipped. The output is written to standard output with UTF-8 encoding via `codecs.getwriter`.

Aamundo
65% match
Loading thumbnail…

letters.py - command line tool to look up the name of Unicode characters in a text

The tool reads UTF-8 text from standard input and prints each character’s Unicode name, its code point in hexadecimal, and a JSON-style escape sequence. It uses Python’s `unicodedata.name` to look up names, `sys.stdin.read` to capture input, and `codecs.getwriter` to ensure UTF-8 output. Characters without a defined name are skipped silently. The output is displayed as a line per character, showing the letter, name, hex code, and escaped form.

Aamundo
62% match
Loading thumbnail…

Gist 2116a7bda7ef9a6364f3

This example demonstrates how to use NLTK’s frequency distribution object to analyze word frequencies in the pre‑loaded text of Monty Python and the Holy Grail. It first displays the top 50 most frequent words, then guides the viewer through tasks that involve examining the raw text, modifying it, and rerunning the frequency calculation. A cumulative frequency plot is generated, and a list comprehension isolates words longer than five characters that occur at least five times, sorted alphabetically. The code relies on NLTK’s `FreqDist` and the `nltk.book` collection.

MMartiHearst
61% match
Loading thumbnail…

Gist af6ed0a95b476ea7f82b0576a93a2306

This visualization displays the 30 most common words from a dataset of cleaned captions, using a frequency distribution to show which terms appear most often. The code filters out common exclusions like "1," "2," and "3" before processing, then relies on the Natural Language Toolkit’s `FreqDist` to count word occurrences. A bar chart is generated with `matplotlib.pyplot`, where the horizontal axis lists the top words and the vertical axis shows their raw frequencies. The plot is sized at 14 by 6 inches for readability, and the resulting figure is displayed directly via `plt.show()`, with the source being an internal data frame of cleaned captions.

AArizonaTay
60% match
Loading thumbnail…

Gist 4be75194a32c761f2a20

This example demonstrates how to use NLTK's frequency distribution object to analyze word frequencies in the Monty Python and the Holy Grail text (text6). The code imports the NLTK book module, creates a FreqDist from the text, and displays the top 50 word-frequency pairs, revealing unexpected results. The notebook then poses tasks for modifying the text and generating cumulative frequency plots, while also showing list comprehensions to filter words by length and frequency. The analysis relies on NLTK's FreqDist and the pre-loaded text corpus from the nltk.book module.

MMartiHearst
60% match
Loading thumbnail…

Gist 8583392

This example displays the frequency of personal pronouns in the Brown Corpus news category as a crude text bar chart. Using NLTK, it loads the news texts, tokenizes them, and applies `FreqDist` to count lowercase pronoun occurrences. The output prints each pronoun followed by a row of asterisks, where every asterisk represents 20 occurrences, alongside the raw count. The visualization intentionally uses a simple, non-graphical format, showing relative frequencies such as “he” dominating with 642 mentions and “us” appearing only 13 times.

Aamundo
59% match