Skip to main content
100%

unescape hex entities in html

✓ Published0🌍 Public
Aamundo
Last edited May 14, 2011
Created on May 14, 2011

This example demonstrates how to unescape HTML entities using Python's `sgmllib` and `htmlentitydefs` modules. It converts named and numeric character references (like `&`, `©`) into their corresponding Unicode characters, with special handling for common typographic entities (e.g., `’`, `©`) that are mapped to ASCII approximations when the `UNICODE_SNOB` flag is disabled. The code includes support for hex and decimal character references, handles unknown entities gracefully, and integrates entity unescaping into HTML attribute parsing. A companion `openanything.py` module provides a flexible HTTP/file/string input stream opener.

AI-generated description

Similar vizzes

Loading thumbnail…

fussing with UTF-16 surrogate encoding in Javascript

This example demonstrates how JavaScript encodes Unicode code points above U+FFFF into UTF-16 surrogate pairs, using functions like `escapeUTF16` and `makeSurrogate` to convert a code point such as U+1F339 (a rose emoji) into the escaped `\ud83c\udf39` sequence. The code implements the surrogate math from the Wikipedia UTF-16 specification, applying bitwise shifts and masking to derive lead and trail surrogates for supplementary planes. It then verifies the result by parsing the escaped string with `JSON.parse` and comparing it to the literal surrogate pair. The source is a standalone gist with no external libraries or data visualization dependencies.

RRandomEtc
53% match
Loading thumbnail…

Gist 3679500

This example demonstrates a Unicode character name lookup error and its resolution through Python’s `unicodedata` module. It shows that passing a two-character string like "ɬʼ" to `unicodedata.name` raises a `TypeError`, while each individual character—"ɬ" and "ʼ"—successfully returns its official Unicode name. The code uses the `unicodedata.name` API interactively in a Python shell, with the traceback illustrating the failure mode and the subsequent successful calls. The rendering approach is plain text output from the Python interpreter, highlighting the module’s requirement for a single-character input.

Aamundo
51% match
Loading thumbnail…

Extra escapey JSON encoding for node.js

This example demonstrates how to encode JavaScript objects into JSON strings with extra escaping for safety and compatibility. The code defines a function, `escapedStringify`, which wraps the native `JSON.stringify` to apply three additional transformations: escaping forward slashes as `\/`, converting angle brackets to uppercase Unicode escape sequences, and converting all characters in the `\u007f` to `\uffff` range into lowercase hex escapes. The implementation uses the `JSON` stringify API and regular expressions with callback functions to perform the character replacements. The example’s data source is the Gist’s own JSON test input, and the rendering approach is purely textual output.

RRandomEtc
51% match
Loading thumbnail…

futzing with python encodings.

This example demonstrates how Python 2.7 handles Unicode strings when serializing to and from JSON. It shows a dictionary of Ethiopic syllable names being written to a file with `json.dumps`, which escapes the characters into `\u1234`-style sequences, and then reloaded with `json.load` to recover the original Unicode objects. The process highlights the round-trip fidelity of the `json` module, even though the intermediate file appears “escape-y,” and the code also uses `unicodedata.name` to fetch character names.

Aamundo
51% match
Loading thumbnail…

Gist 45db9d716671d0e53ccdd33370f72d69

This example displays a reference table for ANSI escape sequences, organizing text attributes, foreground colors, and background colors into three separate sections. The data originates from a Markdown file that lists each escape code alongside its corresponding visual effect, such as bold, underline, or specific color values like Light Cyan. The rendering relies on standard HTML tables, with no JavaScript libraries or visualization APIs involved, presenting the information as static, readable documentation rather than an interactive graphic.

Aamazingandyyy
50% match
Loading thumbnail…

look up names of characters in text

This example maps the characters of UTF-8 text to their Unicode names. Reading input from standard input, the script decodes the text and iterates through each letter, using Python’s `unicodedata.name` to retrieve the official character name and printing it alongside the character, its code point in hexadecimal, and a Unicode escape sequence. Characters without a name are silently skipped. The output is written to standard output with UTF-8 encoding via `codecs.getwriter`.

Aamundo
49% match
Loading thumbnail…

Gist 6c1ae0e4fff5fb8d4704

This example shows a text-parsing utility that cleans and tokenizes a raw string into lowercase words. It first replaces common punctuation sequences like dashes and double quotes with spaces, then uses a regular expression with Unicode flags to extract word tokens, allowing characters such as `@`, `#`, `&`, and hyphens. The code relies on Python’s standard `re` module and basic string methods, with no external visualization libraries or rendering pipeline. The output is a list of normalized words, illustrating a preprocessing step rather than a visual chart or graph.

Aandyreagan
47% match
Loading thumbnail…

Serializes disambiguated entities to CSV

This example extracts named entities from a web-accessible text and serializes only those with geographic coordinates into a CSV file. It uses the Alchemy API’s `URLGetRankedNamedEntities` endpoint via an HTTP POST request, then filters the returned XML for entities containing a `geo` field. The code constructs a `<csv>` element with each record’s text, longitude, and latitude, and outputs the result using BaseX’s `csv:serialize` function. The data source is a raw text file from GitHub, and the output is a clean CSV suitable for mapping.

CCliffordAnderson
46% match