[注音符号字母转换] #string

100%

[注音符号字母转换] #string

✓ Published0🌍 Public

Last edited Jan 25, 2019

Created on Jan 14, 2019

This example demonstrates how to normalize Unicode text that contains accented or composite characters into plain ASCII, showing the transformation before and after processing. It uses Python’s `unicodedata` module, specifically the `normalize` function with `NFKD` and `NFD` forms, followed by encoding to ASCII with the `'ignore'` error handler, or by using a dictionary of combining characters with `translate` to strip diacritical marks. The code includes two methods: one that removes non-ASCII characters entirely, and another that preserves them while eliminating accent marks, with comments explaining the behavior for both Python 2 and 3.

AI-generated description

Similar vizzes

Loading thumbnail…

Normalizer

This example demonstrates a string normalization function that converts accented and special characters into plain ASCII equivalents. It builds a character mapping from two parallel strings, then processes each input character, replacing matches with their mapped counterparts and lowercasing the final result. The implementation relies on standard JavaScript string methods such as `charAt`, `hasOwnProperty`, `join`, and `toLowerCase`. The code is presented as a standalone JavaScript function, with no external libraries or data sources involved, showing the raw logic behind text sanitization in a compact form.

LLuisSevillano

61% match

Loading thumbnail…

[中文标点转英文] #string

This example demonstrates a Python utility that converts Chinese punctuation marks into their English equivalents in a given string. The function `punc_chinese2english` builds translation tables using the built-in `str.maketrans` method, mapping a set of characters such as full-width commas, periods, and quotation marks to standard ASCII punctuation. It applies this mapping via the string `translate` method, returning the converted text. The code explicitly lists the Chinese and English punctuation pairs, making the transformation rule clear and easy to modify.

SShawn91

55% match

Loading thumbnail…

QGIS Function to make strings ascii only

This example demonstrates a custom QGIS function that converts place names into lowercase ASCII-only strings, replacing spaces with hyphens and translating accented characters like ß, à, and ñ to their closest ASCII equivalents. The function, defined with the `@qgsfunction` decorator and grouped under 'Custom', uses Python’s string methods `lower()`, `replace()`, and `translate()` with a manually defined `ascii_dict` mapping Unicode code points to replacement strings. It is designed for use in QGIS expression engines, taking a string input and returning the cleaned version. The code also includes a commented-out alternative using `encode('ascii', 'asciify')`, but the active path relies entirely on the translation dictionary.

GGeoWill

55% match

Loading thumbnail…

[create_mapping_for_normalization]将大量同义词转换为映射表，如 ibm,国际商业机器公司,ibm中国转换为 {'国际商业及其公司':'ibm', 'ibm中国':'ibm'} #dict

This example shows a Python utility that converts a plain-text list of synonym groups into a normalization mapping dictionary, e.g., turning "ibm,国际商业机器公司,ibm中国" into `{'国际商业及其公司':'ibm', 'ibm中国':'ibm'}`. The function `create_mapping_for_normalization` reads either a file path or a list, splits each line by a configurable separator, and uses a `key` function to designate the standard term among each group. It optionally skips duplicate words to avoid overwriting existing mappings. The included test demonstrates the process with sample data containing company names in multiple languages. The code relies solely on Python’s standard library, using built-in file I/O and data structures.

SShawn91

53% match

Loading thumbnail…

[print_unicode] python2 下在命令行中正常打印嵌套在 dict/list 内的 unicode 字符 #python #string

This example shows a Python 2 utility function that makes nested Unicode characters inside dictionaries and lists print correctly to the command line. The function `print_uni` takes any string `s`, applies `repr` to capture its escaped form, and then decodes that representation using `"unicode-escape"` to reveal the actual Unicode glyphs. It relies on the built-in `repr` function and the string `decode` method, demonstrating a workaround for Python 2’s default ASCII-based printing of container structures. The code is a standalone snippet from a gist by Shawn91, focusing on a common debugging pain point.

SShawn91

52% match

Loading thumbnail…

Gist 75454

This example demonstrates string manipulation utilities in Objective-C, converting camelCase or mixed-case strings into either underscore-separated or dash-separated formats. The code defines an NSString category with `underscore` and `dasherize` methods, which internally call a private `normalizeWith:` method that iterates over each character, detects uppercase letters and existing delimiters, and inserts the chosen separator while preserving the original text. The implementation uses NSCharacterSet, NSMutableString, and unichar APIs to perform character-by-character processing, ultimately returning a lowercase version of the transformed string.

CCaged

48% match

Loading thumbnail…

charsethero : convert mixed utf-8 and iso-latin content to utf-8

This example demonstrates a command-line Perl script that converts mixed UTF-8 and ISO 8859-1 encoded text into a single UTF-8 stream. It reads from standard input, processes each line, and outputs the converted result. The core logic uses regular expressions to identify multi-byte UTF-8 sequences and single-byte Latin-1 characters, then applies the `encode_char_utf8` function to re-encode any non-UTF-8 bytes. The script also includes a `force_latin` function for reverse conversion, though the main pipeline calls `force_utf8`. The data source is standard input, making it a filter for text streams.

PPhilippe Rivière

47% match

Loading thumbnail…

writing the numbers 1-100 in order and seeing the middle letter

This example examines the letters at the center of the concatenated text formed by writing the numbers 1 through 100 as words, with and without hyphens. It uses Python’s built-in string methods to join the number list, remove hyphens, and index the middle character by calculating half the total length. The visualization shows the resulting middle letter for four variations: with and without hyphen removal, and with spaces versus no spaces between numbers. The code relies solely on Python’s `list`, `join`, `replace`, and `len` functions, with no external libraries or graphical output.

BBBischof

46% match