Skip to main content
SimilarExport ZIP
100%

[create_mapping_for_normalization]将大量同义词转换为映射表，如 ibm,国际商业机器公司,ibm中国 转换为 {'国际商业及其公司':'ibm', 'ibm中国':'ibm'} #dict

✓ Published0🌍 Public
SShawn91
Last edited May 13, 2019
Created on May 13, 2019

This example shows a Python utility that converts a plain-text list of synonym groups into a normalization mapping dictionary, e.g., turning "ibm,国际商业机器公司,ibm中国" into `{'国际商业及其公司':'ibm', 'ibm中国':'ibm'}`. The function `create_mapping_for_normalization` reads either a file path or a list, splits each line by a configurable separator, and uses a `key` function to designate the standard term among each group. It optionally skips duplicate words to avoid overwriting existing mappings. The included test demonstrates the process with sample data containing company names in multiple languages. The code relies solely on Python’s standard library, using built-in file I/O and data structures.

AI-generated description

Similar vizzes

Loading thumbnail…

[注音符号字母转换] #string

This example demonstrates how to normalize Unicode text that contains accented or composite characters into plain ASCII, showing the transformation before and after processing. It uses Python’s `unicodedata` module, specifically the `normalize` function with `NFKD` and `NFD` forms, followed by encoding to ASCII with the `'ignore'` error handler, or by using a dictionary of combining characters with `translate` to strip diacritical marks. The code includes two methods: one that removes non-ASCII characters entirely, and another that preserves them while eliminating accent marks, with comments explaining the behavior for both Python 2 and 3.

SShawn91
53% match
Loading thumbnail…

[多个字典做相同操作] #dict

This example demonstrates how Python’s `collections.ChainMap` groups multiple dictionaries into a single, view-like mapping that supports standard dict operations. It shows that lookups, length checks, key enumeration, and value retrieval behave as if the dicts were merged, with the first dict taking precedence for duplicate keys. The code also illustrates that assignment and deletion operate only on the first dict, while attempting to delete a key absent from that first dict raises a `KeyError`. The example uses ChainMap to combine `a` and `b` into `c`, then prints results from both.

SShawn91
51% match
Loading thumbnail…

Normalizer

This example demonstrates a string normalization function that converts accented and special characters into plain ASCII equivalents. It builds a character mapping from two parallel strings, then processes each input character, replacing matches with their mapped counterparts and lowercasing the final result. The implementation relies on standard JavaScript string methods such as `charAt`, `hasOwnProperty`, `join`, and `toLowerCase`. The code is presented as a standalone JavaScript function, with no external libraries or data sources involved, showing the raw logic behind text sanitization in a compact form.

LLuisSevillano
48% match
Loading thumbnail…

[百度百科简介内容解析] #爬虫

This example parses the summary table from Baidu Baike encyclopedia pages to extract short names, abbreviations, and foreign-company division names. It uses the BeautifulSoup library to locate the HTML element with class `basic-info cmn-clearfix`, then a helper function `get_baike_shorten_names` finds a definition term (like `dt` for “英文名”) and retrieves its sibling `dd` value, cleaning out bracketed reference numbers with a regular expression. The code demonstrates a reusable scraping pattern for structured infobox data from Baidu Baike, returning the cleaned text or an empty string when no match is found.

SShawn91
45% match
Loading thumbnail…

[中文标点转英文] #string

This example demonstrates a Python utility that converts Chinese punctuation marks into their English equivalents in a given string. The function `punc_chinese2english` builds translation tables using the built-in `str.maketrans` method, mapping a set of characters such as full-width commas, periods, and quotation marks to standard ASCII punctuation. It applies this mapping via the string `translate` method, returning the converted text. The code explicitly lists the Chinese and English punctuation pairs, making the transformation rule clear and easy to modify.

SShawn91
45% match
Loading thumbnail…

[print_unicode] python2 下在命令行中正常打印嵌套在 dict/list 内的 unicode 字符 #python #string

This example shows a Python 2 utility function that makes nested Unicode characters inside dictionaries and lists print correctly to the command line. The function `print_uni` takes any string `s`, applies `repr` to capture its escaped form, and then decodes that representation using `"unicode-escape"` to reveal the actual Unicode glyphs. It relies on the built-in `repr` function and the string `decode` method, demonstrating a workaround for Python 2’s default ASCII-based printing of container structures. The code is a standalone snippet from a gist by Shawn91, focusing on a common debugging pain point.

SShawn91
44% match
Loading thumbnail…

Created on Cognitive Class Labs

This notebook demonstrates Python dictionary operations through a series of executed cells. It shows how to create dictionaries with various key types—strings, tuples, and mixed values—and access values by key. The code uses standard Python dictionary syntax, including colon-separated key-value pairs and curly-brace notation, with examples from an album release-year dataset. The rendered markdown includes instructional text and images, while the executable code cells run in a Jupyter environment on Cognitive Class Labs.

DDAVINDER
42% match
Loading thumbnail…

[json和python对象相互转换] #python

This example demonstrates two-way conversion between JSON data and Python objects using the standard `json` module. It first shows how `json.loads` with an `object_hook` parameter transforms JSON input into a custom `JSONObject` class, allowing attribute-style access to fields like `data.name` instead of dictionary indexing. The second part illustrates the reverse process with a `serialize_instance` function that converts a `Point` class instance into a dictionary, adding a `__classname__` key to preserve type information. Both conversions rely solely on Python's built-in `json` library and basic class definitions, with no external dependencies.

SShawn91
42% match