Skip to main content
100%

Useful Pandas Snippets

✓ Published0🌍 Public
Aabehmiel
Last edited Nov 2, 2016
Created on Apr 3, 2017

This example demonstrates a collection of practical data manipulation recipes for the Pandas library in Python. It shows how to perform common DataFrame operations, including filtering rows by values, renaming columns, handling missing data, sorting, grouping, pivoting, and converting data types. The snippets use Pandas APIs such as `pd.unique`, `df.isin`, `df.rename`, `df.groupby`, `pd.pivot_table`, and `df.fillna`, along with NumPy functions like `np.where`. The code also covers text processing with `.str` methods, concatenating columns, and creating DataFrames from dictionaries or Django querysets.

AI-generated description

Similar vizzes

Loading thumbnail…

Gist 575a4d1a506d4f39d35f

This example presents a collection of Python code snippets for data manipulation with the pandas library, focusing on common DataFrame operations. It demonstrates techniques for filtering rows based on column values, handling missing data, renaming columns, and performing data type conversions. The snippets also cover more advanced operations like pivot tables, merging delimited values, and using `pd.melt` for reshaping data. The code includes functions like `df.column_name.unique()`, `pd.pivot_table`, and `df.assign` to illustrate practical workflows for cleaning and transforming tabular data.

SSav10
86% match
Loading thumbnail…

Useful Pandas csv import functions. Original by Chris Albon

This example demonstrates multiple ways to import CSV data into pandas DataFrames, highlighting how to handle missing values, specify column names, set indexes, skip rows, and interpret thousands separators. The code creates a sample dataset with mixed data types—including strings, integers, and missing values marked with periods—then saves it as a CSV file before applying various `pd.read_csv` parameters. It shows techniques like using `header=None`, the `names` parameter, `index_col` for single or multi-column indexes, `na_values` for custom missing value sentinels, `skiprows` to omit initial lines, and `thousands=','` to parse formatted numbers. The examples use pandas' built-in CSV reader, sourced from Chris Albon's original tutorial.

Aabehmiel
69% match
Loading thumbnail…

Gist 740405b6405a6644fd16d3a50588de51

This example shows a step-by-step transformation of the classic wine dataset, progressively filtering and selecting columns to isolate alcohol content, color intensity, and hue before randomly sampling five rows. The code chains pandas operations—including `rename`, `assign`, `query`, and `sort_values`—through a custom `csnap` helper that snapshots the intermediate state after each step. It uses NumPy’s `np.where` to create a binary `color_filter` column based on hue and color intensity thresholds, then resets the index and samples five rows with `sample(5)`. The visualization highlights how pipelined data wrangling can be inspected at each stage.

Aadiamaan92
63% match
Loading thumbnail…

Gist fa05e9e0684e37e537c08085e5900435

This example shows a data-cleaning pipeline for an Instagram influencer dataset, highlighting the number of unique users and missing values across key columns. The code uses pandas to inspect and transform the data, filling missing industry labels with "General," dropping rows without captions, removing duplicate entries, and converting the post date column to datetime format for time-series indexing. The visualization relies on pandas' built-in data manipulation functions, such as `fillna`, `drop_duplicates`, and `set_index`, rather than a plotting library. The final output would be a cleaned dataframe ready for trend analysis, though no chart is generated in the provided script.

AArizonaTay
61% match
Loading thumbnail…

Gist 7083cd8264b6aa48ce4bbfaf44546f07

This example builds a profile-scraping pipeline for social media data, turning raw CSV input into a structured DataFrame with fields for user names, follower counts, post dates, likes, comments, captions, and industry tags. The code reads `raw_data.csv` via `pandas.read_csv` and then initializes an empty DataFrame with predefined column names, preparing it for subsequent population. The visualization focuses on the data-preparation stage rather than graphical output, demonstrating how pandas handles tabular ingestion and schema definition. No rendering library like d3 or Three.js appears here; instead, the emphasis is on clean data structuring for later analysis or charting.

AArizonaTay
60% match
Loading thumbnail…

Gist d55d478bb85bfb424d4ea80f2af06d2a

This example demonstrates a utility function that renames the columns of a pandas DataFrame. It shows how to apply a custom naming scheme, such as joining multi-level column labels with an underscore, or replacing the column names with an explicit list. The function `setcols` accepts a DataFrame and an optional function or list; when no list is provided, it maps the given function across the existing column index. The code relies on pandas’ `columns` attribute and the `map` method, making it a concise tool for data preprocessing before visualization.

Aadiamaan92
60% match
Loading thumbnail…

Transforming Code into Beautiful, Idiomatic Python: notes from Raymond Hettinger's talk at pycon US 2013. The code examples and direct quotes are all from Raymond's talk. I've reproduced them here for my own edification and the hopes that others will find them as handy as I have!

This example presents a collection of code snippets from Raymond Hettinger’s PyCon 2013 talk, demonstrating how to refactor common Python patterns into more idiomatic and efficient forms. The notes show before-and-after comparisons, such as replacing `range` with `xrange`, using `enumerate` for indexed loops, and applying `iter` with a sentinel value. It covers looping over collections, dictionaries, and multiple sequences, highlighting APIs like `zip`, `izip`, `sorted`, and `iteritems`. The rendering is plain text within a markdown file, with no visual data or canvas involved.

Aabehmiel
59% match
Loading thumbnail…

Gist 6ac95622ce9dd73d237ca6b17b2d5543

This visualization demonstrates a method-chaining utility for pandas DataFrames, allowing users to inspect intermediate data states during complex transformations. The `csnap` function takes a DataFrame, an optional transformation function, and a message, displaying the result of applying that function to the data while returning the original DataFrame for continued chaining. It uses the `display` API from IPython to render the snapshot inline, with a default function that shows the DataFrame’s shape. The example highlights a practical debugging pattern for exploratory data analysis workflows.

Aadiamaan92
59% match