Gist a99d287be62c6d73536521c0e5e74e58

100%

Gist a99d287be62c6d73536521c0e5e74e58

✓ Published0🌍 Public

Last edited Dec 27, 2021

Created on Dec 27, 2021

This example scrapes Instagram profile and post data to track follower counts, likes, comments, captions, and post dates for selected users, associating each entry with an industry topic. The script uses Selenium to automate login and search, BeautifulSoup to parse the page source, and the Instagram GraphQL data embedded in `window._sharedData` to extract metrics. It writes the collected records to a CSV via pandas, pausing with random sleeps to avoid detection. The visualization highlights how social-media engagement varies across profiles and industries over time.

AI-generated description

Similar vizzes

Loading thumbnail…

Gist dfbc4b41961e5b098fffce6af3828f57

This visualization scrapes Instagram profile data to compare follower counts, post engagement, and captions across influencers in different industries. Using Selenium to automate Chrome and BeautifulSoup to parse page JSON, the script extracts post dates, like counts, comments, and partnership flags from each profile’s embedded `_sharedData` blob. It then compiles the results into a pandas DataFrame and exports them to CSV. The example highlights the workflow of collecting social-media metrics at scale, with the final chart likely plotting follower growth or engagement trends per industry.

AArizonaTay

91% match

Loading thumbnail…

Gist fa05e9e0684e37e537c08085e5900435

This example shows a data-cleaning pipeline for an Instagram influencer dataset, highlighting the number of unique users and missing values across key columns. The code uses pandas to inspect and transform the data, filling missing industry labels with "General," dropping rows without captions, removing duplicate entries, and converting the post date column to datetime format for time-series indexing. The visualization relies on pandas' built-in data manipulation functions, such as `fillna`, `drop_duplicates`, and `set_index`, rather than a plotting library. The final output would be a cleaned dataframe ready for trend analysis, though no chart is generated in the provided script.

AArizonaTay

76% match

Loading thumbnail…

Gist 7083cd8264b6aa48ce4bbfaf44546f07

This example builds a profile-scraping pipeline for social media data, turning raw CSV input into a structured DataFrame with fields for user names, follower counts, post dates, likes, comments, captions, and industry tags. The code reads `raw_data.csv` via `pandas.read_csv` and then initializes an empty DataFrame with predefined column names, preparing it for subsequent population. The visualization focuses on the data-preparation stage rather than graphical output, demonstrating how pandas handles tabular ingestion and schema definition. No rendering library like d3 or Three.js appears here; instead, the emphasis is on clean data structuring for later analysis or charting.

AArizonaTay

74% match

Loading thumbnail…

Gist 2c4db01f16e82a0746be7819b4d925d5

This example visualizes influencer engagement by computing an engagement rate from comment and like counts relative to follower totals, using pandas to add and inspect the new column. It then extracts URLs from post captions with a regex pattern, storing them in a new “Links” column to identify which posts contain external links. The code relies on pandas for data manipulation and the `str.extract` method for pattern matching, while the head and describe functions provide a quick statistical summary. The visualization focuses on showing how engagement varies with link presence, though no charting library is used in the provided snippet.

AArizonaTay

68% match

Loading thumbnail…

Gist 0d66893f89c8190de7c21268dfeef1d1

The visualization explores sponsored Instagram posts, showing how engagement rates and posting frequency vary by hour of the day. Two line charts, built with Plotly Express and Plotly Graph Objects, reveal a peak in average engagement at 4pm and the highest number of posts at noon. A separate horizontal bar chart, also using Plotly, ranks the top 20 brand collaborators by counting how often each sponsor appears in the filtered dataset, which only includes posts marked as "Sponsored." The code groups timestamps by hour and processes sponsor tags by stripping "@" symbols to tally frequencies.

AArizonaTay

66% match

Loading thumbnail…

Gist 58c79c81e9a950a0cdafc7d2d0275742

This example shows a dynamic, browser-automated web-scraping workflow that captures rendered page content. It uses Selenium’s `webdriver` to launch a Chrome browser, wait for elements via `WebDriverWait` and `expected_conditions`, and then extracts page HTML with BeautifulSoup. The script programmatically sends keyboard inputs via `Keys`, and also employs the `requests` library for direct HTTP calls. It parses the returned data with `json`, timestamps actions with `datetime`, and structures results into a pandas DataFrame. The process includes randomized delays (`random` and `time`) to mimic human browsing behavior, though no explicit visualization or rendering library is used beyond the raw captured markup.

AArizonaTay

66% match

Loading thumbnail…

Gist da5f7a5f8cf01b0874d92349b33ec806

This visualization uses a Latent Dirichlet Allocation (LDA) topic model to classify Instagram captions into eight thematic categories, such as Giveaway, Fitness, and Love. It first shows the derived topics with their top ten keywords per topic, then assigns each caption its dominant topic and displays a random sample of the resulting annotations. The analysis relies on the Gensim library for the LDA model and coherence scoring, while Pandas DataFrames and the Dictionary and doc2bow APIs handle text preprocessing and corpus construction. A custom function maps each caption’s topic distribution to its most likely label, and the final output presents a sample of the enriched data with the assigned topic column.

AArizonaTay

64% match

Loading thumbnail…

Gist fbc8e33e01b5be01bc6c1ab2d1d08cfc

The visualization displays the 30 most frequently occurring words from a set of cleaned Instagram captions, plotted as a bar chart that ranks terms by raw count. It shows a sharp drop-off in frequency after the top few words, highlighting the long-tail distribution common in text data. The chart is generated using Python’s matplotlib, with the caption data loaded into a pandas DataFrame and tokenized via the Natural Language Toolkit (nltk). Frequencies are computed with `nltk.FreqDist`, and the top 30 entries are selected for plotting, with a filter excluding the characters ‘1’, ‘2’, and ‘3’ from the hashtag tokens. The figure is sized at 14 by 6 inches for readability.

AArizonaTay

64% match