Data-driven journalism web scraping

100%

Data-driven journalism web scraping

✓ Published0🌍 Public

Last edited Jun 1, 2014

Created on Jun 1, 2014

This example shows a web-scraping pipeline that extracts a list of FIFA-registered soccer agents from the FIFA website and saves the data to a CSV file. It displays the process of collecting agent details such as name, company, address, email, and phone numbers for each country. The code uses the `requests` library to fetch HTML pages and `lxml` with XPath queries to parse the table structure. The scraped data is written via the standard `csv` module, producing a structured dataset for further analysis or visualization.

AI-generated description

Similar vizzes

Loading thumbnail…

Loading and Parsing CSV Data - FIFA 19 Dataset

This example demonstrates the basic workflow of loading and parsing a CSV dataset in D3. It displays a summary of the FIFA 19 English Premier League player dataset, showing the file size in kilobytes, row count, and column count. The code uses `d3.csv` to fetch the remote CSV file and `d3.csvFormat` to calculate the data size. Results are rendered as plain text in an HTML `<pre>` element via the Document Object Model.

SSitanshu Rupani

60% match

Loading thumbnail…

Spider Chart _ FIFA

This interactive visualization compares FIFA player statistics between two national teams using a spider chart and a side-by-side data grid. Users select countries and attributes via dropdown menus, with the radar path and grid values updating accordingly. Hovering over data points reveals a tooltip with exact values. The visualization uses D3 scales and line generators, React state management, and renders all marks as SVG elements. The dataset aggregates player attributes like overall rating, potential, and specific skills.

Sstephanie0215

59% match

Loading thumbnail…

Gist 030abf753f0ac606724c658e17188739

This example automates the creation of training teams on the Sorare fantasy football platform, showing a scripted workflow that logs into the site and iteratively assembles lineups from available player cards. The code uses Selenium WebDriver to drive a Chrome browser, with helper functions that toggle filter settings (such as excluding or including "Commons" and "Next Game" availability) and click through the interface to select players. The process runs until no more valid teams can be formed, then moves to the next matchday. The visualization demonstrates browser automation for repetitive data-entry tasks, relying on explicit XPath selectors and timed waits to interact with dynamic page elements.

CConorAspell

59% match

Loading thumbnail…

Fifa World Cup Data

This example displays the raw contents of a Fifa World Cup 2022 matches dataset as formatted JSON text in a `<pre>` element. The visualization initially fetches the CSV file from a GitHub gist, parses it using `d3.csvParse`, and then renders the resulting array of objects. It uses D3 v7's `select` and `join` methods to manage the display. The dataset includes match statistics such as assists, possession, crosses, cards, passes, and fouls, sourced from Kaggle.

MMartha Cash

59% match

Loading thumbnail…

Spider Chart_FIFAPlayer

This interactive spider chart compares two FIFA soccer players across six selected attributes, with a supplementary data grid displaying additional player details. Users select players and attributes from dropdown menus, while hovering over data points reveals tooltips with exact values. The visualization is built with React and D3 v7, using `d3.line` for path generation and `d3.csv` for data loading. The chart is rendered as SVG, featuring radial axes, grid lines, and semi-transparent filled areas for each player.

Sstephanie0215

58% match

Loading thumbnail…

Dashboard - Final Project - FIFA 19 Dataset

This dashboard explores the FIFA 19 dataset, integrating a world map with bubble markers, a Sankey diagram, and a scatterplot to reveal player distributions. The map uses `d3.geoNaturalEarth1` and `d3.geoPath` with topojson data, scaling circle radii by player count. The Sankey chart, built with the `d3.sankey` layout, visualizes flows from nationality to club. The scatterplot displays player overall rating against wage, supporting brush-based selection to highlight individual players.

SSitanshu Rupani

58% match

Loading thumbnail…

Fork of Dashboard - Final Project - FIFA 19 Dataset

This dashboard visualizes the FIFA 19 dataset, showing player distribution across countries and clubs. A world map displays the number of players per nationality using circles sized with `d3.scaleSqrt`, with zoom and brushing interactions. A Sankey diagram connects nationalities to clubs, using `d3.sankey` with draggable nodes and tooltips. The visualization uses React, D3 v4, and TopoJSON, rendering as SVG.

PPriscylla Silva

57% match

Loading thumbnail…

Gist 58c79c81e9a950a0cdafc7d2d0275742

This example shows a dynamic, browser-automated web-scraping workflow that captures rendered page content. It uses Selenium’s `webdriver` to launch a Chrome browser, wait for elements via `WebDriverWait` and `expected_conditions`, and then extracts page HTML with BeautifulSoup. The script programmatically sends keyboard inputs via `Keys`, and also employs the `requests` library for direct HTTP calls. It parses the returned data with `json`, timestamps actions with `datetime`, and structures results into a pandas DataFrame. The process includes randomized delays (`random` and `time`) to mimic human browsing behavior, though no explicit visualization or rendering library is used beyond the raw captured markup.

AArizonaTay

57% match