Fetching Remove Password comments from Github. Using Power Query and R

100%

Fetching Remove Password comments from Github. Using Power Query and R

✓ Published0🌍 Public

Last edited Mar 9, 2017

Created on Mar 9, 2017

This example visualizes a GitHub code search for commits that remove passwords, using a Power Query workflow that calls the GitHub Search API to collect matching commits and their file patches. The data flows through Power Query’s table expansion functions before being handed to an R script via `R.Execute`, where a regular expression pattern extracts only the removed lines from each patch. The final table retains the commit metadata and the cleaned removed-line text, omitting the original patch column. The visualization demonstrates a hybrid ETL pipeline combining GitHub’s REST API, Power Query’s M language, and base R string processing.

AI-generated description

Similar vizzes

Loading thumbnail…

R Regex matching of mentions in twitts. with Power Query and R

This example demonstrates how to extract regex-matched mentions (prefixed with `#` or `@`) from Twitter text using R within a Power Query workflow. The visualization shows the original tweets alongside a new `mention` column containing the first matched term. The solution uses the `R.Execute` function to run an R script that applies `regmatches` and `regexpr` with the pattern `[#@]\w+` across the `text` column. The R script processes the dataset provided by Power Query, leveraging R's base string manipulation functions. The data originates from a CSV file loaded via `Csv.Document`, with the final result passed back to Power Query through the `[Name="temp"]` output.

HHugoberry

63% match

Loading thumbnail…

Reading a Zip file in Power Query via R

This example demonstrates how to read a compressed CSV file directly from a local ZIP archive using Power Query’s R integration. The visualization shows the result of an R script that extracts the file `R_Twitter_sample.csv` from `R_Twitter_sample.zip` and loads it into a table. The Power Query `R.Execute` function runs the R code, which relies on R’s base `read.csv` and `unz` functions to handle the archive and file parsing. The output is then returned to Power Query via the `[Name="datacsv"]` reference, making the data available for further transformation or charting. No external visualization library is used; the focus is purely on data ingestion.

HHugoberry

59% match

Loading thumbnail…

Writing 10M lines of a query result to a table in Power Query via R

This example demonstrates how to write 10 million rows of a query result to a CSV file from Power Query by invoking an R script. It shows the integration of Power Query’s table generation with R’s file-export capabilities, specifically using the `R.Execute` function to run `write.csv` on a dataset. The Power Query code creates a list of numbers from 1 to 10,000,000 via `{1..10000000}`, converts it to a table with `Table.FromList`, and passes that table as the `dataset` parameter to the R script. The R script then writes the data to `d:\Downloads\out.csv`.

HHugoberry

58% match

Loading thumbnail…

Power Query navigate the documentation of #shared functions. [M code]

This example visualizes the complete set of functions exposed by Power Query’s `#shared` namespace, organized into a navigable table. It shows each function’s name, module, category, example code, description, and signature. The M code uses `Record.ToTable` and `Table.SelectRow` to filter functions, then leverages `Value.Metadata` to extract documentation fields like `Documentation.Category` and `Documentation.Examples`. It also parses module names via `Text.Split` and builds signatures dynamically. The result is a self-documenting inventory, enabling users to browse and understand the entire Power Query function library directly from the environment.

HHugoberry

58% match

Loading thumbnail…

Using R.Execute() in Power Query to export the contents of a table to CSV

This example demonstrates how to use R.Execute() in Power Query to export a table’s contents to a CSV file. The code generates a seed list of numbers from 1 to 1,000,000, converts it into a table, and then passes that dataset to R’s write.csv() function via the R.Execute() API. The R script writes the data to a specified file path. The visualization highlights the integration between Power Query and R, showing how R’s data-export capabilities can be invoked directly within a query pipeline, without additional manual steps.

HHugoberry

57% match

Loading thumbnail…

PowerQuery hexview

The example visualizes a hexadecimal dump of a file’s raw bytes as a grid, where each cell represents one byte’s value in uppercase hex notation. The PowerQuery code reads the file `gitignore_global.txt` using `File.Contents` and `BinaryFormat.List`, then maps each byte to its relative and offset position within the file. Non-printable characters are replaced with dots, while printable ones display as hex pairs. The resulting table is expanded via `Table.ExpandRecordColumn`, producing a row per byte with columns for the byte value, its modulo-16 column, and the offset base—offering a compact, text-based visual breakdown of binary content without external charting libraries.

HHugoberry

57% match

Loading thumbnail…

Gist 8bb4970e2700b40a3dce1d785654d907

This visualization uses a force-directed graph to map the relationships between identifiers extracted from a Power Query M codebase. The data originates from a gist by Hugoberry, showing dependencies among functions, modules, and error-handling patterns. The rendering relies on D3.js’s `forceSimulation` with custom link and node positioning, while each node’s label is drawn using SVG text. The code specifically highlights groupings like `TableAction.*`, `ValueAction.*`, and `Pattern.*`, revealing hierarchical clusters of related API calls. The graph’s layout is animated via D3’s tick handler, and the visible node sizes suggest a metric like degree centrality, though the exact encoding is not explicit in the snippet.

HHugoberry

57% match

Loading thumbnail…

Commit and push via Github REST API, from ruby RestClient

This example shows how to programmatically commit a file to a GitHub repository using the GitHub REST API, demonstrated through a Ruby script that performs the five-step Git data model workflow. The code uses the `rest-client` gem for HTTP requests and `JSON` parsing to interact with endpoints like refs, commits, trees, and blobs. It first retrieves the current master branch head, then creates a new tree with the updated file content, builds a commit referencing the prior tree, and finally updates the branch reference. The script relies on basic authentication via environment variables for `GH_USERNAME` and `GH_PASSWORD`.

HHugoberry

56% match