Reading a Zip file in Power Query via R

100%

Reading a Zip file in Power Query via R

✓ Published0🌍 Public

Last edited Mar 9, 2017

Created on Mar 9, 2017

This example demonstrates how to read a compressed CSV file directly from a local ZIP archive using Power Query’s R integration. The visualization shows the result of an R script that extracts the file `R_Twitter_sample.csv` from `R_Twitter_sample.zip` and loads it into a table. The Power Query `R.Execute` function runs the R code, which relies on R’s base `read.csv` and `unz` functions to handle the archive and file parsing. The output is then returned to Power Query via the `[Name="datacsv"]` reference, making the data available for further transformation or charting. No external visualization library is used; the focus is purely on data ingestion.

AI-generated description

Similar vizzes

Loading thumbnail…

Replicating R unz function in Power Query. Based on http://sql10.blogspot.co.uk/2016/06/reading-zip-files-in-powerquery-m.html

This example demonstrates how to read a specific file from a ZIP archive directly in Power Query using a custom M function. It shows the binary-parsing logic that replicates R’s `unz` utility by manually decoding the ZIP container format. The code defines binary readers via `BinaryFormat` components, including `UnsignedInteger32` and `UnsignedInteger16` for headers, and uses `Binary.Decompress` with `Compression.Deflate` to inflate the stored file data. A `BinaryFormat.List` iterator scans the archive for the `PKZIP` signature (`0x04034B50`) to locate and extract the requested file by name. The function returns the uncompressed binary content for the matching entry.

HHugoberry

77% match

Loading thumbnail…

UnZip in Power Query M

This example demonstrates a custom implementation of the UnZip algorithm entirely in Power Query M, enabling direct extraction of compressed ZIP file contents without external dependencies. It shows how binary data can be parsed and decompressed within Power BI’s data transformation environment. The code defines a binary format using `BinaryFormat.Record` to parse ZIP file headers, including signatures, compression flags, and sizes, then applies `BinaryFormat.Transform` with `Compression.Deflate` to decompress individual file entries. The result is a table of filenames and their uncompressed contents, derived from a gist by Hugoberry, showcasing low-level binary handling and list transformations in M.

HHugoberry

74% match

Loading thumbnail…

Using R.Execute() in Power Query to export the contents of a table to CSV

This example demonstrates how to use R.Execute() in Power Query to export a table’s contents to a CSV file. The code generates a seed list of numbers from 1 to 1,000,000, converts it into a table, and then passes that dataset to R’s write.csv() function via the R.Execute() API. The R script writes the data to a specified file path. The visualization highlights the integration between Power Query and R, showing how R’s data-export capabilities can be invoked directly within a query pipeline, without additional manual steps.

HHugoberry

70% match

Loading thumbnail…

Dissecting ZIP file structure in Power Query M following explanation from https://users.cs.jmu.edu/buchhofp/forensics/formats/pkzip.html

This example dissects the binary structure of ZIP files using Power Query’s M language, following the PKZIP format specification from James Madison University. It visually parses a ZIP file’s local file headers, central directory entries, and end-of-central-directory records, revealing metadata like compression method, timestamps, and file names. The code leverages `BinaryFormat` combinators—such as `BinaryFormat.Record`, `BinaryFormat.Choice`, and `BinaryFormat.List`—to sequentially read and interpret byte streams, with `Binary.Decompress` handling deflate decompression. The visualization highlights how raw bytes map to structured fields, making the format’s internal layout explicit. Data originates from a sample ZIP file provided as a binary input.

HHugoberry

68% match

Loading thumbnail…

Writing 10M lines of a query result to a table in Power Query via R

This example demonstrates how to write 10 million rows of a query result to a CSV file from Power Query by invoking an R script. It shows the integration of Power Query’s table generation with R’s file-export capabilities, specifically using the `R.Execute` function to run `write.csv` on a dataset. The Power Query code creates a list of numbers from 1 to 10,000,000 via `{1..10000000}`, converts it to a table with `Table.FromList`, and passes that table as the `dataset` parameter to the R script. The R script then writes the data to `d:\Downloads\out.csv`.

HHugoberry

67% match

Loading thumbnail…

R Regex matching of mentions in twitts. with Power Query and R

This example demonstrates how to extract regex-matched mentions (prefixed with `#` or `@`) from Twitter text using R within a Power Query workflow. The visualization shows the original tweets alongside a new `mention` column containing the first matched term. The solution uses the `R.Execute` function to run an R script that applies `regmatches` and `regexpr` with the pattern `[#@]\w+` across the `text` column. The R script processes the dataset provided by Power Query, leveraging R's base string manipulation functions. The data originates from a CSV file loaded via `Csv.Document`, with the final result passed back to Power Query through the `[Name="temp"]` output.

HHugoberry

65% match

Loading thumbnail…

R.Execute example without the use of R.Execute() in Power Query [behind the scenes this gets executed bin\x64\Rscript.exe" --encoding=UTF-8 RScriptWrapper.R"]

This example demonstrates how to execute an R script from within Power Query without explicitly invoking the `R.Execute` function, instead relying on the `AdoDotNet.DataSource` with the `R.Provider` to run a native query. The code passes a string containing an `output` variable that captures the result of `system2("whoami", stdout=TRUE)`, which retrieves the current username. The resulting table is then converted from binary R data using `RData.FromBinary`. This approach showcases the underlying use of `Rscript.exe` via the provider, highlighting an alternative integration path for R workflows in Power Query.

HHugoberry

64% match

Loading thumbnail…

Gist 47d998760fa7271ac3157ce7d9555612

This example demonstrates how to query and load data from external sources using Power Query's OleDb.Query function, specifically connecting to a local CSV file and an XML catalog. The code shows two approaches: one using Microsoft's ACE OLEDB provider to read a delimited text file, and another using the MSDAOSP provider with MSXML2.DSOControl to access XML data. The visualization highlights the raw query definitions rather than rendering graphical output, focusing on the data-acquisition layer. Both queries reference file paths on the local system, with the CSV query specifying the file directory and the XML query pointing to a catalog file.

HHugoberry

62% match