Skip to main content
100%

Docker for Data Science

✓ Published0🌍 Public
Aaakansh9
Last edited Jan 19, 2020
Created on Jun 23, 2016

This example documents a practical workflow for containerizing data science environments with Docker, covering local macOS setups and remote Amazon EC2 instances. It shows shell commands for pulling Kaggle’s Python and R images, running Jupyter or RStudio servers with memory and CPU limits, and installing tools like tmux, htop, and pyspark inside containers. For EC2, it details mounting EBS volumes, configuring security groups, and enabling GPU access via nvidia-docker, including driver installation and clock optimization for K80 cards. The source is a markdown note with command snippets, not an interactive visualization.

AI-generated description

Similar vizzes

Loading thumbnail…

R on Ubuntu 14.04 EC2 for Data Science

This example presents a step-by-step shell and R script for configuring a data-science environment on an Ubuntu 14.04 EC2 instance, focusing on installing R, RStudio Server, and the xgboost package. It shows the setup commands for security group settings, user permissions, and system updates, along with package installations via `apt-get`, `gdebi`, and R’s `install.packages` from the drat repository. The code also includes dependencies like `libcurl4-openssl-dev`, `libxml2-dev`, and tools such as `mono-complete` and `ffmpeg`. The description highlights the practical workflow rather than a visualization, emphasizing the underlying infrastructure for data analysis.

Aaakansh9
71% match
Loading thumbnail…

Docker notes

This visualization presents Docker command syntax as an interactive reference, organizing the gist’s structured notes into a force-directed network. Using d3.forceSimulation, it positions nodes for commands, options, and objects, with links encoding the relationships between root commands, their flags, and use cases. The layout clusters commands by category—containers, general, and images—while tooltips reveal full syntax and descriptions from the markdown source. The rendering relies on D3’s SVG and simulation APIs to create a browsable graph of the CLI’s command hierarchy.

Aaakansh9
67% match
Loading thumbnail…

scipy-notebook with rasterio

This example demonstrates a Docker-based environment for geospatial data analysis in Jupyter, combining the scipy-notebook stack with the rasterio library for raster processing. The Dockerfile builds on the official jupyter/scipy-notebook image, installing system-level GDAL dependencies via apt-get and then using conda to add the gdal package. It also uses pip to install rasterio for the jovyan user, enabling direct access to rasterio’s geospatial raster I/O and analysis APIs within Python notebooks. The setup shows a reproducible workflow for working with satellite or elevation data without requiring manual system configuration.

ZZJONSSON
65% match
Loading thumbnail…

Gist 3d7ff1d83fb2177cedceded587ff4aca

This example presents a setup guide for a Docker-based Node.js workshop, illustrating how to launch a project from a Bitbucket-hosted configuration. It shows the command sequence, starting with copying a `docker-compose.yml` file from the provided URL and then running `docker compose up --build` to construct and start the container image. The visualization focuses on the workflow steps, highlighting the use of Docker Compose for service orchestration and image building. The interface displays the copied configuration link alongside the terminal command, making the process explicit for users. No additional data or rendering occurs beyond these instructional elements.

MMistyBlunch
63% match
Loading thumbnail…

A Packer template for building a Docker container host on an AWS EC2 instance.

This example shows a Packer template that automates the creation of an Amazon EC2 instance preconfigured as a Docker container host. The code defines an Amazon EBS builder using the `amazon-ebs` type, specifying an Ubuntu AMI and an `m3.xlarge` instance type. Provisioners run shell commands to install Docker Engine, add the `ubuntu` user to the `docker` group, and configure DNS via `DOCKER_OPTS`. The template also includes a `shell-local` provisioner to wait for a reboot, and uses variables for AWS credentials. The rendering approach is code-as-infrastructure, with no visual data involved.

JJoelBCarter
62% match
Loading thumbnail…

Gist 1487e9082b7aaf6a45007d66fc0a7697

This example demonstrates a terminal-based workflow for running an Ubuntu Docker container on a Windows host. The visualization is a step-by-step textual tutorial, not a graphical chart, showing the commands necessary to pull the official Ubuntu image from Docker Hub and execute it interactively. The code relies on the Docker command-line interface and `winpty` utility to facilitate a pseudo-terminal session, with the primary command being `winpty docker run -i -t ubuntu bash`. The output presents the three required steps as a simple, linear sequence, with the final step noting the interactive shell session is ready for use.

MMistyBlunch
62% match
Loading thumbnail…

Gist b7a46dea7569df07c3ab2ca8654968ca

This visualization example demonstrates an automated ECS task that runs a Python script in a Fargate container, configured through the AWS CLI and JSON task definition. It shows how infrastructure-as-code defines a containerized workload, using the AWS SDK to launch a task that likely scrapes or processes hill-related data. The configuration specifies the `ecsTaskExecutionRole` IAM role, sets environment variables for mode, email, and password, and uses the `sel-test` Docker image from ECR. The rendering approach is not visual; instead, it focuses on the declarative task definition and container lifecycle, with no d3, Canvas, or Three.js involved.

CConorAspell
61% match
Loading thumbnail…

k8s

This visualization is a reference cheat sheet for command-line workflows, primarily centered on Kubernetes cluster management, SSH key handling, and Docker operations. It presents plain-text code snippets and terminal output showing commands like `kubectl config get-contexts`, `ssh-add -l`, and `docker build`, along with the expected results. The examples cover additional utilities such as `git diff`, `rsync`, `ffmpeg` encoding, and PDF conversion with `convert` and `montage`. The data shown is static text and command outputs, not a graphical rendering, so no visualization libraries are used.

Aabernier
61% match