Download and setup [from the command line] Java, Scala, SBT and Spark on a Ubuntu machine.

100%

Download and setup [from the command line] Java, Scala, SBT and Spark on a Ubuntu machine.

✓ Published0🌍 Public

Last edited Mar 11, 2017

Created on Apr 13, 2016

Two Bash scripts automate the end-to-end setup of a big-data toolchain on Ubuntu, downloading and installing JDK 8, Scala, SBT, and Spark via `wget`, then extracting tarballs with `tar`, moving binaries into `~/apps`, and appending environment variables to `.bashrc`. The second script sources the updated shell configuration, launches a Spark master and slave using `start-master.sh` and `start-slave.sh`, and runs the bundled `SparkPi` example to verify the installation. It also uses `sed` to reduce log verbosity across all `log4j.properties` files.

AI-generated description

Similar vizzes

Loading thumbnail…

Install Scala and SBT using apt-get on Ubuntu 16.04 or any Debian derivative using apt-get

This example presents a shell-script sequence for installing the Java Development Kit, Scala, and the Simple Build Tool on Ubuntu 16.04 or Debian-based systems via `apt-get`. It combines `sudo apt-get` commands, `wget` to fetch a Scala `.deb` package, and `dpkg -i` for manual installation, followed by adding an SBT repository and importing its GPG key via `sudo apt-key`. The code relies on system package managers and command-line tools.

FFrozenfire92

66% match

Loading thumbnail…

Gist 38a5a981b671bf09a7b9e76eeebc2294

This example visualizes a system-administration script that automates the setup of an Ambari-managed Hadoop cluster. The code shows a sequence of shell commands and configuration steps, including disabling SELinux and iptables, installing Java and MySQL, and configuring databases and users. It uses the `awk` utility to edit `sshd_config` and the `mysql` command-line client to create and grant privileges on the `ambaridb`, `hivedb`, and `ooziedb` databases. The visualization maps the script’s control flow and dependencies, likely through a node-link diagram, to illustrate how each step builds on prior ones.

FFred-Fan

61% match

Loading thumbnail…

JDK9 command line download script; For JDK10, please check: https://gist.github.com/P7h/9741922

This example provides a shell script that automates the download of Oracle JDK 9 binaries from the Oracle website using command-line tools. The script defines a base URL for JDK 9.0.4 and a list of platform-specific files, including Linux tar archives, Windows executables, and API documentation. It uses `curl` with options like `-C -` for resuming interrupted downloads, `-L` for redirects, `-R` for timestamping, and `-O` (implied) with a cookie header to accept the Oracle license. The script also includes commented-out alternatives using `wget`, and documents its purpose for environments like Amazon EC2.

PP7h

60% match

Loading thumbnail…

Gist a9811ea9c0293f1b19277f7a6995b236

This example shows a bash script that automates the setup of a Linux scavenger-hunt lab environment. It downloads an SSH deploy key, clones a Git repository from GitLab, initializes submodules, and uses Vagrant to provision the virtual machine. The script concludes by parsing `vagrant ssh-config` output with `awk` and `sed` to display the student’s SSH connection details, including hostname and port.

PPeleke

59% match

Loading thumbnail…

Script to download JDK / JRE / Java binaries from Oracle website from terminal / shell / command line / command prompt

This example shows a collection of Bash scripts for downloading Oracle JDK/JRE binaries from the Oracle website via the terminal. It demonstrates how to automate fetching multiple platform-specific packages (Linux, Windows, macOS) and documentation in a single invocation using `curl` or `wget`. The scripts use `wget` with options like `-c` for resuming interrupted downloads and `--header` to pass the required Oracle license cookie, while `curl` variants employ `-C -` for continuation, `-L` for redirects, and `-O` for remote filenames. The code includes version-specific base URLs for JDK 8, 9, and 10, along with commented notes on command-line flags.

PP7h

58% match

Loading thumbnail…

Numpy and Scipy [and also 7zip] on Ubuntu.

This example shows a shell script for setting up a scientific Python environment on Ubuntu, with a focus on installing NumPy, SciPy, and 7zip. The code uses the Bash `sudo apt-get` and `sudo pip` commands to install system packages like `gfortran`, `libopenblas-dev`, and `liblapack-dev`, which are required for building SciPy. It also installs `p7zip` for archive handling and `python-pip` for package management. The script demonstrates a linear, command-by-command installation workflow, with each line invoking a package manager API directly in the terminal.

PP7h

57% match

Loading thumbnail…

JDK 7 command line download script; For JDK8, please check: https://gist.github.com/P7h/9741922

This example shows a shell script that automates the download of multiple JDK 7 platform-specific packages from Oracle’s website. It defines a base URL for JDK 7u79 and iterates over an array of file suffixes, using `wget` with `--no-check-certificate` and a cookie header to accept the Oracle license. The script also comments alternative versions and a `curl` command for JDK8.

PP7h

57% match

Loading thumbnail…

Apache Toree intallation steps

This example shows a terminal-style walkthrough of the Apache Toree installation process, presenting a sequence of shell and Conda commands in a monospaced layout. The code includes installation steps for system utilities via `sudo apt`, JupyterLab and PySpark through `conda install`, and additional Jupyter extensions from conda-forge. It then demonstrates Toree’s pip installation from an Apache distribution URL, followed by `jupyter toree install` commands that register Scala, PySpark, and SQL kernels against a Spark home directory. The final `jupyter kernelspec list` command displays the available kernels, highlighting the command-line interaction as the primary visual element.

PP7h

57% match