Skip to main content
100%

Gist 0f94769031d17af1aabd

✓ Published0🌍 Public
Aadkatrit
Last edited Aug 26, 2015
Created on Jun 20, 2014

This example demonstrates how to optimize an Elasticsearch index for bulk data ingestion by adjusting multiple low-level settings before and after loading. It shows the sequence of configuration changes applied to a specific index named "corp-reg", including disabling replicas, closing the index, pausing refresh intervals, increasing merge factors, adjusting translog flush thresholds, and raising the indexing buffer size. The code uses curl commands to interact with the Elasticsearch REST API at a given socket address, sending JSON payloads via PUT and POST requests to modify index settings and open/close the index as needed.

AI-generated description

Similar vizzes

Loading thumbnail…

Gist 10351954

This example demonstrates the setup of an Elasticsearch server with a suite of management and monitoring plugins. The shell script installs OpenJDK 7, downloads Elasticsearch 1.1.0 as a Debian package, and configures plugins including elasticsearch-head, elasticsearch-gui, inquisitor, browser, HQ, suggest, MongoDB river, JDBC river, and bigdesk. It also downloads the PostgreSQL JDBC driver and moves it into the river-jdbc plugin directory. The process concludes by starting the Elasticsearch service, making the server available at localhost:9200.

Aanatolyg
53% match
Loading thumbnail…

modifique el script que hizo kimchy para su charla de París en el 2011

This example demonstrates Elasticsearch query DSL variations using curl commands against a local test index. It shows term, prefix, wildcard, fuzzy, text, range, and bool queries applied to documents containing tags, numeric fields, and dates. The scripts also illustrate Elasticsearch’s mapping and reindexing constraints when changing field types, and use the `_search`, `_count`, and `_mapping` endpoints to explore and manipulate indexed news data.

Aaaizemberg
52% match
Loading thumbnail…

Gist 4a460749f5f2d01019812d536ed42648

This example showcases a set of PostgreSQL client configuration settings designed to format query output for readability and analysis. It defines a custom prompt, enables timing information, sets unicode and wrapped table borders, and activates expanded display for wide results. A slow-query log pulls the top 100 queries by total time from the `pg_stat_statements` view, calculating average execution time per call. The configuration relies on standard `psql` meta-commands like `\pset`, `\set`, and `\x`, with no external visualization libraries involved.

XXXX
48% match
Loading thumbnail…

Bash / JQ for Cloudant Bulk Upload & Download

This example demonstrates a command-line workflow for bulk uploading and downloading JSON documents to and from a Cloudant database, using bash scripts that combine HTTPie and JQ. It shows how to aggregate multiple local JSON files into a single `_bulk_docs` payload via `jq -s`, upload that payload with an HTTP POST request, and retrieve data from a Cloudant view—transforming the response into either a plain document array or a GeoJSON FeatureCollection. The scripts also convert view output back into a file, enabling round-trip data migration and export without a custom application.

CCliffordAnderson
47% match
Loading thumbnail…

Gist d57b4594607d7185a88e

This example demonstrates parent-child relationships in Elasticsearch by indexing stores, departments, and products as nested document types. It shows how to query hierarchical data using the `has_child` filter to find stores containing departments whose products match a specific trademark. The code uses Elasticsearch’s REST API with `curl` commands to define mappings, index sample data, and execute filtered queries. It illustrates the `_parent` field for linking document types and `_routing` to enforce shard placement, while the final search combines term queries with nested `has_child` filters to retrieve relevant parent documents.

CCBasis
47% match
Loading thumbnail…

Gist 7642122

This visualization compares write performance between Apache CouchDB and couchup, a Node.js implementation using levelup and leveldb. It presents benchmark results from three tests—new writes, edits, and optimized edits—as raw text output from the `compare-new-writes.js` script, showing couchup outperforming CouchDB in the final run. The description highlights the optimization strategy of storing only new keys with complex key sequences and using `level-peek` for reads, avoiding overwrites and deletes.

Aalessioalex
47% match
Loading thumbnail…

Gist 9ea11dbcc52b4bb1c048

This example shows performance analysis for a data engineering capstone project, comparing a legacy Python log parser against a proposed Scala implementation on Spark and Mesos. The visualization tracks transfer metrics from ASCP log data, specifically examining throughput and packet rates. Using d3.js for charting, it evaluates how efficiently the new streaming solution handles regex parsing of unstructured logs. The project also demonstrates integration with Redis for persistent storage and FaspStream for live data ingestion, with the D3 visualizations presenting benchmark results from test log datasets.

BBBischof
47% match
Loading thumbnail…

My local Elasticsearch test instance

This example shows how to set up a local Elasticsearch test instance in a Vagrant virtual machine, complete with a suite of management plugins. The Vagrantfile provisions a precise64 Ubuntu VM with 512 MB of memory and a private network IP, while the es.sh script installs Elasticsearch 1.1.0 via its Debian package and then loads plugins like elasticsearch-head, elasticsearch-HQ, and bigdesk for cluster monitoring. It also demonstrates adding a JDBC river plugin with a PostgreSQL driver to enable database indexing, then starts the service and verifies it via a curl request.

Aanatolyg
47% match