Elasticsearch edit   discuss  

A distributed search server built on Apache Lucene that supports a number of advanced analytics over search results. Data is stored in indexes, with each index able to support multiple schemas (types), with the data itself sharded to support distributed parallel queries, with multiple replicas of each shard providing resilience and redundancy. Supports both pre-defined and schemaless types, all standard Lucene functionality (including faceting, grouping, clustering, hit highlighting, geo support, near real time indexing), the ability to update and delete documents (by id or query), upsert operations, batch operations, re-indexing (from one index into a second index), generated or calculated fields, document versioning and optimistic concurrency control, nested searches based on sub-documents or explicit parent-child document links, templated searches, a range of aggregations (include support for metrics, bucketing results, matrix calculations and custom aggregations using pipelines), custom analysers for indexing data, custom transformation pipelines prior to indexing (via an ingest node), the ability to query across clusters (cross cluster search), a plugin framework, registered queries that are executed against newly indexed data (percolation) and the ability to snapshot and restore indexes using HDFS, S3, Azure and Google Cloud. Also now includes a number of features that were previously bundled separately in the Elastic X-Pack, including Security (encryption of data and links, authentication via LDAP and Active Directory, authorisation at the cluster, index, document and field level, and full audit logging), Monitoring (export of cluster, nod and index metrics), Alerting (via Watcher, allowing registration of scheduled queries over monitoring data that can perform a number of extensible actions), Graph (APIs for working with relationships, with connections between indexed terms generated on the fly using Elasticsearch aggregations and relevance scoring), SQL access (via a REST API, CLI or JDBC interface), Machine Learning (support for automated anomaly detection jobs over time-series data run on the ElasticSearch cluster) and Rollup (aggregation of historical data), the majority of which require a commercial licence from Elastic in order to be enabled. Comes with a REST API, with clients available for a range of languages including Java, C#, Python, JavaScript, PHP, Perl and Ruby. First released in February 2010, with a 1.0 release in February 2014. Open source under the Apache licence, with the exception of the X-Pack components which are under an Elastic licence following the open sourcing of X-Pack in version 6.3. Development is led by Elastic, who were formed in 2012 by the creator of Elasticsearch and a lead Lucene contributor, and who provide commercial support, licences to enable the commercial X-Pack features, and an on-site or public cloud service offering (Elastic Cloud).

Technology Information

VendorsElastic
TypeCommercial Open Source
Last UpdatedAugust 2019 - v7.3

Related Technologies

Add onsElasticsearch-Hadoop
Manageable viaElastic Cloud
Is packaged byMapR Monitoring

Further Information

A list of some add-ons that are an alternative to the X-Pack commercial features is available from Sematext at https://sematext.com/blog/x-pack-alternatives/

Release History

versionrelease daterelease linksrelease comment
5.52017-07-06announcement; release notesWindows installer
5.62017-09-11announcement; release notesHigh Level REST Client
6.02017-11-14announcement; release notesRemoval of mapping types
6.12017-12-13announcement; release notes 
6.22018-02-06announcement; release notes 
6.32018-06-13announcement; release notesExperimental SQL & pre-generated rollups support; addition of X-Pack components
6.42018-08-23announcement; release notes 
6.52018-11-14announcement; release notesCross cluster replication; ODBC driver; Java 100 support
6.62019-01-29announcement; release notesIndex lifecycle management beta
6.72019-03-26announcement; release notesCross cluster replication, index lifecycle management and SQL all GA; Pluggable Authorization Engines
6.82019-05-20announcement; release notesTLS and Role Based Access Control (RBAC) now free - guide
7.02019-04-10announcement; release notesremoval of types
7.12019-05-20announcement; release notesTLS and Role Based Access Control (RBAC) now free - guide
7.22019-06-25announcement; release notes 
7.32019-07-31announcement 

News

Blog Posts