CVS commit: pkgsrc/databases/elasticsearch

["Filip Hajny" <fhajny%netbsd.org@localhost>]

Module Name:    pkgsrc
Committed By:   fhajny
Date:           Wed Sep 27 12:33:36 UTC 2017

Modified Files:
        pkgsrc/databases/elasticsearch: Makefile PLIST distinfo

Log Message:
Update databases/elasticsearch to 5.6.2.

== 5.6.2 Release Notes

=== Bug fixes

Aggregations::
- Do not delegate a null scorer to LeafBucketCollectors

Inner Hits::
- Do not allow inner hits that fetch _source and have a non nested
  object field as parent

Internal::
- Catch exceptions and inform handler in
  RemoteClusterConnection#collectNodes

Java API::
- BulkProcessor flush runnable preserves the thread context from
  creation time

Java High Level REST Client::
- Make RestHighLevelClient's Request class public

Plugin Analysis Kuromoji::
- Fix kuromoji default stoptags

Plugin Repository HDFS::
- Fix permission errors when using Read Only HDFS Repository

Query DSL::
-  Fixed incomplete JSON body on count request making
   org.elasticsearch.rest.action.RestActions#parseTopLevelQueryBuilder
   go into endless loop

Scripting::
- Add missing script contexts and types allowed settings

Upgrade API::
- Upgrade API: fix excessive logging and unnecessary template updates

=== Upgrades

Logging::
- Upgrade to Log4j 2.9.1

== 5.6.1 Release Notes

=== Bug fixes

Highlighting::
- Fix percolator highlight sub fetch phase to not highlight query twice

Mapping::
- Fix unmapped_type creation for indices created in 2.x

Similarities::
- Add boolean similarity to built in similarity types

=== Upgrades

Core::
- Upgrade to Lucene-6.6.1.

== 5.6.0 Release Notes

=== Breaking Java changes

Java High Level REST Client::
- Allow RestHighLevelClient to use plugins

Java REST Client::
- Rename client artifacts

=== Deprecations

Highlighting::
- Postings highlighter deprecation

Indexed Scripts/Templates::
- Scripting: Deprecate stored search template apis

Mapping::
- Add deprecation logging when _all is enabled

Query DSL::
- Deprecate omitting terms lookup index name in 5.6

Scripting::
- Scripting: Deprecate scripts.max_compilation_per_minute setting
- Scripting: Change keys for inline/stored scripts to source/id

Tribe Node::
- Deprecate tribe service

=== New features

Java High Level REST Client::
- Backport high level REST client

Parent/Child::
- Typeless parent child backport
- Move parent_id query to the parent-join module
- Introduce ParentJoinFieldMapper, a field mapper that creates
  parent/child relation within documents of the same index

Upgrade API::
- TemplateUpgraders should be called during rolling restart

=== Enhancements

Allocation::
- Adjust status on bad allocation explain requests
- Promote replica on the highest version node

Analysis::
- [analysis-icu] Allow setting unicodeSetFilter

CAT API::
- expand `/_cat/nodes` to return information about hard drive

Cluster::
- Validate a joining node's version with version of existing cluster
  nodes

Core::
- Add max file size bootstrap check
- Explicitly reject duplicate data paths

Highlighting::
- Picks offset source for the unified highlighter directly from the es
  mapping

Index APIs::
- Create index request should return the index name

Ingest::
- Add Ingest-Processor specific Rest Endpoints & Add Grok endpoint
- Port support for commercial GeoIP2 databases from Logstash.
- Allow removing multiple fields in ingest processor
- Add target_field parameter to ingest processors

Internal::
- Use holder pattern for lazy deprecation loggers
- "shard started" should show index and shard ID
- Break out clear scroll logic from TransportClearScrollAction
- Add helper methods to TransportActionProxy to identify proxy actions
  and requests
- Add remote cluster infrastructure to fetch discovery nodes.
- Disallow multiple parent-join fields per mapping

Java High Level REST Client::
- [DOCS] restructure java clients docs pages
- Use SPI in High Level Rest Client to load XContent parsers

Java REST Client::
- Shade external dependencies in the rest client jar
- RestClient uses system properties and system default SSLContext

Logging::
- Use LRU set to reduce repeat deprecation messages

Mapping::
- Optimize `terms` queries on `ip` addresses to use a `PointInSetQuery`
  whenever possible.

Network::
- Simplify connection closing and cleanups in TcpTransport

Packaging::
- Remove memlock suggestion from systemd service
- Set address space limit in systemd service file

Parent/Child::
- Remove ParentJoinFieldSubFetchPhase
- Support parent id being specified as number in the _source

Query DSL::
- Make slop optional when parsing `span_near` query

Search::
- Reduce the overhead of timeouts and low-level search cancellation.
- Reduce profiling overhead.
- Backport `can_match` endpoint to 5.6 to allow 6.0 to use the
  optimization in mixed version
- Add a shard filter search phase to pre-filter shards based on query
  rewriting
- Ensure we rewrite common queries to `match_none` if possible
- Limit the number of concurrent shard requests per search request
- Add cluster name validation to RemoteClusterConnection
- Leverage scorerSupplier when applicable.
- Add Cross Cluster Search support for scroll searches

Sequence IDs::
- 5.x - Move primary term from ReplicationRequest to
  ConcreteShardRequest
- Forward compatibility for primary context handoff on 6.x

Settings::
- Emit settings deprecation logging at most once
- IndexMetaData: Introduce internal format index setting

Snapshot/Restore::
- Improves snapshot logging and snapshot deletion error handling

Stats::
- Update `IndexShard#refreshMetric` via a
  `ReferenceManager.RefreshListener`

=== Bug fixes

Aggregations::
- Fixes array out of bounds for value count agg

Aliases::
- mget with an alias shouldn't ignore alias routing

Allocation::
- Allow wildcards for shard IP filtering

Analysis::
- Pre-configured shingle filter should disable graph analysis

CRUD::
- Serialize and expose timeout of acknowledged requests in REST layer
  (ES 5.6)

Cluster::
- Register setting `cluster.indices.tombstones.size`

Core::
- Release operation permit on thread-pool rejection
- Node should start up despite of a lingering `.es_temp_file`

Discovery::
- MasterNodeChangePredicate should use the node instance to detect
  master change

Engine::
- Engine - Do not store operations that are not index into lucene in the
  translog (5.x only)

Geo::
- Fix GeoPoint FieldStats ternary logic bug

Highlighting::
- Fix nested query highlighting
- FastVectorHighlighter should not cache the field query globally

Index APIs::
- Shrink API should ignore templates
- Rollover max docs should only count primaries

Ingest::
- Sort Processor does not have proper behavior with targetField

Inner Hits::
- Fix inner hits to work with queries wrapped in an indices query
- When fetching nested inner hits only access stored fields when needed

Internal::
- Fix BytesReferenceStreamInput#skip with offset
- Fix race condition in RemoteClusterConnection node supplier
- Initialise empty lists in BaseTaskResponse constructor

Java High Level REST Client::
- Register ip_range aggregation with the high level client
- add top hits as a parsed aggregation to the rest high level client

Logging::
- Lazy initialize deprecation logger in parser
- Allow not configure logging without config
- Declare XContent deprecation logger as static

Mapping::
- ICUCollationKeywordFieldMapper use SortedSetDocValuesField
- Fixed bug that mapper_parsing_exception is thrown for numeric field
  with ignore_malformed=true when inserting "NaN"
- Coerce decimal strings for whole number types by truncating the
  decimal part
- Fix parsing of ip range queries.
- Remove `fielddata:false` from mappings of non-analyzed strings.
- Disable date field mapping changing
- token_count datatype should handle null value
- keep _parent field while updating child type mapping

Nested Docs::
- In case of a single type the _id field should be added to the nested
  document instead of _uid field

Network::
- Release pipelined http responses on close
- Ensure pending transport handlers are invoked for all channel failures

Packaging::
- setgid on /etc/elasticearch on package install
- Stop disabling explicit GC
- Avoid failing install if system-sysctl is masked
- Get short path name for native controllers
- When stopping via systemd only kill the JVM, not its control group

Parent/Child::
- The default _parent field should not try to load global ordinals

Plugin Lang Painless::
- Painless: allow doubles to be casted to longs.

Plugin Repository HDFS::
- Upgrading HDFS Repository Plugin to use HDFS 2.8.1 Client

Query DSL::
- Parse "*" in query_string_query as MatchAllDocsQuery
- SpanNearQueryBuilder should return the inner clause when a single
  clause is provided
- WrapperQueryBuilder should also rewrite the parsed query

REST::
- Fix handling of exceptions thrown on HEAD requests

Search::
- Fix term(s) query for range field
- Caching a MinDocQuery can lead to wrong results.
- First increment shard stats before notifying and potentially sending
  response
- Remove assertion about deviation when casting to a float.
- Prevent skipping shards if a suggest builder is present
- Ensure remote cluster alias is preserved in inner hits aggs
- Do not search locally if remote index pattern resolves to no indices

Settings::
- Fix settings serialization to not serialize secure settings or not
  take the total size into account
- Keystore CLI should use the AddFileKeyStoreCommand for files

Snapshot/Restore::
- Snapshot/Restore: fix NPE while handling null failure reasons
- Snapshot/Restore: Ensure that shard failure reasons are correctly
  stored in CS
- Output all empty snapshot info fields if in verbose mode

Stats::
- _nodes/stats should not fail due to concurrent AlreadyClosedException

Suggesters::
- Context suggester should filter doc values field

=== Upgrades

Network::
- Upgrade to Netty 4.1.13.Final

Upgrade API::
- Improve stability and logging of TemplateUpgradeServiceIT tests

== 5.5.3 Release Notes

=== Deprecations

Mapping::
- Add deprecation logging when _all is enabled

=== Bug fixes

Packaging::
- setgid on /etc/elasticearch on package install


To generate a diff of this commit:
cvs rdiff -u -r1.32 -r1.33 pkgsrc/databases/elasticsearch/Makefile
cvs rdiff -u -r1.21 -r1.22 pkgsrc/databases/elasticsearch/PLIST
cvs rdiff -u -r1.33 -r1.34 pkgsrc/databases/elasticsearch/distinfo

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: pkgsrc/databases/elasticsearch/Makefile
diff -u pkgsrc/databases/elasticsearch/Makefile:1.32 pkgsrc/databases/elasticsearch/Makefile:1.33
--- pkgsrc/databases/elasticsearch/Makefile:1.32        Fri Aug 18 09:03:08 2017
+++ pkgsrc/databases/elasticsearch/Makefile     Wed Sep 27 12:33:36 2017
@@ -1,6 +1,6 @@
-# $NetBSD: Makefile,v 1.32 2017/08/18 09:03:08 fhajny Exp $
+# $NetBSD: Makefile,v 1.33 2017/09/27 12:33:36 fhajny Exp $
 
-DISTNAME=      elasticsearch-5.5.2
+DISTNAME=      elasticsearch-5.6.2
 CATEGORIES=    textproc
 MASTER_SITES=  https://artifacts.elastic.co/downloads/elasticsearch/
 

Index: pkgsrc/databases/elasticsearch/PLIST
diff -u pkgsrc/databases/elasticsearch/PLIST:1.21 pkgsrc/databases/elasticsearch/PLIST:1.22
--- pkgsrc/databases/elasticsearch/PLIST:1.21   Fri Aug 18 09:03:08 2017
+++ pkgsrc/databases/elasticsearch/PLIST        Wed Sep 27 12:33:36 2017
@@ -1,4 +1,4 @@
-@comment $NetBSD: PLIST,v 1.21 2017/08/18 09:03:08 fhajny Exp $
+@comment $NetBSD: PLIST,v 1.22 2017/09/27 12:33:36 fhajny Exp $
 bin/elasticsearch
 bin/elasticsearch-plugin
 lib/elasticsearch/bin/elasticsearch.in.sh
@@ -10,28 +10,28 @@ lib/elasticsearch/lib/jackson-dataformat
 lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
 lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
 lib/elasticsearch/lib/java-version-checker-${PKGVERSION}.jar
-lib/elasticsearch/lib/jna-4.4.0.jar
+lib/elasticsearch/lib/jna-4.4.0-1.jar
 lib/elasticsearch/lib/joda-time-2.9.5.jar
 lib/elasticsearch/lib/jopt-simple-5.0.2.jar
 lib/elasticsearch/lib/jts-1.13.jar
-lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
-lib/elasticsearch/lib/log4j-api-2.8.2.jar
-lib/elasticsearch/lib/log4j-core-2.8.2.jar
-lib/elasticsearch/lib/lucene-analyzers-common-6.6.0.jar
-lib/elasticsearch/lib/lucene-backward-codecs-6.6.0.jar
-lib/elasticsearch/lib/lucene-core-6.6.0.jar
-lib/elasticsearch/lib/lucene-grouping-6.6.0.jar
-lib/elasticsearch/lib/lucene-highlighter-6.6.0.jar
-lib/elasticsearch/lib/lucene-join-6.6.0.jar
-lib/elasticsearch/lib/lucene-memory-6.6.0.jar
-lib/elasticsearch/lib/lucene-misc-6.6.0.jar
-lib/elasticsearch/lib/lucene-queries-6.6.0.jar
-lib/elasticsearch/lib/lucene-queryparser-6.6.0.jar
-lib/elasticsearch/lib/lucene-sandbox-6.6.0.jar
-lib/elasticsearch/lib/lucene-spatial-6.6.0.jar
-lib/elasticsearch/lib/lucene-spatial-extras-6.6.0.jar
-lib/elasticsearch/lib/lucene-spatial3d-6.6.0.jar
-lib/elasticsearch/lib/lucene-suggest-6.6.0.jar
+lib/elasticsearch/lib/log4j-1.2-api-2.9.1.jar
+lib/elasticsearch/lib/log4j-api-2.9.1.jar
+lib/elasticsearch/lib/log4j-core-2.9.1.jar
+lib/elasticsearch/lib/lucene-analyzers-common-6.6.1.jar
+lib/elasticsearch/lib/lucene-backward-codecs-6.6.1.jar
+lib/elasticsearch/lib/lucene-core-6.6.1.jar
+lib/elasticsearch/lib/lucene-grouping-6.6.1.jar
+lib/elasticsearch/lib/lucene-highlighter-6.6.1.jar
+lib/elasticsearch/lib/lucene-join-6.6.1.jar
+lib/elasticsearch/lib/lucene-memory-6.6.1.jar
+lib/elasticsearch/lib/lucene-misc-6.6.1.jar
+lib/elasticsearch/lib/lucene-queries-6.6.1.jar
+lib/elasticsearch/lib/lucene-queryparser-6.6.1.jar
+lib/elasticsearch/lib/lucene-sandbox-6.6.1.jar
+lib/elasticsearch/lib/lucene-spatial-6.6.1.jar
+lib/elasticsearch/lib/lucene-spatial-extras-6.6.1.jar
+lib/elasticsearch/lib/lucene-spatial3d-6.6.1.jar
+lib/elasticsearch/lib/lucene-suggest-6.6.1.jar
 lib/elasticsearch/lib/plugin-cli-${PKGVERSION}.jar
 lib/elasticsearch/lib/securesm-1.1.jar
 lib/elasticsearch/lib/snakeyaml-1.15.jar
@@ -48,7 +48,7 @@ lib/elasticsearch/modules/lang-expressio
 lib/elasticsearch/modules/lang-expression/asm-commons-5.0.4.jar
 lib/elasticsearch/modules/lang-expression/asm-tree-5.0.4.jar
 lib/elasticsearch/modules/lang-expression/lang-expression-${PKGVERSION}.jar
-lib/elasticsearch/modules/lang-expression/lucene-expressions-6.6.0.jar
+lib/elasticsearch/modules/lang-expression/lucene-expressions-6.6.1.jar
 lib/elasticsearch/modules/lang-expression/plugin-descriptor.properties
 lib/elasticsearch/modules/lang-expression/plugin-security.policy
 lib/elasticsearch/modules/lang-groovy/groovy-2.4.6-indy.jar
@@ -70,24 +70,25 @@ lib/elasticsearch/modules/percolator/per
 lib/elasticsearch/modules/percolator/plugin-descriptor.properties
 lib/elasticsearch/modules/reindex/commons-codec-1.10.jar
 lib/elasticsearch/modules/reindex/commons-logging-1.1.3.jar
+lib/elasticsearch/modules/reindex/elasticsearch-rest-client-${PKGVERSION}.jar
 lib/elasticsearch/modules/reindex/httpasyncclient-4.1.2.jar
 lib/elasticsearch/modules/reindex/httpclient-4.5.2.jar
 lib/elasticsearch/modules/reindex/httpcore-4.4.5.jar
 lib/elasticsearch/modules/reindex/httpcore-nio-4.4.5.jar
 lib/elasticsearch/modules/reindex/plugin-descriptor.properties
+lib/elasticsearch/modules/reindex/plugin-security.policy
 lib/elasticsearch/modules/reindex/reindex-${PKGVERSION}.jar
-lib/elasticsearch/modules/reindex/rest-${PKGVERSION}.jar
 lib/elasticsearch/modules/transport-netty3/netty-3.10.6.Final.jar
 lib/elasticsearch/modules/transport-netty3/plugin-descriptor.properties
 lib/elasticsearch/modules/transport-netty3/plugin-security.policy
 lib/elasticsearch/modules/transport-netty3/transport-netty3-${PKGVERSION}.jar
-lib/elasticsearch/modules/transport-netty4/netty-buffer-4.1.11.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-codec-4.1.11.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-codec-http-4.1.11.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-common-4.1.11.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-handler-4.1.11.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-resolver-4.1.11.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-transport-4.1.11.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-buffer-4.1.13.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-codec-4.1.13.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-codec-http-4.1.13.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-common-4.1.13.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-handler-4.1.13.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-resolver-4.1.13.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-transport-4.1.13.Final.jar
 lib/elasticsearch/modules/transport-netty4/plugin-descriptor.properties
 lib/elasticsearch/modules/transport-netty4/plugin-security.policy
 lib/elasticsearch/modules/transport-netty4/transport-netty4-${PKGVERSION}.jar

Index: pkgsrc/databases/elasticsearch/distinfo
diff -u pkgsrc/databases/elasticsearch/distinfo:1.33 pkgsrc/databases/elasticsearch/distinfo:1.34
--- pkgsrc/databases/elasticsearch/distinfo:1.33        Fri Aug 18 09:03:08 2017
+++ pkgsrc/databases/elasticsearch/distinfo     Wed Sep 27 12:33:36 2017
@@ -1,9 +1,9 @@
-$NetBSD: distinfo,v 1.33 2017/08/18 09:03:08 fhajny Exp $
+$NetBSD: distinfo,v 1.34 2017/09/27 12:33:36 fhajny Exp $
 
-SHA1 (elasticsearch-5.5.2.tar.gz) = 91b3b3c823fafce54609ed5c9075d9cf50b2edff
-RMD160 (elasticsearch-5.5.2.tar.gz) = d4c369766b8480316f10bd2f1f541250446132f1
-SHA512 (elasticsearch-5.5.2.tar.gz) = 62048f15b43e38a61e3a19a1599c25cd0d9009cc1172db5b450b04dec349ecd313b1f20e3d1c7ed1c101ae3e6f6c6d2cdf004a9713ad803576277f93e3adbdb9
-Size (elasticsearch-5.5.2.tar.gz) = 33485703 bytes
+SHA1 (elasticsearch-5.6.2.tar.gz) = 114c46f011d1d576fd05e9957b8a235ebe4b7c74
+RMD160 (elasticsearch-5.6.2.tar.gz) = 114ca1200c97d11a80bafb36f445a872b992afed
+SHA512 (elasticsearch-5.6.2.tar.gz) = a20cd6607cc9fd94b37c8592b2aaaede4136349d66175581ccba999bc5a64038387680f471fca600afc2b538e4aecbb9d3ee1f82aa327853d072feff2f950319
+Size (elasticsearch-5.6.2.tar.gz) = 33766495 bytes
 SHA1 (patch-bin_elasticsearch) = 5360818fb870c0005e23f0fb247efa247a909f47
 SHA1 (patch-bin_elasticsearch-plugin) = 56db071765b91a4846e1529b5fe8be2c549b449d
 SHA1 (patch-config_elasticsearch.yml) = 8a59f9123b8bc1c40d17131dc51c361fa210c17c