Skip to content

docs: document OpenSearch Serverless startup version-check workaround - #186

Merged
kenhys merged 1 commit into
fluent:mainfrom
Watson1978:docs
Jul 10, 2026
Merged

kenhys merged 1 commit into
fluent:mainfrom
Watson1978:docs

Conversation

@Watson1978

Copy link
Copy Markdown
Contributor

Fix #126

What

Expands the Use OpenSearch Serverless section of the README to document why fluent-plugin-opensearch fails to start against an *.aoss.amazonaws.com endpoint, and how to work around it.

Why

Fixes the confusion reported in #126. When targeting OpenSearch Serverless, the plugin retries indefinitely at startup with:

Could not communicate to OpenSearch, resetting connection and trying again. [404]

The root cause is the startup version detection: with the default verify_os_version_at_startup true, the plugin calls the root/info endpoint (GET /) to detect the OpenSearch major version, but Serverless only supports a subset of the OpenSearch APIs and does not serve GET /, so it returns 404. A plain OpenSearch Ruby client works because it goes straight to _bulk and never performs the version probe.

OpenSearch Serverless (aoss) exposes only a subset of the OpenSearch
APIs and does not serve the root/info endpoint (GET /) that the plugin
calls to detect the OpenSearch version at startup. With the default
verify_os_version_at_startup true, the version probe fails with 404 and
the plugin keeps retrying without ever sending data:

  Could not communicate to OpenSearch, resetting connection and trying
  again. [404]

Expand the "Use OpenSearch Serverless" section to explain this and to
recommend disabling the startup version check with a pinned version
(verify_os_version_at_startup false / default_opensearch_version 2).
Also list the main Serverless limitations: data access policy
permissions, unsupported custom document IDs on TIMESERIES collections,
and unsupported template/ILM/data-stream APIs.

Signed-off-by: Shizuo Fujita <fujita@clear-code.com>
@kenhys
kenhys merged commit b0e25b0 into fluent:main Jul 10, 2026
21 checks passed
@Watson1978
Watson1978 deleted the docs branch July 10, 2026 04:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Could not communicate to OpenSearch, resetting connection and trying again. [404]

2 participants