opensearch (es) 修改分片

发表于 分类于 阅读次数： 本文字数： 141 阅读时长 ≈ 1 分钟

错误

Fluentd 向 ES 写入数据的时候如下报错：

1
2024-12-27 01:33:27 +0000 [warn]: #0 fluent/log.rb:381:warn: send an error event to @ERROR: error_class=Fluent::Plugin::ElasticsearchErrorHandler::ElasticsearchError error="400 - Rejected by Elasticsearch [error type]: illegal_argument_exception [reason]: 'Validation Failed: 1: this action would add [2] total shards, but this cluster currently has [3000]/[3000] maximum shards open;'" location=nil tag="kubernetes.var.log.containers.dataops-ds-worker-fbc64df5f-k6xrm_dataops_dataops-ds-worker-494d705e1a173657644f86708f16041cf8d429038c969f1237d7f040bbaa313e.log" time=2024-12-27 01:33:21.135254232 +0000

解决

1
2
3
4
5
curl -X PUT -u admin:xxxxxx --insecure https://172.23.8.175:9200/_cluster/settings -H 'Content-Type: application/json' -d '{
  "persistent": {
    "cluster.max_shards_per_node": 5000
  }
}'

其他命令

1
2
curl -X GET -u admin:xxxxxx --insecure https://172.23.8.175:9200/_cat/shards?v
curl -X GET -u admin:xxxxxx --insecure https://172.23.8.175:9200/_cluster/stats?pretty

‍