elasticsearch - Elassandra 索引数据大小是实际数据的 10 倍

Question

在 Elassandra 中，cassandra 数据大小为 8GB，但 elasticsearch.data 大小为 83GB。我们有 5 msgs/sec 的数据输入流，下面是用于创建表和索引的查询：

表创建：

CREATE TABLE IF NOT EXISTS x.abc (
        internal_tag text,
        generated_at timestamp,
        collected_at timestamp,
        data_type text,
        metadata text,
        recorded_at timestamp,
        value text,
        PRIMARY KEY(internal_tag, generated_at)
)
WITH CLUSTERING ORDER BY(generated_at ASC)
AND bloom_filter_fp_chance = 0.01
AND caching = { 'keys': 'ALL', 'rows_per_partition': 'NONE' }
AND comment = ''
AND compaction = { 'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4' }
AND compression = { 'chunk_length_in_kb': '64', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor' }
AND crc_check_chance = 1.0
AND default_time_to_live = 0
AND gc_grace_seconds = 864000
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99PERCENTILE';

索引创建：

curl -XPUT -H 'Content-Type: application/json' 'http://10.0.0.01:9200/x_abc_index' -d '{
        "settings": {
        "keyspace": "x"
    },
        "mappings":{
                "abc" : {
                        "discover":".*"
                }
        }
}'

请提出任何解决数据大小问题的解决方案。谢谢

Answer 1

LeBigCat 建议，您可以通过减少映射中索引字段的数量或选择正确的映射来减小弹性搜索索引的大小。