我有一个三节点的cassandra集群。当我从集群进行多线程查询时,io负载非常高。集群每个节点大约保存80GB数据。我使用时间窗口紧凑策略,时间窗口是十小时。一个sstable大约是 1GB。有人能帮我吗。谢谢。一个稳定
的信息
数据以每秒10000条的速度。集群拥有大约100亿条记录。以下是架构信息
CREATE TABLE point_warehouse.point_period (
point_name text,
year text,
time timestamp,
period int,
time_end timestamp,
value text,
PRIMARY KEY ((point_name, year), time)
) WITH CLUSTERING ORDER BY (time DESC)
AND bloom_filter_fp_chance = 0.01
AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
AND comment = ''
AND compaction = {'class': 'org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy', 'compaction_window_size': '10', 'compaction_window_unit': 'HOURS', 'max_threshold': '32', 'min_threshold': '4'}
AND compression = {'chunk_length_in_kb': '64', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
AND crc_check_chance = 1.0
AND dclocal_read_repair_chance = 0.1
AND default_time_to_live = 2592000
AND gc_grace_seconds = 864000
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99PERCENTILE';
并且查询是SELECT * from POINT_PERIOD where POINT_NAME=? AND YEAR='2017' AND TIME >'2017-05-23 12:53:24
按时间排序的 asc LIMIT 1 ALLOW FILTERING'
当同时执行此查询时,io 负载变得非常高,例如 200MB/s。谢谢你 。