1

我能够使用默认键空间和表运行 cassandra-stress，但是参考 datastax 文档，我试图通过使用自己的配置文件来使用 cassandra-stress 工具。Datastax 文档 - https://docs.datastax.com/en/dse/5.1/dse-admin/datastax_enterprise/tools/toolsCStress.html

我有 2 个具有 (2+1) 节点和 cassandra 3.11 设置的 DC，我相应地修改了 yaml 文件，但出现错误。

命令 -

cassandra-stress user profile=/var/lib/cassandra/stresstest/cqlstress-example.yaml n=1000000 ops\(insert=3,read1=1\) no-warmup cl=one

错误 -

java.io.IOError: while parsing a block mapping
 in 'reader', line 5, column 4:
       CREATE KEYSPACE perftesting WITH ...
       ^
expected <block end>, but found FlowEntry
 in 'reader', line 5, column 87:
     ... lass': 'NetworkTopologyStrategy', 'dc1': 1, 'dc2': 2};
                                         ^

    at org.apache.cassandra.stress.StressProfile.load(StressProfile.java:823)
    at org.apache.cassandra.stress.settings.SettingsCommandUser.<init>(SettingsCommandUser.java:62)
    at org.apache.cassandra.stress.settings.SettingsCommandUser.build(SettingsCommandUser.java:150)
    at org.apache.cassandra.stress.settings.SettingsCommand.get(SettingsCommand.java:217)
    at org.apache.cassandra.stress.settings.StressSettings.get(StressSettings.java:264)
    at org.apache.cassandra.stress.settings.StressSettings.parse(StressSettings.java:241)
    at org.apache.cassandra.stress.Stress.run(Stress.java:80)
    at org.apache.cassandra.stress.Stress.main(Stress.java:62)
Caused by: while parsing a block mapping
 in 'reader', line 5, column 4:
       CREATE KEYSPACE perftesting WITH ...
       ^
expected <block end>, but found FlowEntry
 in 'reader', line 5, column 87:
     ... lass': 'NetworkTopologyStrategy', 'dc1': 1, 'dc2': 2};
                                         ^
    at org.yaml.snakeyaml.parser.ParserImpl$ParseBlockMappingKey.produce(ParserImpl.java:570)
    at org.yaml.snakeyaml.parser.ParserImpl.peekEvent(ParserImpl.java:158)
    at org.yaml.snakeyaml.parser.ParserImpl.checkEvent(ParserImpl.java:143)
    at org.yaml.snakeyaml.composer.Composer.composeMappingNode(Composer.java:230)
    at org.yaml.snakeyaml.composer.Composer.composeNode(Composer.java:159)
    at org.yaml.snakeyaml.composer.Composer.composeMappingNode(Composer.java:237)
    at org.yaml.snakeyaml.composer.Composer.composeNode(Composer.java:159)
    at org.yaml.snakeyaml.composer.Composer.composeDocument(Composer.java:122)
    at org.yaml.snakeyaml.composer.Composer.getSingleNode(Composer.java:105)
    at org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(BaseConstructor.java:120)
    at org.yaml.snakeyaml.Yaml.loadFromReader(Yaml.java:481)
    at org.yaml.snakeyaml.Yaml.loadAs(Yaml.java:475)
    at org.apache.cassandra.stress.StressProfile.load(StressProfile.java:814)
    ... 7 more

cqlstress-example.yaml 的内容

keyspace: perftesting

keyspace_definition: 

  CREATE KEYSPACE perftesting WITH replication = { 'class': 'NetworkTopologyStrategy', 'dc1': 1, 'dc2': 2};
  
table: users

table_definition:

  CREATE TABLE users (
    username text,
    first_name text,
    last_name text,
    password text,
    email text,
    last_access timeuuid,
    PRIMARY KEY(username)
  );

extra_definitions:
  - CREATE MATERIALIZED VIEW perftesting.users_by_first_name AS SELECT * FROM perftesting.users WHERE first_name IS NOT NULL and username IS NOT NULL PRIMARY KEY (first_name, username);
  - CREATE MATERIALIZED VIEW perftesting.users_by_first_name2 AS SELECT * FROM perftesting.users WHERE first_name IS NOT NULL and username IS NOT NULL PRIMARY KEY (first_name, username);
  - CREATE MATERIALIZED VIEW perftesting.users_by_first_name3 AS SELECT * FROM perftesting.users WHERE first_name IS NOT NULL and username IS NOT NULL PRIMARY KEY (first_name, username);

columnspec:
  - name: username
    size: uniform(10..30)
  - name: first_name
    size: fixed(16)
  - name: last_name
    size: uniform(1..32)
  - name: password
    size: fixed(80) # sha-512
  - name: email
    size: uniform(16..50)
  - name: startdate
    cluster: uniform(20...40)
  - name: description
    size: gaussian(100...500)
  
insert:
  partitions: fixed(10)
  batchtype: UNLOGGED

queries:
  read1:
    cql: select * from users where username = ? and startdate = ?
    fields: samerow     # samerow or multirow (select arguments from the same row, or randomly from all rows in the partition)
4

2 回答 2

1

里面的 yaml 解析器cassandra-stress非常严格。我总是在提前定义模式方面取得了更大的成功，并且只是利用压力来插入/查询数据。

我的建议是CREATE从您的 中删除这些语句stress.yaml，通过 cqlsh 预先运行它们，然后再试一次。

于 2021-01-11T18:30:26.857 回答
1

就像@Aaron 所说，最好事先定义模式。

另一方面，请注意 yaml 文件中的多行 CQL 语句。我发现将多行语句更改为单行语句解决了我的大部分问题。

拥有一个带有 yaml 语法突出显示的 IDE 可能有助于查看您的语法是否是您想要的。

于 2021-04-26T06:12:37.233 回答