0

我有一个小型 Java 应用程序,它加载类似于下面这些的日志:

Fri May 29 12:10:34 BST 2015 Trade ID: 2 status is :received
Fri May 29 14:12:36 BST 2015 Trade ID: 4 status is :received
Fri May 29 17:15:39 BST 2015 Trade ID: 3 status is :received
Fri May 29 21:19:43 BST 2015 Trade ID: 3 status is :Parsed
Sat May 30 02:24:48 BST 2015 Trade ID: 8 status is :received
Sat May 30 08:30:54 BST 2015 Trade ID: 3 status is :Data not found
Sat May 30 15:38:01 BST 2015 Trade ID: 3 status is :Book not found
Sat May 30 23:46:09 BST 2015 Trade ID: 6 status is :received

我想使用 ELK 堆栈来分析我的日志并过滤它们。我想要至少 3 个过滤器:日期和时间、交易 ID 和状态。

在我的 logstash 配置文件的过滤器部分,这是我所做的:

filter {
grok {
    match => { "message" => "%{DAY} %{MONTH} %{DAY} %{TIME} BST %{YEAR} Trade ID: %{NUMBER:tradeId}  status is : %{WORD:status}" }
  }

目前我无法根据需要过滤我的日志。

4

1 回答 1

0

您在模式之间有一些额外的空格,对于状态,您想解析整个消息,因此使用 GREEEDYDATA 而不是 WORD 是您的选择。

filter {
    grok {
        match => { "message" => "%{DAY:day} %{MONTH:month} %{MONTHDAY:monthday} %{TIME:time} BST %{YEAR:year} Trade ID: %{NUMBER:tradeId} status is :%{GREEDYDATA:status}" }
    }
}

对于此日志行:

2015 年 5 月 30 日星期六 15:38:01 BST 贸易 ID:3 状态是:找不到书

你最终会得到一个像这样的json:

{
   "message" => "Sat May 30 15:38:01 BST 2015 Trade ID: 3 status is :Book not found",
  "@version" => "1",
"@timestamp" => "2015-08-18T18:28:47.195Z",
      "host" => "Gabriels-MacBook-Pro.local",
       "day" => "Sat",
     "month" => "May",
  "monthday" => "30",
      "time" => "15:38:01",
      "year" => "2015",
   "tradeId" => "3",
    "status" => "Book not found"

}
于 2015-08-18T18:34:20.647 回答