0

我正在编写一个工具来帮助分析小型日志文件(例如 1-2 MB,在极少数情况下高达 50 MB)。

日志文件来自文件同步应用程序,并包含各种不同的日志行:

2016-02-22 21:18:03,872 +0200 INFO pid=670 4664029184:PerfReporter    perf_reporter.pyo:71 Current Stats: sync_bo=0, dio=266945, blacklist_len=0, uptime=1601770, pc=60, sync_x=0, sync_y=0, prs=78368, sync_percent=0, corpus=8819, c0=1510, pvm=3095812
2016-02-22 21:18:03,874 +0200 INFO pid=670 4664029184:PerfReporter    sync_http_client.pyo:237 Opening direct connection to csi.gstatic.com:443.
2016-02-22 21:19:13,185 +0200 INFO pid=670 4650881024:SyncClientImpressionsThread impression_logger.pyo:278 Heartbeat was added.

2015-06-23 12:15:29,860 +0300 INFO pid=33914 4634906624:Worker-2        snapshot_sqlite.pyo:143 Adding local entry inode=57033344, filename=None
2015-06-23 12:15:29,861 +0300 INFO pid=33914 4634906624:Worker-2        snapshot_sqlite.pyo:171 Adding cloud entry resource_id=file:0B_JGPr4BzMr4dmdCbFBibms5WFk, filename=None
2015-06-23 12:15:29,862 +0300 INFO pid=33914 4634906624:Worker-2        snapshot_sqlite.pyo:253 Updating cloud entry doc_id=0B_JGPr4BzMr4dmdCbFBibms5WFk, filename=~$Foo Bar.xlsx

2015-06-23 12:15:30,247 +0300 INFO pid=33914 4651732992:Batcher         batcher.pyo:849 Batcher Stats = file_count = Counter({_COUNT_KEY(direction=_DownloadDirectionType(Direction.DOWNLOAD), action=_FSChangeActionType(Action.CREATE), batch=False, successful=True): 1}), byte_count = Counter({_COUNT_KEY(direction=_DownloadDirectionType(Direction.DOWNLOAD), action=
_FSChangeActionType(Action.CREATE), batch=False, successful=True): 165}), batch_operation_count = Counter(), process_seconds = Counter({_COUNT_KEY(direction=_DownloadDirectionType(Direction.DOWNLOAD), action=_FSChangeActionType(Action.CREATE), batch=False, successful=True): 0.6173379421234131}), duration seconds = 1 (start_time = 1435050929, end_time = 143505093
0)

我将解析任何键值对以及几个键属性(例如 inode 编号、文件名、doc_id)

然后,我想要一个 UI(控制台或 Web UI),它可以让您按各种内容进行过滤,并显示完整的日志:

  • 按时间范围过滤
  • 按 inode 编号、文件名、事件类型等过滤。

是否有任何现有的 UI 元素/工具包/框架可以轻松地沿多个维度进行过滤?

例如,您可以选择一个 inode 编号和事件类型,然后查看该组合的完整历史记录?

可能类似于 Splunk/Kibana 和同类允许您使用的功能,但可以作为独立组件使用?(控制台或网络)

4

1 回答 1

0

使用 MASSALYZER,您可以在控制台中进行操作。如果你需要帮助,问我!

于 2016-03-02T11:43:18.763 回答