1

我正在使用kbastani/spark-neo4j和docker -compose来分析我的图表的中介中心性。

我的节点是这样构建的:

(n1:Node {id:1})-[r:NEXT {count:100}]->(n2:Node {id:2})

我忽略了日志异常(因为我不知道如何解决它):

mazerunner_1  | 16/11/29 08:27:51 INFO FileInputFormat: Total input paths to process : 1
mazerunner_1  | Exception in thread "main" org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException): Zero blocklocations for /neo4j/mazerunner/jobs/edgeList.txt. Name node is in safe mode.
mazerunner_1  | The reported blocks 0 needs additional 28 blocks to reach the threshold 0.9990 of total blocks 28.
mazerunner_1  | The number of live datanodes 0 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached.
mazerunner_1  |     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1678)
mazerunner_1  |     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1651)
mazerunner_1  |     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1625)
mazerunner_1  |     at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:497)
mazerunner_1  |     at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:322)
mazerunner_1  |     at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
mazerunner_1  |     at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
mazerunner_1  |     at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
mazerunner_1  |     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
mazerunner_1  |     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
mazerunner_1  |     at java.security.AccessController.doPrivileged(Native Method)
mazerunner_1  |     at javax.security.auth.Subject.doAs(Subject.java:415)
mazerunner_1  |     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
mazerunner_1  |     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)

我正在从 Neo4J 浏览器运行我的工作,如下所示:

:GET /service/mazerunner/analysis/betweenness_centrality/NEXT

我可以在迷宫赛跑者日志中看到:

graphdb_1     | /var/lib/neo4j-community-2.2.3/..
graphdb_1     |  [*] Waiting for messages. To exit press CTRL+C
graphdb_1     | 08:50:31.608 [qtp198725683-33] WARN  o.a.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
graphdb_1     | Records exported: 20000
graphdb_1     | Records exported: 40000
graphdb_1     | Records exported: 60000
graphdb_1     | Records exported: 80000
graphdb_1     | Mazerunner Export Status: 100%
graphdb_1     |  [x] Sent '{"path":"hdfs://hdfs:9000/neo4j/mazerunner/jobs/edgeList.txt","analysis":"betweenness_centrality","mode":"Unpartitioned"}'

然后什么都没有……很长一段时间。
问:我怎样才能让它运行?

4

1 回答 1

0

在我的日志中

16/11/29 08:27:51 INFO FileInputFormat:要处理的总输入路径:1

那是一个古老的工作。我不得不删除 hdfs 图像,然后重新运行 docker-compose up。它解决了我的问题

于 2016-11-29T14:53:21.220 回答