Find centralized, trusted content and collaborate around the technologies you use most.
Teams
Q&A for work
Connect and share knowledge within a single location that is structured and easy to search.
现在我正在通过 HttpFS 摄取日志,这在绝对数量上分崩离析。出于性能原因,我无法在边缘运行 JVM。所以我正在考虑使用本机协议进行摄取(我听说它是 IPC 或原始网络套接字魔术)
hadoop fs -put localfile -fs webhdfs://datanode:14000/hadoopfile
hadoop fs -put localfile hdfs://namenode/hadoopfile
恕我直言,实际上没有区别,因为这两种情况下的底层协议都是 TCP/IP。