android - tensorflow-lite and nnapi hw acceleration for embedded linux

Question

TensorFlow-lite is for embedded linux system and Android NNAPI is for hw acceleration for Android system. I do like to find out solutions for embedded linux not android with Tensorflow-Lite hw acceleration.

Answer 1

NNAPI 是 Tensorflow-Lite 目前唯一可用的硬件加速。话虽如此，Tensorflow-Lite 框架旨在通过使用硬件加速的自定义 Ops 轻松扩展。此外，tensorflow lite 内置操作已经利用特定的 CPU 指令（ARM NEON、Intel SSE）来加速推理。

您是否针对特定的嵌入式 linux 系统？