0

I'm working on a project about Cued Speech (it's a visual system of communication used with and among deaf or hard-of-hearing people). It is a phonemic-based system which makes traditionally spoken languages accessible by using a small number of handshapes, known as cues, (representing consonants) in different locations near the mouth (representing vowels), as a supplement to speechreading.

I already followed the tutorial about phonemes recognition (pocketsphinx_continuous), pocketsphinx on android and it's working. I'm working for now on Android but the final goal of this project is to make it work on Google glass. The best case is to write on the device the speech (closer as real time) and an avatar in 3D which will reproduce the correct hand configuration and lips mouvement according to the phoneme identified. (That's why i need to work with phonemes and not the word it self)

I read http://cmusphinx.sourceforge.net/wiki/phonemerecognition but i'm quite confuse about how to create my own "files" for french phonemes to make it works on Android.

What are the steps ? What kind of file should i create ?

In other words, is it possible to have the same result of pocketsphinx_continuous with phonemes on Android with voice input ?

I hope you can guide me !

Guillaume

4

1 回答 1

3

最新的pocketsphinx 演示包括通过“电话”搜索激活的语音识别模式，详情请参见源代码：

https://github.com/cmusphinx/pocketsphinx-android-demo

要将其与法语一起使用，您需要使用法语声学模型对其进行更新：

http://sourceforge.net/projects/cmusphinx/files/Acoustic%20and%20Language%20Models/French%20F0%20Broadcast%20News%20Acoustic%20Model/lium_french_f0.tar.gz/download

并使用法语语音语言模型：

http://sourceforge.net/projects/cmusphinx/files/Acoustic%20and%20Language%20Models/French%20Language%20Model/fr-phone.lm.dmp/download

像这样：

    recognizer = defaultSetup()
            .setAcousticModel(new File(modelsDir, "hmm/french");
            .setBoolean("-allphone_ci", true)
            .getRecognizer();
    // Phonetic search
    File phoneticModel = new File(modelsDir, "phone/fr-phone.lm.dmp");
    recognizer.addAllphoneSearch(PHONE_SEARCH, phoneticModel);

我怀疑它在 Glass 上能否正常工作，但它似乎不是一个非常强大的设备。

于 2014-11-30T00:24:54.307 回答