Speech recognition

Submitted by pvc2 on Wed, 11/30/2016 - 02:15
Forums: 
Feature requests

Thanks  H5p team. I like it so much. Could you plan. We are applying H5p for Onling English Training.  Would you plan to develop H5p content that support speech recognition (based on Google Engine).

Thanks

Pham

 

 

Summary: 
Speech recognition
Issue Status: 
Open
0
0
Supporter votes Members of the Supporter Network can vote for feature requests. When the supporter network has generated sufficient funding for the top voted feature request it will normally be implemented and released. More about the H5P Supporter Network
thomasmars's picture

thomasmars

Thu, 12/01/2016 - 09:40

I have created a speech recognition H5P that is about translating words from one language to english. It could easily be extended to work with other languages as well. It is just at the prototype level at the moment, but the logic is mostly there and working.

It uses the Speech Recognition web API. You can find it at github if you want to contribute with some development, design or ideas, or try out the prototype.

Is this something like what you were looking for ? It relies on the browser supporting the Web Speech API though. Any feedback is greatly appreciated.

- Thomas

otacke's picture

otacke

Thu, 12/01/2016 - 12:36

"A library for answering a question using speech recognition."

What am I looking at here? The pre-stage of a chatbot using a machine learning classifier system?

thomasmars's picture

thomasmars

Fri, 12/02/2016 - 09:57

Nothing that sophisticated. I suppose the wording could be more precise.

In essence the content type leverages the Web Speech API, which uses the browser's speech recognition engine. The implementation of this is up to the browser.

There is no grand plan for what this will be, to start with it is just a simply library for translating words by speaking the word the translation should be in english. It could easily be extended to more complex tasks though.

otacke's picture

otacke

Fri, 12/02/2016 - 10:11

Alright. Then this might be the grand plan ;-) What happened when a professor built a chatbot to be his teaching assistant

I'm still looking for a nice topic for the capstone project within the nanodegree program "machine learning engineer" at Udacity ... ;-)

thomasmars's picture

thomasmars

Fri, 12/02/2016 - 10:52

That's very interesting. I don't think the speech engine is smart, it just relies on processing text-to-speech and speech-to-text. It does not actually understand language. You would need machine learning/natural language processing for that, training data and somewhere to process all of it.

It would be very interesting if you decide to expand on this in some way! :)

otacke's picture

otacke

Fri, 12/02/2016 - 11:25

<cite>It does not actually understand language. You would need machine learning/natural language processing for that, training data and somewhere to process all of it.</cite>

That's why I was saying "pre-stage" :-) I's not likely that I will pursue that topic for the capstone project - way too ambitious. Still, I didn't take part in the program for no reason. I am really interested in machine learning and related topics. Although I think it's not the holy grail for education, I think there's quite some cool stuff that could be done in many scenarios. Adding some "intelligence" to some of the H5P libraries might be one of them.

thomasmars's picture

thomasmars

Fri, 12/02/2016 - 11:52

Yeah, there's definitely some cool stuff that could be done, let me know if you have any cool ideas you would like some help/collaboration on.

pvc2

Thu, 12/01/2016 - 11:28

Hi, Thomas!

Thank you for information, I'll have a look. Have you release it yet?

Pham

thomasmars's picture

thomasmars

Fri, 12/02/2016 - 09:57

Hi,

The content type is not released yet, presently it is just a hobby project in the prototype phase.