Share feedback, ideas and get community help

Updated 4 months ago

Typebot understands audio using ChatGPT/OpenAI?

At a glance

The community member is using the OpenAI ChatGPT 4ºmini assistant and wants to know if there is a way for the Typebot to understand audio from the sender and respond accordingly. They mention that the bot can send audio, but when it receives audio, it says it doesn't understand. The community member suggests that they can transcribe the audio to text using the OpenAI API and then respond, and they want to know if they should add the suggested code in the "Add Function" in the OpenAI integration in Typebot.

The comments from other community members suggest that the OpenAI block in Typebot has a "Create transcription" action that can be used to transcribe an audio URL into text.

hey guys, is there a way for the typebot to understand audio from the sender? And answer accordingly?
I know the bot can send the audio, but when it receives, it says it doesnt understand.
I'm using the assistant from OpenAI ChatGPT 4ºmini.
Do I need the regular one or is a configuration on typebot?

In OpenAI documentation in API, it seems that I can transcribe audio to text and then respond. So to implent this on Typebot should I add the suggested code in the Add Function in OpenAI integration in typebot?
Attachments
Captura_de_Tela_2024-10-18_as_10.42.20.png
Captura_de_Tela_2024-10-18_as_10.43.46.png
B
2 comments
OpenAI block has a "Create transcription" action that you can use
it allows you to transcribe a audio URL into text.
Add a reply
Sign up and join the conversation on Discord