Share feedback, ideas and get community help

Updated 11 months ago

Elevenlabs Integration

While the Open AI TTS is great, it doesn't do many accents and, for localisation purposes, I'd prefer integrating Elevenlabs' voices.

With my limited experience with APIs (I consider myself a nocoder), I tried creating an API block that carries out a POST request to the Elevenlabs tts streaming endpoint. It returns a data object that is a long string of characters but not a url, which is what I believe we need to pass to the audio file block.

I tried searching more about this in this discord and in the docs but without success. If anyone has any particular tips or steps, would be appreciated.
2
B
n
J
7 comments
@nefer_l do you have a tutorial of Elevenlabs with Typebot? ๐Ÿ˜…
I don't have a tutorial on this one, but I did try Eleven labs a while ago. If I remember correctly, I wasn't able to stream the audio response into Typebot but rather had to save the response as a file, capture it in the Audio Block, and then the user would have to click on play to hear the audio.
Thanks, Nefer. Iโ€™m away from my computer right now so canโ€™t share screenshots, but could you explain how to go from the POST request results to the audio block? (Excuse my noobishness, I donโ€™t consider myself a coder but am learning more about APIs).
So currently you can't plug Elevenlabs with Typebot because of the limitation Nefer is referring to. I'd have to implement a native Elevenlabs block
If you do plan that, that would be wonderful. The use case I see for it is especially in international markets where the existing Open AI TTS English audio returned doesn't match the customer rep avatar in, say, the Middle East. English accents or cloned voices would really help with personalising that experience.
This would be a good idea. I use elevenlab to clone my voice.๐Ÿ‘
There's an alternative to elevenlabs if you need same quality voice clone without breaking the bank, I recommend play.ht with API plans
Add a reply
Sign up and join the conversation on Discord