Discrepancy in Bot Responses: Missing Initial Character...

JJoão Morossini

I'm using the Dify block to call gpt-3.5-turbo in part of my conversation flow.

The attached images illustrate the problem. Basically, a few letters go missing somewhere in between Dify and Typebot. It seems to me that this only happens to the first couple of words.

At first I thought the llm was making a mistake, but after inspecting the messages in Dify, I noticed that they were actually correct.

Then I thought it could have something to do with the OpenAI moderation API, but after a few tests, I've ruled out that hypothesis.

Thanks in advance for any help. Cheers! 🤓 👍

Edit: I had to delete the screenshots from the original post and repost them below

21 comments

BBaptiste

Hmmm

BBaptiste

I’ll need a way to reproduce it

BBaptiste

do you have a clear procedure for me to follow to have that issue ?

JJoão Morossini

Hey Baptiste, how are you? I could duplicate my Typebot flow, edit out the client specific content, export the json file and send you privately along with details from my Dify config. Would that help?

JJoão Morossini

I had to delete the screenshots from the original post and repost them. Here they are

Attachments

JJoão Morossini

I should point out that this behavior is a bit erratic. It doesn't always happen, but it's pretty frequent

BBaptiste

What's your Typebot instance version?

BBaptiste

You can see it in the Settings & Members modal

BBaptiste

Is it a Basic Assistant or Agent Assistant that you've plugged here?

BBaptiste

Can you provide more examples if you stumble upon any other?

JJoão Morossini

Typebot Version: 2.23.0
It's an Agent Assistant
I've come across other examples, but they all contain client info that I can't post.

But now that you've mentioned the type of agent, I went and tested running the same flow with the basic assistant and it worked fine. Nice guess 🙂

BBaptiste

Ok but still I wonder why it fails to stream some part of the text with the agent assistant mode 🤔

JJoão Morossini

Hello, @Baptiste . Unfortunately, it seems that the Basic Assistant faces the same issue. Here's an example I came across today. I used asterisks to omit sensitive info.

Dify
"O ** foi fundado em de ** de 2011 por 181 cidadãos de diversas profissões e estados brasileiros insatisfeitos com..."

Typebot
"O ** foi fundado em de ** de 201 por 181 cidadãos de diversas profissões e estados brasileiros insatisfeitos com..."

BBaptiste

I'd need that for debugging purpose

BBaptiste

As of now, I can't guess what goes wrong here

GGeethanjali

I have shared the details over the email. Can u try to fix asap...

BBaptiste

Thank you, it helped a lot and I think I fixed it

BBaptiste

Should be deployed in ~10 minutes

BBaptiste

Let me know 🙂