GPT-4V (Vision)

VVilela™

I'm attempting to integrate Typebot with GPT-4V (Vision) through the Webhook Block.
It works seamlessly when the URL points to any image from Google Images, randomly selected. However, it encounters issues when the image is sent/uploaded through Typebot.

The error message provided is too ambiguous, I'm speculating that the problem may be related to the cross-origin policy.

Plain Text

"error": {
  "message": "Invalid image.",
  "type": "invalid_request_error",
  "param": null,
  "code": null
}

I'm seeking any clues or advice that could help troubleshoot this issue.

Attachments

26 comments

MMichaelvips

Maybe it's some access policy for the bucket where the image is, is this using the AWS minio?

VVilela™

Yes, I am.

MMichaelvips

Try open the url that is put in the variable in a incognito window, if open so there is no problem with access policy for the bucket, Or you can try send the file to openai storage also.

MMichaelvips

You are an expert, I feel like I'm trying to teach ¨a priest how to say mass¨, sorry for maybe saying something that you might already know.

VVilela™

No! 😂 You're absolutely right!
Man! How stupid I am? 😆
I can see the image cause I'm logged. 🤦‍♂️

VVilela™

The access policy already "public".
Do you know where else should I change it?

Attachment

VVilela™

The minio / s3 url is already public. I can access it from the incognito window.
The problem is the typebot URL for the image.

MMichaelvips

Sorry delay I was busy... I will try replicate this here..

MMichaelvips

Your image url look like this

¨https://your-domain.com/typebot/public/workspaces/clnz064l30001mc4ssx4lk05b/typebots/clrl175vc0003mc4sxlmwaxkl/blocks/zy4wku96ug8g908abg9w1h1z?v=1706025986599¨

MMichaelvips

should look like this

Attachment

MMichaelvips

Attachment

VVilela™

I send an image to Typebot. In Typebot I get an URL like:
https://typebot.myurl.io/api/typebots/<bunchoffstuff>
If I access this url I get the error: {"message":"Not authenticated"}

But if I access my minio, I can see that the original image url is something like:
https://s3.myurl.io/typebot/public/workspaces/<bunchofstuff>
And that's public accessible.

MMichaelvips

Yes I was wrong the domain is from s3 or minio not typebot builder

MMichaelvips

Look this https://bot.eletromotiva.com.br/gpt-minio-test

VVilela™

Differently from mine, yours is receiving the minio URL, not the bot, and it works because of that.
Why is mine different?
🤔

MMichaelvips

Are you using preview mode or live ?

VVilela™

Live

VVilela™

Thought Whatsapp.

MMichaelvips

https://app.typebot.io/typebots/clrqnxql70001l7urqp95al59/edit

MMichaelvips

try use this

VVilela™

It works if I don't use Whatsapp.

Attachment

VVilela™

Attachment

MMichaelvips

So is something on code of integration of whatsapp

MMichaelvips

some variable

MMichaelvips

Access Policy

{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Principal": {
"AWS": [
"" ] }, "Action": [ "s3:ListBucketMultipartUploads", "s3:GetBucketLocation" ], "Resource": [ "arn:aws:s3:::typebot" ] }, { "Effect": "Allow", "Principal": { "AWS": [ ""
]
},
"Action": [
"s3:ListBucket"
],
"Resource": [
"arn:aws:s3:::typebot"
],
"Condition": {
"StringEquals": {
"s3:prefix": [
"public"
]
}
}
},
{
"Effect": "Allow",
"Principal": {
"AWS": [
"" ] }, "Action": [ "s3:PutObject", "s3:AbortMultipartUpload", "s3:DeleteObject", "s3:GetObject", "s3:ListMultipartUploadParts" ], "Resource": [ "arn:aws:s3:::typebot/public"
]
}
]
}

Attachment

BBaptiste

Add a reply

Join on Discord

Share feedback, ideas and get community help

GPT-4V (Vision)