GPT-4V (Vision)

VVilela™

I'm attempting to integrate Typebot with GPT-4V (Vision) through the Webhook Block.
It works seamlessly when the URL points to any image from Google Images, randomly selected. However, it encounters issues when the image is sent/uploaded through Typebot.

The error message provided is too ambiguous, I'm speculating that the problem may be related to the cross-origin policy.

Plain Text

"error": {
  "message": "Invalid image.",
  "type": "invalid_request_error",
  "param": null,
  "code": null
}

I'm seeking any clues or advice that could help troubleshoot this issue.

Attachments

26 comments

MMichael

Maybe it's some access policy for the bucket where the image is, is this using the AWS minio?

VVilela™

Yes, I am.

MMichael

Try open the url that is put in the variable in a incognito window, if open so there is no problem with access policy for the bucket, Or you can try send the file to openai storage also.

MMichael

You are an expert, I feel like I'm trying to teach ¨a priest how to say mass¨, sorry for maybe saying something that you might already know.

VVilela™

No! 😂 You're absolutely right!
Man! How stupid I am? 😆
I can see the image cause I'm logged. 🤦‍♂️

VVilela™

The access policy already "public".
Do you know where else should I change it?

Attachment

VVilela™

The minio / s3 url is already public. I can access it from the incognito window.
The problem is the typebot URL for the image.

MMichael

Sorry delay I was busy... I will try replicate this here..

MMichael

Your image url look like this

¨https://your-domain.com/typebot/public/workspaces/clnz064l30001mc4ssx4lk05b/typebots/clrl175vc0003mc4sxlmwaxkl/blocks/zy4wku96ug8g908abg9w1h1z?v=1706025986599¨

MMichael

should look like this

Attachment

MMichael

Attachment

VVilela™

I send an image to Typebot. In Typebot I get an URL like:
https://typebot.myurl.io/api/typebots/<bunchoffstuff>
If I access this url I get the error: {"message":"Not authenticated"}

But if I access my minio, I can see that the original image url is something like:
https://s3.myurl.io/typebot/public/workspaces/<bunchofstuff>
And that's public accessible.

MMichael

Yes I was wrong the domain is from s3 or minio not typebot builder

MMichael

Look this https://bot.eletromotiva.com.br/gpt-minio-test

VVilela™

Differently from mine, yours is receiving the minio URL, not the bot, and it works because of that.
Why is mine different?
🤔

MMichael

Are you using preview mode or live ?

VVilela™

Live

VVilela™

Thought Whatsapp.

MMichael

https://app.typebot.io/typebots/clrqnxql70001l7urqp95al59/edit

MMichael

try use this

VVilela™

It works if I don't use Whatsapp.

Attachment

VVilela™

Attachment

MMichael

So is something on code of integration of whatsapp

MMichael

some variable

MMichael

Access Policy

{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Principal": {
"AWS": [
"" ] }, "Action": [ "s3:ListBucketMultipartUploads", "s3:GetBucketLocation" ], "Resource": [ "arn:aws:s3:::typebot" ] }, { "Effect": "Allow", "Principal": { "AWS": [ ""
]
},
"Action": [
"s3:ListBucket"
],
"Resource": [
"arn:aws:s3:::typebot"
],
"Condition": {
"StringEquals": {
"s3:prefix": [
"public"
]
}
}
},
{
"Effect": "Allow",
"Principal": {
"AWS": [
"" ] }, "Action": [ "s3:PutObject", "s3:AbortMultipartUpload", "s3:DeleteObject", "s3:GetObject", "s3:ListMultipartUploadParts" ], "Resource": [ "arn:aws:s3:::typebot/public"
]
}
]
}

Attachment

BBaptiste

Add a reply

Share feedback, ideas and get community help

GPT-4V (Vision)