How to use AI Chat Completion and Assistent

At a glance

The community member is seeking a full tutorial on how to use two options in a tool, as the documentation does not provide much explanation. The comments explain that the "append" variable is used to add the assistant's message to a "Chat history" variable, which is then passed to the "Dialogue" option to remember the conversation. The community members discuss the tradeoff of increased token usage as the conversation history grows, and suggest using a summary of the conversation to reduce token usage.

Useful resources

GGeorge

Does anyone have a full tutorial on how to use these two options? Inside each one there are several fields to fill in and I don't understand what to do.

Unfortunately the docs don't have much explanation https://docs.typebot.io/editor/blocks/integrations/openai#tools

For example, in this image taken from the link above, why are you using the append variable? don't get the logic

7 comments

BBaptiste

You append the assistant message to a Chat history variable

BBaptiste

The Chat history is a basically a list of all the messages between user and assistant here

BBaptiste

and we pass it to the "Dialogue" option so that it parses the entire conversation and ultimately remember things

GGeorge

Thanks! With the growth of the conversation history, does it spends more tokens with each response due to the size of the history? I imagine that the history is attached to the prompt + user question evertyime. I don't know if I'm thinking right here

BBaptiste

Yes, it spends more token, that's the tradeoff of remembering the conversation!

BBaptiste

To spend less, you could potentiatlly ask chatgpt to summarize the conversation at some point and feed the summary to subsequent OpenAI blocks

GGeorge

A summary, nice insight! gonna test it, thanks

Add a reply

Share feedback, ideas and get community help

How to use AI Chat Completion and Assistent