Unanswered

Input prompt length cannot exceed 64936 characters or 16384 tokens while using AI Builder create text with GPT using a prompt.

(0) Share

Report

Posted on by Vinod_M

Hi,
We are trying to summarize the text using AI builder (create text with GPT using a prompt). While testing, we are getting an error saying that "length cannot exceed 64936 characters or 16384 tokens". is there any other way we can increase length of characters.

Error Screenshot:

Thanks!

Categories:

AI Builder

I have the same question (0)

All responses (7)

Answers (0)

samiak Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

Hi @Vinod_M,

This is a limitation of the GPT 3.5 Turbo model.

You will find more details here: What's new in Azure OpenAI Service? - Azure AI services | Microsoft Learn

Hope that helps!

Samia

Was this reply helpful? Yes No
vp007 18 on at

Like (0)

Report
Copy link

Link copied!

@Vinod_M @samiak Is there any solution for this? How to break it down in the ChatGPT action? My input is of unknown size due to N number of files. Kindly suggest if you have any idea

Was this reply helpful? Yes No
Antrod Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

Hi @vp007 , @Vinod_M ,

Unfortunately, it's not possible to augment the limit as this is a limitation from the GPT 3.5 service. What you can do is split your initial text into couple of pieces, summarize each piece and aggregate summaries (or summarize once again the aggregation of summaries).

Was this reply helpful? Yes No
vp007 18 on at

Like (0)

Report
Copy link

Link copied!

@Antrod Thanks for the response, I tried it. But my use case needs exact information so summarize is not going to help sadly.

Do you have any idea how to Add content to chatGpt prompt one by one of the big text. I tried to break but I did not find any TextBreak based on length in PowerAutomate

Was this reply helpful? Yes No
AlexAguirreF on at

Like (0)

Report
Copy link

Link copied!

Hello!
Someone knows whats happens with that problem? Where o what is the trick?
I know that all models have a tokens windows (https://learn.microsoft.com/en-us/azure/ai-services/openai/whats-new#gpt-4-turbo-preview--gpt-35-turbo-1106-released), but my input prompt DO NOT exceed the limit .
Why do i receive the error messages?

Was this reply helpful? Yes No
samiak Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

Hello,

Can you share more details (text/prompt...), I would like to reproduce the issue if possible.

You can send me a DM.

Thanks,

Samia

Was this reply helpful? Yes No
takolota1 4,980 Moderator on at

Like (0)

Report
Copy link

Link copied!

The take( ) expression can take any number of characters from a string

Was this reply helpful? Yes No