Unanswered

Chatgpt with prompt

(0) Share

Report

Posted on by vp007

Hello All,

I have huge text and I would like to pass it to chatgpt with prompt for extracting information but due to limit chatgpt errors out.

Alternatively, i have to break the content and send to chatgpt but the chatgpt is not doing the job of remembering the previous loop so every time each loop is considered as new.

I am into summarization but the real content is lost so is there any way to handle original text and chatgpt limit and also getting info from every loop.

Categories:

General topics

I have the same question (0)

All responses (8)

Answers (0)

timminer 2 on at

Like (0)

Report
Copy link

Link copied!

You basically have a few options and I will list them from best to good:
- 1.) You can upgrade to ChatGPT Plus: This will cost you $20/month without a commitment. So if you decide to cancel, you can at any time. With ChatGPT Plus, you will get the ability to load in a file and ask ChatGPT to summarize the document as you wish. With the Plus version, you can also use Data Analysis. This is a tool that will create python code that runs automatically to summary large sets of structured data.
- 2.) Use any number of Chrome Extensions that help you load files into ChatGPT. I used to use a product called File Uploader for ChatGPT, but this market is constantly changing, so get whichever one works (see comments). After installation, restart ChatGPT and you will find the extension has put a button to allow files to upload. It will then break the file up into multiple pieces and load these piece by piece into the ChatGPT. After completion, you can ask the summary questions or any other questions you have.

Was this reply helpful? Yes No
vp007 18 on at

Like (0)

Report
Copy link

Link copied!

@timminer _ use enterprise license so Plus is not available. I want to do this in power automate. Thanks for your time and suggestions

Was this reply helpful? Yes No
takolota1 4,978 Moderator on at

Like (0)

Report
Copy link

Link copied!

@vp007

How many pages are you trying to summarize?

Have you tried setting up a premium HTTP call to a custom GPT4 Turbo instance in Azure? GPT4 Turbo has a 128K context window so it should handle like 100 pages.

I used such a call to GPT4 Turbo in this template: https://powerusers.microsoft.com/t5/Power-Automate-Cookbook/Query-Large-PDFs-With-GPT-RAG/td-p/2650178

Was this reply helpful? Yes No
vp007 18 on at

Like (1)

Report
Copy link

Link copied!

@takolota Some are 70 pages but less than 100. So this worth a try. Thanks for sharing it. I will keep you posted if it works.

Was this reply helpful? Yes No
vp007 18 on at

Like (1)

Report
Copy link

Link copied!

@takolota - My company doesn't have Azure instance so can't try this method. I have raised a ticket with MS to get help on ChatGpt 3.5 prompt (current PowerApps AI) to handle 70+ pages. fingers crossed!

Was this reply helpful? Yes No
takolota1 4,978 Moderator on at

Like (0)

Report
Copy link

Link copied!

@vp007

Is all the data you need on 10 or fewer pages on any given document?

If so then the RAG template I mentioned my be one of your best bets. You would just submit the prompt to the GPT3.5Turbo AI Builder action.

Alternatively you could try signing up for the OpenAI API outside of Azure to access GPT4Turbo as long as your data isn’t sensitive.

Was this reply helpful? Yes No
vp007 18 on at

Like (0)

Report
Copy link

Link copied!

@takolota Yes, It's less than 10 pages of output. I liked your code - was checking the feasibility to plugin with what I have at the moment.

The data is sensitive and I cannot do anything beyond work firewall environment.

Was this reply helpful? Yes No
takolota1 4,978 Moderator on at

Like (0)

Report
Copy link

Link copied!

@vp007

Oh wait, I forgot the text embeddings require Azure too.

Sorry

Was this reply helpful? Yes No