Answered

Generative Responses

(1) Share

Report

Posted on by ThiagoMQT

Good afternoon! I'm running tests on Copilot Studio and I'm finding it difficult to understand to what extent it behaves like a Generative AI.

I trained it with my SharePoint base, but so far it only works as a simple query tool, for example:

Thinking about a SharePoint with a list of standards, if I make a promt like for example: "I'm a corporate coordinator, I'm going to start a contract about Highways, list which standards are pertinent", it doesn't return me. It only comes back if I ask a specific question about a standard, because it basically works like a "word search".

I've seen that there are some ways to connect Azure AI to Copilot, would that be the solution to really become a Generative AI solution? Or should I make some configuration within the tool to adjust this issue?

If I have to adjust with Azure AI, is it possible to use GPT 3.5 or 4 in Copilot?

Cheers!

All responses (4)

Answers (1)

Verified answer

citron-truc 389 on at

Like (2)

Report

Re: Generative Responses

Good morning,
I'm afraid that wouldn't change the results. You can have a bit of control on the model who is doing the generating and on the datasource (and the way it is consulted) but right now it has pretty much the same behaviour. Use Azure OpenAI if you have additional constraints (example : documents you can't have in sharepoint).

If you want your AI to be really creative, the best way seems to create it with programming. You can create an Azure function, using Azure OpenAI and python you program what you want with the system prompts you want. You then have a copilot that queries the Azure function (or you add it to your website).

Copilot studio is good at "creating something simple quickly", it also is the only platform that lets you create chatbots on teams. If you want a non-default behaviour, I'm afraid you'll need to go back to code.

Hope it helps,
Have a great day !
ThiagoMQT 9 on at

Like (0)

Report

Re: Generative Responses

Good morning!
I see, in this case the topic/word search function is Copilot's standard Generative AI. If I use Azure Open AI, could I get the results I was looking for? In fact be a Generative AI learning about the document?
Cheers!
ThiagoMQT 9 on at

Like (0)

Report

Re: Generative Responses

Good morning!
I see, in this case the topic/word search function is Copilot's standard Generative AI. If I use Azure Open AI, could I get the results I was looking for? In fact be a Generative AI learning about the document?
Cheers!
citron-truc 389 on at

Like (0)

Report

Re: Generative Responses

Good morning,

I hope you are doing well.
When you ask for a generative answer on your sharepoint, this is what happens (I think, might need confirmation from microsoft) :
- The copilot chooses the documents in your sharepoint that seem interesting with your query cuts them into chunks that are small enough to be treated in one go by the GPT model.
- The chunks are ranked according to their relevance to the question.
- There is a hidden prompt where you ask a GPT model "with these five most relevant documents, could you answer this user question ?"
- The GPT returns an answer with links pointing to the documents whose chunks were used.

There is no retraining of a generative AI (retraining a generative AI is very costly right now). It's more of a "word / topic search with generative summarization" as you correctly said. In copilot studio there doesn't seem to be an option to let the generative AI be creative on your documents.

Hope it helps.
Have a great day.