Unanswered

Traffic Management in Copilot Studio

Like (0) Share

Report

Posted on 6 Dec 2023 18:02:28 by Maazz7

I am making a chatbot for website and around 0.75 million people will access it. Is Microsoft Copilot Studio capable enough to handle the traffic of this amount?

Categories:

General

I have the same question (0)

Summarized by AI

All responses (3)

Answers (0)

Jameslew_MSFT on 07 Dec 2023 at 01:39:17

Like (0)

Report

Re: Traffic Management in Copilot Studio

Copilot Studio is indeed designed for high-scale operations and where limits exist we have patterns to help customers work beyond them (work with your MSFT field representative).

That said, can you describe more your scenario, and what the traffic might look like? Will they all try to use the bot at the same time (say around a sporting event), or is that the total customer base for example?

Was this reply helpful? Yes No
Maazz7 2 on 07 Dec 2023 at 06:13:49

Like (0)

Report

Re: Traffic Management in Copilot Studio

Around 0.5 million people will access it on MONTHLY Basis. It won't be at the same time.

Was this reply helpful? Yes No
Jameslew_MSFT on 07 Dec 2023 at 15:46:02

Like (0)

Report

Re: Traffic Management in Copilot Studio

So again, it will depend on volume whether we should have further interaction on this. Default throttles documented are around 800 requests per minute; if every one of your users used it twice a month for conversations of around 7 turns, you'd be in that range.

Do you have specifics around what channel you'd be using, how long the conversations might be, how frequently you expect those users to use the system? Also, usage of generative answers would be something to consider as well as that has significantly lower throttles due to scarcity of GPU's.

Was this reply helpful? Yes No