Skip to main content

Notifications

Community site session details

Community site session details

Session Id : G2y8KBPx2xMZ8hoB/+5wUa
Copilot Studio - General
Unanswered

AI-Guided Chatbot without OpenAI Data Connection

Like (0) ShareShare
ReportReport
Posted on 20 Sep 2023 14:14:27 by 8

Hi community!

 

I have currently a small assignment to create a Virtual Agent Pilot. I want to create a chatbot for FAQs which seems to be a standard idea for this. 

 

However, creating hundreds of topics and hardcoding them doesnt seem like a good solution. 

The generative answers solutions for Power Virtual Agents seems promising, however, data is leaving the tenant which does represent a data risk. 

 

What would your recommendations be to solve that approach? Is there any "non-OpenAI" solution to combine text understanding in the chatbot?

 

Thank you!

 

Categories:
  • Jameslew_MSFT Profile Picture
    on 19 Oct 2023 at 21:54:25
    Re: AI-Guided Chatbot without OpenAI Data Connection

    Yes, this is a case of one tool doing a few too many things.  GA happened on October 2 (part of this wave), and Geo-expansion will also happen in this wave - as Henry mentioned, very soon.  They dont' however happen on the same date.

  • HenryJammes Profile Picture
    on 19 Oct 2023 at 15:19:52
    Re: AI-Guided Chatbot without OpenAI Data Connection

    Sorry for the confusion @BennyS27

     

    Release wave plans contain many features that have preview and G.A. dates that are different from the "General Availability" of the release wave early access features. The PVA features are not part of these.

     

    I'm going to work with the team to make sure the dates that are present on the below page are updated:

    New and planned features for Power Virtual Agents, 2023 release wave 2 | Microsoft Learn

     

    For generative answers over a SharePoint source, the feature is already indeed considered G.A. in the US region, but we probably should have a separate plan for the regional availability, as it will be a bit later than October 31st for Europe. 

     

    Henry

  • BennyS27 Profile Picture
    36 on 19 Oct 2023 at 14:41:01
    Re: AI-Guided Chatbot without OpenAI Data Connection

    Thank you for your response again and sorry, I guess I am getting confused now.

     

    The functionality has been in preview (US only) before. This is exactly what we are currently seeing in the VA Portal. 

    According to my understanding, "General availability" is the next release phase after "public preview". Consequently, the documentation reveals that this functionality has taken this step towards GA and is officially in this release wave as general availability. 

     

    We already have this wave enabled in our environment but this did not change anything. Could it be that Microsoft is rolling out this release in waves across tenants and this can take some time still because we're not one of the first to get it?

     

    Quote: "In 2023 release wave 2, we're expanding the breadth of sources that your bots can use to generate answers and including internal SharePoint sites as a source."

    So this all does not sound like early access, more like a generally coming and also maybe already available feature. 

     

    I'm currently just hoping that it will take maximum 2-3 weeks from now on to be officially available, because we have this pilot planned internally to evaluate the capabilities in our CoE. 

     

     

  • HenryJammes Profile Picture
    on 19 Oct 2023 at 14:32:14
    Re: AI-Guided Chatbot without OpenAI Data Connection

    Hi @BennyS27,

     

    Thanks for raising this, we clearly need to update our release plans to reflect the latest dates. It's not far from now, but it isn't October.

     

    Regarding the "General availability deployment" this is about activating the "2023 Release Wave 2" in your environment in case you haven't done so already. What this effectively does is enabling the "early access features". Generative answers isn't one of them.

    You can get see list of early access features here: 2023 release wave 2 features available for early access | Microsoft Learn.

     

    Henry

  • BennyS27 Profile Picture
    36 on 19 Oct 2023 at 13:11:39
    Re: AI-Guided Chatbot without OpenAI Data Connection

    Hi @HenryJammes 

    thank you for your answer!


    I found the release plan here: https://releaseplans.microsoft.com/en-us?app=Power+Virtual+Agents&status=new it is stating that it has been rolled out in october for general availability.

    Deep-diving in the release plans leads to this article:

    Use internal SharePoint content as a source for AI-created generative answers | Microsoft Learn

    This article is also stating "Geographic Areas" including Europe. 

     

    The development timeplan in this article General availability deployment - Power Platform | Microsoft Learn indicates 2nd October for Germany etc and 16th October for Europe. 

     

    Did I get the information here wrong? 

     

    Edit: Our goal is to use an internal sharepoint information via generative answers for a smoother chatbot  building experience

  • HenryJammes Profile Picture
    on 19 Oct 2023 at 11:31:08
    Re: AI-Guided Chatbot without OpenAI Data Connection

    Not sure where that information comes from, but Generative AI features in PVA, like Generative Answers, Plugin Actions, and Copilot are not expected on Monday to become available in more regions outside of the US. There is active work to make this happen as soon as possible though, so stay tuned.

  • BennyS27 Profile Picture
    36 on 19 Oct 2023 at 09:33:49
    Re: AI-Guided Chatbot without OpenAI Data Connection

    Another question in the same context.

    The GPT Functionalities are expected to be rolled-out in Europa on Monday - the functionality still is not visible in our environment, nor can I enable it in the "settings" and there is still the "preview" stuff listed. 

     

    Does this functionality require any special license? Which licenses are required for this functionality?

    How long does it take to be rolled out to our tenant? 

     

    Thanks!

  • BennyS27 Profile Picture
    36 on 28 Sep 2023 at 07:26:59
    Re: AI-Guided Chatbot without OpenAI Data Connection

    Hi @Jameslew_MSFT 

    Thank you for your fast response!

     

    With the business I am referring to us - so the customers using the capabilities. Is our approval required for MSFT to get access for abuse monitoring? I read this in another thread and I would like this approach, but somehow I think that this doesnt make sense. 

     

    I guess major concern that there IS an access to our data for MSFT which we cannot restrict/monitor/avoid due to the abuse monitoring scheme. 

  • MattJimison Profile Picture
    577 Most Valuable Professional on 26 Sep 2023 at 15:56:01
    Re: AI-Guided Chatbot without OpenAI Data Connection

    Hi, @BennyS .

     

    This is a great resource to help answer your questions:

    https://learn.microsoft.com/en-us/legal/cognitive-services/openai/data-privacy

     

    That includes a link to the below form where you can request that your data not be monitored at all:
    https://customervoice.microsoft.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbR7en2Ais5pxKtso_Pz4b1_xURE01NDY1OUhBRzQ3MkQxMUhZSE1ZUlJKTiQlQCN0PWcu

     


    Find this post helpful? Please mark it as the solution and/or provide kudos so that it will help others in the future.

    Cheers,
    Matt

  • Jameslew_MSFT Profile Picture
    on 26 Sep 2023 at 15:33:16
    Re: AI-Guided Chatbot without OpenAI Data Connection

    Thanks BennyS for your question; given the nature of it, I'd like to clarify further.


    By "the business", do you mean the customer whose application was related to the "abuse", or do you mean Microsoft's "business" to approve such a thing?  Can you be more specific?

    In general, for Power Platform and Azure services, no individual operator has standing access to production customer data; multiple gates exist which prevent this; specific hardware, requirement for access to be approved by a designated team member, and membership in specific security groups, along with demonstrated need for a specific case. For an abuse monitoring type of issue there would be additional constraints applied.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

🌸 Community Spring Festival 2025 Challenge 🌸

WIN Power Platform Community Conference 2025 tickets!

Markus Franz – Community Spotlight

We are honored to recognize Markus Franz as our April 2025 Community…

Kudos to the March Top 10 Community Stars!

Thanks for all your good work in the Community!

Leaderboard

#1
WarrenBelz Profile Picture

WarrenBelz 146,651 Most Valuable Professional

#2
RandyHayes Profile Picture

RandyHayes 76,287 Super User 2024 Season 1

#3
Pstork1 Profile Picture

Pstork1 65,999 Most Valuable Professional

Leaderboard