Skip to main content

Notifications

Community site session details

Community site session details

Session Id :
Copilot Studio - General
Unanswered

Speech input to text or variable?

Like (0) ShareShare
ReportReport
Posted on 26 Feb 2024 09:00:50 by 5

Is there any method that involves the telephony or other extension/plugins to store the speech we input as a variable maybe in the form of varbase64 like how we can in power apps?

 

Thank you

Categories:
  • adilei Profile Picture
    on 27 Feb 2024 at 10:48:18
    Re: Speech input to text or variable?

    I still struggle understanding the context here, but it seems like Copilot Studio may not be a good match for your requirements. Copilot Studio helps to build conversational AI experiences - and I'm not hearing that is a requirement for you.

  • adtest1 Profile Picture
    5 on 27 Feb 2024 at 09:40:58
    Re: Speech input to text or variable?

    Ill make a scenario that hopefully explains enough,

    Lets say Person A wants to record a conversation between A and B, have its transcription ready and then have further operations done on it like:
    1. summarization or finding key words from it (this can be done using the AI plugins or by enabling generative answers)

    So i want to be able to click a button or send a message to the bot to start recording the ongoing conversation until i stop it manually. It then gives me options on operations to do with the transcript that is either already available or I take the recorded file and convert it to text using Azure ai speech services(already have this setup), and then do the further operations.

    I am looking towards omnichannel/customercare admin center which also has transcription capabilities but its mainly made for talking to the bot itself and not recording a conversation so I feel like it will mess up the transcription.

  • adilei Profile Picture
    on 27 Feb 2024 at 07:46:59
    Re: Speech input to text or variable?

    Not sure that I follow. Maybe with a specific use case it will be easier to provide guidance.

  • adtest1 Profile Picture
    5 on 27 Feb 2024 at 06:14:21
    Re: Speech input to text or variable?

    I dont have a specific use case yet, but i want to set it up so that i can choose to speak and save the audio file, maybe forward it to a flow to convert it to text(after switching its file format if its webm) or do other operations with it.

    But the aim is to make it so it can still be used with multiple users so storage will also end up being a doubt

  • adilei Profile Picture
    on 26 Feb 2024 at 13:09:31
    Re: Speech input to text or variable?

    Can you say more about the use case? Who would be using the copilot, on which channel, etc.?

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Understanding Microsoft Agents - Introductory Session

Confused about how agents work across the Microsoft ecosystem? Register today!

Warren Belz – Community Spotlight

We are honored to recognize Warren Belz as our May 2025 Community…

Congratulations to the April Top 10 Community Stars!

Thanks for all your good work in the Community!

Leaderboard

#1
WarrenBelz Profile Picture

WarrenBelz 146,743 Most Valuable Professional

#2
RandyHayes Profile Picture

RandyHayes 76,287 Super User 2024 Season 1

#3
Pstork1 Profile Picture

Pstork1 66,089 Most Valuable Professional

Leaderboard
Loading started