Unanswered

Speech input to text or variable?

(0) Share

Report

Posted on by adtest1

Is there any method that involves the telephony or other extension/plugins to store the speech we input as a variable maybe in the form of varbase64 like how we can in power apps?

Thank you

Categories:

General topics

I have the same question (0)

All responses (5)

Answers (0)

adilei on at

Like (0)

Report

Can you say more about the use case? Who would be using the copilot, on which channel, etc.?

Was this reply helpful? Yes No
adtest1 5 on at

Like (0)

Report

I dont have a specific use case yet, but i want to set it up so that i can choose to speak and save the audio file, maybe forward it to a flow to convert it to text(after switching its file format if its webm) or do other operations with it.

But the aim is to make it so it can still be used with multiple users so storage will also end up being a doubt

Was this reply helpful? Yes No
adilei on at

Like (0)

Report

Not sure that I follow. Maybe with a specific use case it will be easier to provide guidance.

Was this reply helpful? Yes No
adtest1 5 on at

Like (0)

Report

Ill make a scenario that hopefully explains enough,
Lets say Person A wants to record a conversation between A and B, have its transcription ready and then have further operations done on it like:
1. summarization or finding key words from it (this can be done using the AI plugins or by enabling generative answers)

So i want to be able to click a button or send a message to the bot to start recording the ongoing conversation until i stop it manually. It then gives me options on operations to do with the transcript that is either already available or I take the recorded file and convert it to text using Azure ai speech services(already have this setup), and then do the further operations.

I am looking towards omnichannel/customercare admin center which also has transcription capabilities but its mainly made for talking to the bot itself and not recording a conversation so I feel like it will mess up the transcription.

Was this reply helpful? Yes No
adilei on at

Like (1)

Report

I still struggle understanding the context here, but it seems like Copilot Studio may not be a good match for your requirements. Copilot Studio helps to build conversational AI experiences - and I'm not hearing that is a requirement for you.

Was this reply helpful? Yes No