Skip to main content
Community site session details

Community site session details

Session Id : MOqf768fejxj3lfU0hoV5y
Copilot Studio - Bot Extensibility
Answered

Can PowerAgents understand audio and video inputs for its natural language functions?

Like (0) ShareShare
ReportReport
Posted on 30 May 2023 16:21:39 by 5

I know that we can point PowerAgents to a Sharepoint folder to read and learn about information and then use it's AI Cognitive abilities (Open AI Engine) to respond to questions about that content in a conversational way. 

 

Can I include audio and video files within that Sharepoint folder and will PowerAgents have the ability to process and understand those inputs to then answer questions? Or does it only understand text inputs?

 

I would love to be able to record video screen captures of using our platform, or at least audio recordings, describing and explaining how things work with our actual UI/UX and then have PowerAgents understand that information to answer user queries. 

Categories:
  • davidpauldoyle Profile Picture
    5 on 30 May 2023 at 23:39:40
    Re: Can PowerAgents understand audio and video inputs for its natural language functions?

    Thank you! I will transcribe for now, but look forward to Azure Cognitive Search having that level of cognitive ability in the future. Will make it's understanding and awareness of our product that much better! Put in a good word to your dev team. 🙂 Thanks.

  • Verified answer
    remidyon Profile Picture
    on 30 May 2023 at 23:06:05
    Re: Can PowerAgents understand audio and video inputs for its natural language functions?

    Hi @davidpauldoyle 

    right now the conversation boost can only use text document (word, pdf, sharepoint pages, etc.). Parsing videos and sound in real time and getting an answer would be a performance challenge depending on the size of the file.

    However, you could automate the transcription of your audio files to text and store the transcript back in Sharepoint using power automate, see this article. That way PVA will be able to use that transcript in its answer.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Announcing our 2025 Season 2 Super Users!

A new season of Super Users has arrived, and we are so grateful for…

Paul Stork – Community Spotlight

We are honored to recognize Paul Stork as our July 2025 Community…

Congratulations to the June Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Copilot Studio

#1
Michael E. Gernaey Profile Picture

Michael E. Gernaey 169 Super User 2025 Season 2

#2
Romain The Low-Code Bearded Bear Profile Picture

Romain The Low-Code... 150

#3
sandeep_angara Profile Picture

sandeep_angara 75 Super User 2025 Season 2

Featured topics