Skip to main content

Notifications

Community site session details

Community site session details

Session Id :
Copilot Studio - Bot Extensibility
Answered

Can PowerAgents understand audio and video inputs for its natural language functions?

(0) ShareShare
ReportReport
Posted on by 5

I know that we can point PowerAgents to a Sharepoint folder to read and learn about information and then use it's AI Cognitive abilities (Open AI Engine) to respond to questions about that content in a conversational way. 

 

Can I include audio and video files within that Sharepoint folder and will PowerAgents have the ability to process and understand those inputs to then answer questions? Or does it only understand text inputs?

 

I would love to be able to record video screen captures of using our platform, or at least audio recordings, describing and explaining how things work with our actual UI/UX and then have PowerAgents understand that information to answer user queries. 

Categories:
  • davidpauldoyle Profile Picture
    5 on at
    Re: Can PowerAgents understand audio and video inputs for its natural language functions?

    Thank you! I will transcribe for now, but look forward to Azure Cognitive Search having that level of cognitive ability in the future. Will make it's understanding and awareness of our product that much better! Put in a good word to your dev team. 🙂 Thanks.

  • Verified answer
    remidyon Profile Picture
    on at
    Re: Can PowerAgents understand audio and video inputs for its natural language functions?

    Hi @davidpauldoyle 

    right now the conversation boost can only use text document (word, pdf, sharepoint pages, etc.). Parsing videos and sound in real time and getting an answer would be a performance challenge depending on the size of the file.

    However, you could automate the transcription of your audio files to text and store the transcript back in Sharepoint using power automate, see this article. That way PVA will be able to use that transcript in its answer.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

🌸 Community Spring Festival 2025 Challenge 🌸

WIN Power Platform Community Conference 2025 tickets!

Markus Franz – Community Spotlight

We are honored to recognize Markus Franz as our April 2025 Community…

Kudos to the March Top 10 Community Stars!

Thanks for all your good work in the Community!

Leaderboard

#1
WarrenBelz Profile Picture

WarrenBelz 146,524 Most Valuable Professional

#2
RandyHayes Profile Picture

RandyHayes 76,287 Super User 2024 Season 1

#3
Pstork1 Profile Picture

Pstork1 65,906 Most Valuable Professional

Leaderboard

Featured topics