Skip to main content

Notifications

Topic Creation & Management
Unanswered

Perform search on video transcripts present on share point. Followed by pointing to the exact timestamp in the video where the answer for the video resides.

Posted on by

Hi everyone,

I'm building a Teams chatbot using Copilot Studio that retrieves information and videos from a SharePoint library based on user prompts.

Here's what I'm aiming to achieve:

User asks a question in the chat.

Bot searches SharePoint documents and identifies relevant information.

Bot respond using Generative AI along with any related videos.

Ideally, the bot pinpoints the specific video section addressing the question.

Current Progress:

I've successfully used generative AI to answer questions based on SharePoint documents.

I can display SharePoint videos in Teams chat using adaptive cards.

Challenge:

I'm struggling to connect these elements. I need help figuring out how to:

Search SharePoint videos for relevant information based on user queries.

Identify the specific section of a video that addresses the user's question (if possible).

Potential Solution: Leveraging Video Transcripts

I noticed that SharePoint videos on Stream often have transcripts available. I'm wondering if it's possible to:

  1. Access the transcript of a video.
  2. Perform the user's query on the transcript text.
  3. If the transcript contains relevant information, identify the corresponding video and potentially the timestamp within the video where the answer appears.

Looking for Advice:

Has anyone worked with SharePoint videos and Copilot Studio in Teams chatbots? Any suggestions or solutions for:

  • Extracting video sections or displaying relevant videos based on user prompts would be greatly appreciated!
  • Accessing SharePoint video transcripts within Copilot Studio (if possible)

Thank you

  • Suma_Sai Profile Picture
    Suma_Sai on at
    Re: Perform search on video transcripts present on share point. Followed by pointing to the exact timestamp in the video where the answer for the video resides.

    I have looked into all the resources you have provided but unfortunately I am unable to find a way in which I could search the transcripts  of all the videos on the sharepoint site which I have access to without using the teamsid/transcript id. 

    I should be able to retrieve the transcripts of based on the search terms and input these transcripts to the genAI and retrieve responses aswell as display the videos which I am referring to.

  • Umianta Profile Picture
    Umianta 293 on at

Helpful resources

Quick Links

Welcome to the Power Platform…

We are thrilled to unveil the newly-launched Power Platform Communities!…

Getting Started…

Welcome to the Power Platform Community! We appreciate your visit…

Welcome to the new Power Platform Community!…

We are excited to announce our new Copilot Cookbook Gallery in the Community…

Leaderboard

#1
WarrenBelz Profile Picture

WarrenBelz 138,006

#2
RandyHayes Profile Picture

RandyHayes 76,308

#3
Pstork1 Profile Picture

Pstork1 63,059

Leaderboard

Featured topics