web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Automate / Web Scraping using PAD
Power Automate
Unanswered

Web Scraping using PAD

(0) ShareShare
ReportReport
Posted on by 9

Hi,

 

I have created a flow to extract Job Opportunities with their respective description from multiple websites (100+ websites).

The flow loops through each websites and extract the Href links of all the job opportunities present in the website. To extract JD, the flow loops through each Href link and obtains the JD, later save it in excel sheet.

 

The problem is, the flow is taking more time to extract data. The main cause of the problem is, the flow has to loop through each Href link to obtain JD (Eg. if a company website has 200 jobs, the flow has to go to each job page and extract the required data).

 

I have added the snap of one company's subflow for further understanding.

Please help me to reduce time consumption.

 

Thank You.

Neha

I have the same question (0)
  • Sayan Profile Picture
    818 Super User 2025 Season 2 on at
    Hello Neha,
     
    To reduce time consumption, you can use the following approach - 
     
    You can split the flow into multiple sub-flows to process Href links in parallel. This way, instead of extracting one job description at a time, you can extract multiple descriptions simultaneously, speeding up the process.
     
     
     

    -----------------------------------------------------------------------------------------------------------------------------------------------------------

    If my suggestion helps you, please gives it a Like and Marks as a Solution. Which motivates to solve more problems.

     

    Thanks,
    Sayan Patra
    RPA Developer

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Forum hierarchy changes are complete!

In our never-ending quest to improve we are simplifying the forum hierarchy…

Ajay Kumar Gannamaneni – Community Spotlight

We are honored to recognize Ajay Kumar Gannamaneni as our Community Spotlight for December…

Leaderboard > Power Automate

#1
Michael E. Gernaey Profile Picture

Michael E. Gernaey 503 Super User 2025 Season 2

#2
Tomac Profile Picture

Tomac 321 Moderator

#3
abm abm Profile Picture

abm abm 237 Most Valuable Professional

Last 30 days Overall leaderboard