web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Automate / Web Scraping using PAD
Power Automate
Unanswered

Web Scraping using PAD

(0) ShareShare
ReportReport
Posted on by 9

Hi,

 

I have created a flow to extract Job Opportunities with their respective description from multiple websites (100+ websites).

The flow loops through each websites and extract the Href links of all the job opportunities present in the website. To extract JD, the flow loops through each Href link and obtains the JD, later save it in excel sheet.

 

The problem is, the flow is taking more time to extract data. The main cause of the problem is, the flow has to loop through each Href link to obtain JD (Eg. if a company website has 200 jobs, the flow has to go to each job page and extract the required data).

 

I have added the snap of one company's subflow for further understanding.

Please help me to reduce time consumption.

 

Thank You.

Neha

Screenshot 2024-10-21 175353.png
I have the same question (0)
  • Sayan Profile Picture
    818 Moderator on at
    Hello Neha,
     
    To reduce time consumption, you can use the following approach - 
     
    You can split the flow into multiple sub-flows to process Href links in parallel. This way, instead of extracting one job description at a time, you can extract multiple descriptions simultaneously, speeding up the process.
     
     
     

    -----------------------------------------------------------------------------------------------------------------------------------------------------------

    If my suggestion helps you, please gives it a Like and Marks as a Solution. Which motivates to solve more problems.

     

    Thanks,
    Sayan Patra
    RPA Developer

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Season of Sharing Community Challenge Winners!

Congratulations to our community stars!

Kudos to our 2025 Community Spotlight Honorees

Expanding mentorship, skilling, and AI innovation

Congratulations to the July Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Power Automate

#1
David_MA Profile Picture

David_MA 293 Super User 2026 Season 2

#2
trice602 Profile Picture

trice602 186 Super User 2026 Season 2

#3
11manish Profile Picture

11manish 144 Super User 2026 Season 2

Last 30 days Overall leaderboard