web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Automate / Can Power Automate go ...
Power Automate
Unanswered

Can Power Automate go through a text file with multiple names of companies, search their names on the web, scrape their respective websites and upload results on to a csv?

(0) ShareShare
ReportReport
Posted on by 3

Hello I am a beginner on Power Automate trying to explore its capabilities. I have a text file with over a 1000 company names whose websites I want to scrape. Can I create an automated work flow to complete the process described above? I tried doing the same using Pyhton's Beautiful Soup library but couldn't achieve intended results. I was wondering if Power Automate could help me achieve this task. I am very new to this application and I do not know what its capabilities are.

  • Agnius Bartninkas Profile Picture
    Most Valuable Professional on at

    In theory, yes, that is possible. But the reality is that you'll have each web page structured very differently. And, as such, it will be difficult to get anything useful into the output CSV file dynamically, without actually training your flow on each individual web page.

     

    If you can use some specific keywords to get what you need, you might be able to scrape some of that data and reduce the manual task. But it is highly likely it won't be 100% accurate.

     

    Also, using a search engine to find the specific web pages can also return varying results and unless you actually provide the URLs instead of the names of the companies in your input file, you are likely to get some inconsistencies there, too. If these are all local companies to your area, you might have some local company registry available online or a database of sorts where you can find the web page of the company based on its name. That would make it slightly more accurate.

     

    But still, there are too many possible points of failure in a flow like this to possibly expect RPA to handle it accurately. It works well when all rules in the flow are in fact clear and defined. But when you want to do stuff that's as vague as scraping the same data from 1000+ websites without defining each of them manually, it will likely not work.

    -------------------------------------------------------------------------
    If I have answered your question, please mark it as the preferred solution. If you like my response, please give it a Thumbs Up.

    I also provide paid consultancy and development services using Power Automate. If you're interested, DM me and we can discuss it.

  • mridul1710 Profile Picture
    3 on at

    Thank you so much for your guidance, I have a quick follow up question. If I have all the URLs of the companies ready will I be able to complete this task more easily?

  • Agnius Bartninkas Profile Picture
    Most Valuable Professional on at

    It will be more accurate, because you will eliminate the probability of your flow using an incorrect URL it finds on the web. 

     

    But you will still have the issue of scraping 1000+ different web pages. You could use Get details of web page to extract the entire text of the page and then try parsing it using regular expressions by searching for some keywords. But it won't be 100% accurate unless you specifically define it for each web page manually.

    -------------------------------------------------------------------------
    If I have answered your question, please mark it as the preferred solution. If you like my response, please give it a Thumbs Up.

    I also provide paid consultancy and development services using Power Automate. If you're interested, DM me and we can discuss it.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Season of Sharing Community Challenge Winners!

Congratulations to our community stars!

Kudos to our 2025 Community Spotlight Honorees

Expanding mentorship, skilling, and AI innovation

Congratulations to the July Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Power Automate

#1
David_MA Profile Picture

David_MA 229 Super User 2026 Season 2

#2
11manish Profile Picture

11manish 223 Super User 2026 Season 2

#3
Valantis Profile Picture

Valantis 136 Super User 2026 Season 2

Last 30 days Overall leaderboard