Skip to main content

Notifications

Announcements

Replay: Power Platform Community AMA - Copilot Studio | April
Welcome to the Power Platform Communities
News and Announcements icon
Community site session details

Community site session details

Session Id : qqYx9bSFUmNwTZaqyoRlXW
Power Platform Community / Forums / Power Automate - General Discussion / Automate Web Scraping
Power Automate - General Discussion
Unanswered

Automate Web Scraping

Like (0) ShareShare
ReportReport
Posted on 27 Jan 2023 11:34:55 by Dinerz 112

Hi Brilliant Minds,

 

I'm looking for some ideas to automate the following without a desktop so Power Automate Desktop cannot be used:

1. Navigate to a Webpage

2. Logon with site credentials (There is no SSO or Human verification checks as the site is internal to the company)

3. Click on a button called "Export" which downloads a CSV file

4. Save that CSV file to SharePoint or SMB or even an Azure blob

 

Any ideas?

  • Chriddle Profile Picture
    Chriddle 7,680 Super User 2025 Season 1 on 31 Jan 2023 at 14:46:24
    Re: Automate Web Scraping

    How did you integrate Python and Playwright into your webflow?

    And if you have Python available, why not use it for CSV to JSON conversion?

  • Dinerz Profile Picture
    Dinerz 112 on 31 Jan 2023 at 09:45:36
    Re: Automate Web Scraping

    An update so far on my progress:

    I used a Python and Playwright script to login to the site and download the CSV.

    I now need to figure out how to get the CSV into SharePoint so I can do some automation on it with Power Automate.

  • Chriddle Profile Picture
    Chriddle 7,680 Super User 2025 Season 1 on 27 Jan 2023 at 12:12:02
    Re: Automate Web Scraping
    1. You can get web page content with the HTTP action.
    2. Since you didn't provide any information on how the login works, it's difficult to say.
    3. You can't click a button in a web flow, but you might be able to inspect the button's request and use another HTTP action
    4. Sharepoint action "Create file"

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

News and Announcements

Replay: Power Platform Community AMA - Copilot Studio | April
Welcome to the Power Platform Communities

Quick Links

Understanding Microsoft Agents - Introductory Session

Confused about how agents work across the Microsoft ecosystem? Register today!

Markus Franz – Community Spotlight

We are honored to recognize Markus Franz as our April 2025 Community…

Kudos to the March Top 10 Community Stars!

Thanks for all your good work in the Community!

Leaderboard

#1
WarrenBelz Profile Picture

WarrenBelz 146,668 Most Valuable Professional

#2
RandyHayes Profile Picture

RandyHayes 76,287 Super User 2024 Season 1

#3
Pstork1 Profile Picture

Pstork1 66,004 Most Valuable Professional

Leaderboard

Featured topics

How to Ask for Help with Your Power Automate Workflow

Product updates

Microsoft Power Platform Community release plans