Answered

How to use MS FLOW to extract from a URL API using a table as part of the URL parameter to create a single file with all results?

(0) Share

Report

Posted on by Community Power Pla... Microsoft Employee

Hi Guys,
My issues is exactaly as the Subject: How to use MS FLOW to extract from a URL API using a table as part of the URL parameter to create a single file with all results?

In my scenario, I have:

1) A .csv table (actually a single column named "M_ID") with 7K rows;

2) An URL, that return a json.

Part of this URL is the column "M_ID", something like this: http://lorem.ipsum/"M_ID"/true/out=json
I need to extract from the URL all json returns and create a single file.

Is it possible to do this with Flow?

I don't know if I was clear, if not let me know.

Categories:

General topics

I have the same question (0)

All responses (4)

Answers (2)

Sort by

Verified answer

Ed Gonzales 4,531 Most Valuable Professional on at

Like (0)

Report
Copy link

Link copied!
@Anonymous

Thinking this through, there are definitely better ways to do this, but this is what I've got:

Manual Trigger (or whatever you're already using as a trigger)

Initialize an Array variable

Get your list of M_ID's (either from an SP list or Excel table.

Apply to each loop

Inside the loop: Your API call to get the JSON results

Inside the loop: Append to Array variable

Outside the loop, create a file (whatever format) with the array variable as the body.

Save

I imagine, with 7,000 M_ID's, your array will get pretty huge quick, so it will probably take some finessing (default max may be 500, but I think you can change that).

Another option might be to write everything to text files and then use a batch command to append them together. Dunno.

Keep us posted.

-Ed-

If this reply has answered your question or resolved your challenge, please consider marking it as a Solution. This helps other users find it more easily via search.

Was this reply helpful? Yes No
Community Power Pla... Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

Hi @edgonzales,
Thanks for your support.

I used your suggestion, and it is Working!
But there is a limitation, 256 loops.
Is it possible change this limitation?

Was this reply helpful? Yes No
Ed Gonzales 4,531 Most Valuable Professional on at

Like (0)

Report
Copy link

Link copied!

Great to hear! You're on the right track.

Check the limits here and compare that to your license before you go too much further. Without a P1 or P2, it looks like you cap out at 5,000 even if/when we figure out how to up the limit from the current 256.

On that, I think it might be the getting the limits from the list items. Look around for an article to change the default depending on your action step. I found this one, but don't know if it totally applies.

Keep us posted.

-Ed-

If this reply has answered your question or resolved your challenge, please consider marking it as a Solution. This helps other users find it more easily via search.

Was this reply helpful? Yes No
Verified answer

v-bacao-msft Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

Hi @Anonymous ,

Please try enabling Pagination and increasing the Threshold to the expected value.

It is also recommended to set Apply to each to improve the Degree of Parallelism to improve execution efficiency.

Hope it helps.

Best Regards,

Was this reply helpful? Yes No