Unanswered

Size Limit on JSON?

(1) Share

Report

Posted on by wsalling

114

Is there a size limit when using the function JSON? i have large collection that i turn into a JSON object to send to a flow. if i select the first 4000 records and create the JSON it takes a couple of seconds. But if i try 6000 or more it seems to stop working without an error. Ideas?

Categories:

Building Power Apps

All responses (14)

Answers (0)

Sort by

KrishnaV 5,023 on at

Like
a
(0)

Report
Copy link

Link copied!

Hi @wsalling,

There is no size limit for binary data or text strings beyond available memory on the device. See the below article from @GregLindhorst Power Apps principle manager explaining about JSON IncludeBinaryData or IgnoreBinaryData.

https://powerapps.microsoft.com/en-us/blog/json-for-canvas-apps/

I hope this resolved your issue if you see any challenge/need further help please let me know I am always happy to do it for my community.

Regards,
Krishna
If this post helps you give a 👍 and if it solved your issue consider Accept it as the solution to help the other members find it more.
wsalling 114 on at

Like
a
(0)

Report
Copy link

Link copied!

Thanks, i don't have any of the problem areas they mention. all just text fields for blob information.
the button does not release, it still looks depressed.
markfleet 108 on at

Like
a
(1)

Report
Copy link

Link copied!

I too am having this problem.

My collection consists of 20 text fields. The JSON function works fine for me for 4000 records but nothing happens at all when I press the button for 5000 records.

This appears to be a genuine issue.
ahanif 3 on at

Like
a
(0)

Report
Copy link

Link copied!

I have the same issue with large json object of hourly data.
wsalling 114 on at

Like
a
(0)

Report
Copy link

Link copied!

what have you done to combat the issue? we had to create length counter to make way smaller ones to pass.
markfleet 108 on at

Like
a
(0)

Report
Copy link

Link copied!

This is still an issue which I do not feel relates to available memory.

This can be demonstrated by running the below. Variable "jsontest" will be empty. If the Sequence function is changed to 4000 then the variable will be set correctly.

Set(jsontest, Blank());
Clear(colDummyColForJson);
ForAll(Sequence(5000),
Collect(colDummyColForJson, {RowIndex: CountRows(colDummyColForJson) + 1})
);
Set(jsontest, JSON(colDummyColForJson))
markfleet 108 on at

Like
a
(0)

Report
Copy link

Link copied!
In case this is useful for anyone else, this is how I run JSON() in batches and still send to my flow in one go. I am collecting the results from the batched JSON into a collection and then running JSON() again on this when running the flow.

Clear(colBatchedJson); With({BatchSize: 1000, RowCount: CountRows(colSourceCollection)}, With({BatchCount: RoundUp(RowCount / BatchSize, 0)}, ForAll(RenameColumns(Sequence(BatchCount), "Value", "i"), Collect( colBatchedJson, { Index: i, Json: JSON( LastN( FirstN(colSourceCollection, i * BatchSize ), BatchSize - Max( ((i * BatchSize) - CountRows(colSourceCollection)), 0 ) ) ) } ) ) ) ); FlowToRun.Run( JSON(colBatchedJson) )

This does mean some further work is required in the flow to iterate over the batches. I am passing this data to SQL Server within the flow so I am doing the work there rather than within the flow but a combined array of the data could be created within the flow too.
markfleet 108 on at

Like
a
(1)

Report
Copy link

Link copied!
Another option to combine the batches in the app meaning no changes required in the flow.

Clear(colBatchedJson); With({BatchSize: 1000, RowCount: CountRows(colSourceCollection)}, With({BatchCount: RoundUp(RowCount / BatchSize, 0)}, ForAll(RenameColumns(Sequence(BatchCount), "Value", "i"), Collect( colBatchedJson, { Index: i, Json: JSON( LastN( FirstN(colSourceCollection, i * BatchSize ), BatchSize - Max( ((i * BatchSize) - CountRows(colSourceCollection)), 0 ) ) ) } ) ) ) ); UpdateIf(colBatchedJson, true, {Json: Left(Mid(Json, 2), Len(Json) - 2)}); FlowToRun.Run( Concatenate("[", Concat(colBatchedJson, Json, ","), "]") )
londontoholland 37 on at

Like
a
(0)

Report
Copy link

Link copied!

I'm also having the same issue. If the collection is more than about 4000 records, the JSON function will not work (there's no image/file data in there... just text)
addy2019 153 on at

Like
a
(0)

Report
Copy link

Link copied!
Hi @markfleet,

I use your code to collect more than 5000 records in JSON it got collected but its throwing SCHEMA error in ParseJSON step in Powerautomate "Expected Array but got String". Am I missing something in Powerapps code or any step before ParseJSON.

This is powerapps code generating & passing json
Clear(repodatajsoncol); With({BatchSize: 1000, RowCount: CountRows(repodata)}, With({BatchCount: RoundUp(RowCount / BatchSize, 0)}, ForAll(RenameColumns(Sequence(BatchCount), "Value", "i"), Collect( repodatajsoncol, JSON(ShowColumns( LastN( FirstN(repodata, i * BatchSize ), BatchSize - Max( ((i * BatchSize) - CountRows(repodata)), 0 ) ),"cr17c_account_number","cr17c_cnumber","cr17c_country","cr17c_d_u_number","cr17c_enddate","cr17c_entrname","cr17c_status__c","cr17c_center_name__c","cr17c_rtu__c","cr17c_type__c","cr17c_platform__c","cr17c_portfolioc","cr17c_group_name__c","cr17c_ro2q_sld_id__c" ) ) ) ) ) ); Set(repodatajson,JSON(First(repodatajsoncol).Value));Set(varLink,PasrseJsonPAPS.Run(repodatajson).filelink);Launch(varLink)

This is the JSON received in Powerautomate which is giving above error in ParseJSON
"\"[{\"cr17c_account_number\":\"XXXXXXXX\",\"cr17c_cnumber\":xxxxxxxxx,\"cr17c_country\":\"XX\",\"cr17c_d_u_number\":null,\"cr17c_enddate\":\"2021-09-30\",\"cr17c_entrname\":\"XXXXXXXXXXXXXXXXXXXXXXXXXXXX\",\"cr17c_status__c\":\"Active\",\"cr17c_center_name__c\":\"XXXXXX\",\"cr17c_rtu__c\":null,\"cr17c_type__c\":\"XXXXX\",\"cr17c_platform__c\":null,\"cr17c_portfolioc\":\"XXXXXXXX\",\"cr17c_group_name__c\":\"XXXXXXXXXX\",\"cr17c_ro2q_sld_id__c\":XXXXXXX}]\""