cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
ericonline
Community Champion
Community Champion

Append to String Variable Size Limits: Workaround?

Hello,

I followed the blog post here to download 35k records from Sharepoint List. As part of the final "Apply to Each", I need to recompile the 5k chunks of json into a single json doc. 

Unfortunately, with Append to String Variable, I hit the size limit! Any ideas for how to overcome this?

image.png

3 REPLIES 3
Gristy
Resident Rockstar
Resident Rockstar

Thats a lot of json 🙂

 

Maybe you could write a azure function to do that final step? Assume you just want to end up with a big .json file?

ericonline
Community Champion
Community Champion

Hi @Gristy,

Thanks for the idea. I've tried my hand at Azure Functions, but haven't gotten the grasp yet. Any recipes you can think of to get started?

juresti
Continued Contributor
Continued Contributor

Hi,

 

You can try writing the chunks of data to text files on sharepoint.

 

I see that you are processing a loop or apply to all?

 

If you write the chunks then you can read the files back in for processing. You would only need to figure out the JSON parsing on reading them back in.

I do this with a flow where I read about 50k excel rows and write them to text, then open each one for processing through JSON.

 

Here I read the rows which will not fit in either a string append or array append.

The files are named dynamically and are also read in dynamically.

05.jpg

 

Here I read the files back in. The JSON was a little difficult finding where the object, the array, and items are nested, and the way to access them as well. In my JSON, it begins with the array.

06.jpg

 

Helpful resources

Announcements
Power Platform Conf 2022 768x460.jpg

Join us for Microsoft Power Platform Conference

The first Microsoft-sponsored Power Platform Conference is coming in September. 100+ speakers, 150+ sessions, and what's new and next for Power Platform.

New Ideas Forum MPA.jpg

A new place to submit your Ideas for Power Automate

Announcing a new way to share your feedback with the Power Automate Team.

MPA Virtual Workshop Carousel 768x460.png

Register for a Free Workshop

Learn to digitize and optimize business processes and connect all your applications to share data in real time.

MPA Licensing.jpg

Ask your licensing questions at the Power Automate AMA!

Join Priya Kodukula and the licensing team, super users and MVPs to find answers to your questions on Power Automate licensing.

Users online (4,480)