cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
SHBarrios
Frequent Visitor

Merge Excel rows from multiple files into a template one

I'm new to Power Automate and I want to solve a problem, I seek assistance to understand the issue. I have created 2 Cloud Flow: the first one that save all attachments from multiple emails address and store them in a single OneDrive Location. The second cloud flow is to send an email after it generate a report on such attachments and send it to a pre-arrange list of users.

 

I create a desktop flow that basically open a Report Template which have header on it, add the rows for all the excel files that are in OneDrive folder location and then save the report in a folder in OneDrive location. grab the date converted to a format that I need and save the in another location with the name and also the format as part of the name. Feel free to see the flow below, the template and output file is like this

 

Template form

SHBarrios_8-1715102022381.png

 

Output from my desktop flow (edited) 

SHBarrios_9-1715102247073.png

 

 

 

I have a few issues that I need help. I know that desktop flows are unable to run while my system is power down. I need a cloud flow to emulate my flow, I have been reading the forums, but I have no clear idea on how to implement my desktop flow successfully. I have been trying but I have to admit my knowledge is lacking and while Copilot AI suggested a few steps I'm still not able to figure it out the logic and how to set the correct parameters.

 

 

SHBarrios_0-1715101917739.png

 

Start Flow- Grab the excel files, open the template and add the info

SHBarrios_1-1715101918514.png

 

Mid Flow - save the document and add get the time

SHBarrios_2-1715101918581.png

 

final steps - save the document with time frame added

 

 

Copilot AI suggested the following flow - While I know that list files on folder is the same as my first desktop flow steps all other are unfamiliar:

 

 

SHBarrios_3-1715101918120.png

 

 

is this the template, if so how to get the right headers on it. if not, what else is missing?

 

SHBarrios_4-1715101918099.png

 

Is this the reader for all excel files excluding headers?

 

SHBarrios_5-1715101918090.png

 

 

I know this one , this is the UTC time format

SHBarrios_6-1715101918079.png

 

 

wait, what outputs, body parameter, I do not see them in any previous steps...I know the folder where I want those...

SHBarrios_7-1715101918383.png

 

 

I hope some guidance and thanks in advance for your kind help, I have received some work arounds using 3rd party vendors solutions

1 ACCEPTED SOLUTION

Accepted Solutions
SHBarrios
Frequent Visitor

Thanks to all , is far from perfect but is a solution of the issue that I have. Still a few things to improve, as always, but is a work in progress solution.

 

Feel free to review it and send your feedback on how to improve this code.

View solution in original post

11 REPLIES 11

Hi @SHBarrios 

 

I think this should include 

 

1. Listing all files in onedrive

2. Looping through each of excel files and listing the rows present in it.

3. append the row to master table 

4. Once done > send it as email.

 

Power Automate cloud requires table to be present in the excel sheet around the sheet content so to recognize the rows etc, even if it is report template file which is empty- there should be an empty table created.

 

see below - 

 

Assume this is excel template file

Nived_Nambiar_2-1715109375185.png

 

 

below are list of files to be merged

Nived_Nambiar_1-1715109359610.png

 

Now use below approach-

 

Nived_Nambiar_3-1715109633905.png

 

Nived_Nambiar_4-1715109651817.png

 

Nived_Nambiar_5-1715109676573.png

 

Expression- 

first(outputs('Get_tables')?['body/value'])?['id']
 
Nived_Nambiar_6-1715109722431.png

 

Nived_Nambiar_7-1715109750123.png

 

Overall flow

Nived_Nambiar_8-1715109805668.png

 

 

Thanks & Regards,

Nived N 🚀

LinkedIn: Nived N's LinkedIn
YouTube: Nived N's YouTube Channel
Blog: Nived Nambiar's Blogs

🔍 Found my answer helpful? Please consider marking it as the solution!
Your appreciation keeps me motivated. Thank you! 🙌

 

Wow!! That is great solution, but I do see 2 problems implementing that into the solution for my flow:

 

1) my saved files from my first cloud flow save them as .csv files, with no table format (please see the folder and data below).

SHBarrios_1-1715112570228.png

 

SHBarrios_0-1715112477657.png

 

2) in order to implement the solution proposed, I need to change my Cloud Flow "Gather all emails" and change the output to all files has a formatted table on it, which I believe will need to add an extra step on the loop for each after creating the file, am I right ?

 

SHBarrios_2-1715113050630.png

 

and that is when I get lost , I do not have an idea how to change that...

 

 

 

 

 

 

@SHBarrios 

 

You can parse data from CSV files using native expressions. This can be a little complicated but you'll find some topics on these threads.

 

To extract CSV data into Power Automate in a no code way, Encodian has two possible actions:

Parse CSV

Get Rows from Excel (works with CSVs too)

SHBarrios
Frequent Visitor

@AlexEncodian 

 

Thanks for the proposed solution, but 3rd party vendors and API may not be the solution I'm looking for, as I mention previously, this may be tempting but only if and only if there are no other solutions.  Beside that I need api keys and buy a subscription right?

 

@SHBarrios 

API Key is free to get with no credit card required.

 

But yes, the free plan gives you 50 credits per month (i.e. extracting data from 50 CSVs). Above that you would need a paid subscriptions.

 

As mentioned, you can parse CSVs natively. I'm not an expert on this but you'll find threads on this topic so you can start studying it.

SHBarrios
Frequent Visitor

@AlexEncodian ,

I figure it out in our previous interactions, I get the API key free at subscription, but I need to buy a lot more credits than just 50 a month is 8 .csv files a day, so I will run out of credits in a week.

 

I will continue looking in this topic, I learn a lot, but is not quite easy to implement desktop flow to cloud flow.

SHBarrios
Frequent Visitor

@Expiscornovus 

 

I was reading your solution for Removing header (first row) in CSV files, I was wondering if you kindly guide me to the process to solve my issue of parsing multiple .csv files that I have in my OneDrive folder and marge into my template file.

 

SHBarrios_0-1715120115615.png

 

Hi @SHBarrios 

 

Given that output excel file should have empty table present it, we can still proceed with if the input files are of csv type.

 

see below

 

I have placed csv files in input folder in sharepoint

Nived_Nambiar_0-1715194443604.png

 

Now see the flow design

 

1. use get files properties to get the list of all files from the folder location where csv files are stored

Nived_Nambiar_1-1715194502174.png

 

2. Now use an apply to each loop to loop through all files 

Nived_Nambiar_2-1715194537658.png

 

 Inside the loop, follow the below sub-steps 

2.1- Use get file content to get file content of the csv file 

Nived_Nambiar_3-1715194614518.png

 

2.2 - use compose action to decode text from csv file get file content action 

Nived_Nambiar_4-1715194695844.png

 

Expression - 

decodeBase64(outputs('Get_file_content')?['body']?['$content'])
 
2.3 Now use another apply to each which loops through csv file content and add row to excel table 
Nived_Nambiar_5-1715194770544.png

 

Expression - 

skip(split(trim(outputs('Compose')),decodeUriComponent('%0A')),1)
The above expression will skip the headers of csv file.
 
2.3.1- inside the above apply to each loop, use add row to table to add the csv row content to excel table 
Nived_Nambiar_6-1715194853987.png

 

Nived_Nambiar_7-1715194872306.png

 

Since apply to each iterates through rows , each element in a row is separated by comma,  so will be splitted by comma and take the respective element out of it.

 

 

This is how input data looks like

Nived_Nambiar_8-1715194978405.png

 

Nived_Nambiar_9-1715194988702.png

 

Output should look like 

Nived_Nambiar_10-1715195006681.png

 

 

Hope it helps !

Thanks & Regards,

Nived N 🚀

LinkedIn: Nived N's LinkedIn
YouTube: Nived N's YouTube Channel
Blog: Nived Nambiar's Blogs

🔍 Found my answer helpful? Please consider marking it as the solution!
Your appreciation keeps me motivated. Thank you! 🙌

 

SHBarrios
Frequent Visitor

@Nived_Nambiar 

 

That is close enough, I think I can edit the code for work in OneDrive location. Let me try and get back to you if not able to work it out.

SHBarrios
Frequent Visitor

@Nived_Nambiar ,

 

well it does not work at all.... or at least will take a long time. each of the  .csv files is having over 250 rows each one and is still running after 35 minutes.

 

SHBarrios_0-1715209029377.png

SHBarrios_1-1715209192615.png

 

SHBarrios
Frequent Visitor

Thanks to all , is far from perfect but is a solution of the issue that I have. Still a few things to improve, as always, but is a work in progress solution.

 

Feel free to review it and send your feedback on how to improve this code.

Helpful resources

Announcements

Community will be READ ONLY July 16th, 5p PDT -July 22nd

Dear Community Members,   We'd like to let you know of an upcoming change to the community platform: starting July 16th, the platform will transition to a READ ONLY mode until July 22nd.   During this period, members will not be able to Kudo, Comment, or Reply to any posts.   On July 22nd, please be on the lookout for a message sent to the email address registered on your community profile. This email is crucial as it will contain your unique code and link to register for the new platform encompassing all of the communities.   What to Expect in the New Community: A more unified experience where all products, including Power Apps, Power Automate, Copilot Studio, and Power Pages, will be accessible from one community.Community Blogs that you can syndicate and link to for automatic updates. We appreciate your understanding and cooperation during this transition. Stay tuned for the exciting new features and a seamless community experience ahead!

Summer of Solutions | Week 4 Results | Results posted on July 24th

We are excited to announce the Summer of Solutions Challenge!    This challenge is kicking off on Monday, June 17th and will run for (4) weeks.  The challenge is open to all Power Platform (Power Apps, Power Automate, Copilot Studio & Power Pages) community members. We invite you to participate in a quest to provide solutions to as many questions as you can. Answers can be provided in all the communities.    Entry Period: This Challenge will consist of four weekly Entry Periods as follows (each an “Entry Period”)   - 12:00 a.m. PT on June 17, 2024 – 11:59 p.m. PT on June 23, 2024 - 12:00 a.m. PT on June 24, 2024 – 11:59 p.m. PT on June 30, 2024 - 12:00 a.m. PT on July 1, 2024 – 11:59 p.m. PT on July 7, 2024 - 12:00 a.m. PT on July 8, 2024 – 11:59 p.m. PT on July 14, 2024   Entries will be eligible for the Entry Period in which they are received and will not carryover to subsequent weekly entry periods.  You must enter into each weekly Entry Period separately.   How to Enter: We invite you to participate in a quest to provide "Accepted Solutions" to as many questions as you can. Answers can be provided in all the communities. Users must provide a solution which can be an “Accepted Solution” in the Forums in all of the communities and there are no limits to the number of “Accepted Solutions” that a member can provide for entries in this challenge, but each entry must be substantially unique and different.    Winner Selection and Prizes: At the end of each week, we will list the top ten (10) Community users which will consist of: 5 Community Members & 5 Super Users and they will advance to the final drawing. We will post each week in the News & Announcements the top 10 Solution providers.  At the end of the challenge, we will add all of the top 10 weekly names and enter them into a random drawing.  Then we will randomly select ten (10) winners (5 Community Members & 5 Super Users) from among all eligible entrants received across all weekly Entry Periods to receive the prize listed below. If a winner declines, we will draw again at random for the next winner.  A user will only be able to win once overall. If they are drawn multiple times, another user will be drawn at random.  Individuals will be contacted before the announcement with the opportunity to claim or deny the prize.  Once all of the winners have been notified, we will post in the News & Announcements of each community with the list of winners.   Each winner will receive one (1) Pass to the Power Platform Conference in Las Vegas, Sep. 18-20, 2024 ($1800 value). NOTE: Prize is for conference attendance only and any other costs such as airfare, lodging, transportation, and food are the sole responsibility of the winner. Tickets are not transferable to any other party or to next year’s event.   ** PLEASE SEE THE ATTACHED RULES for this CHALLENGE**   Week 1 Results: Congratulations to the Week 1 qualifiers, you are being entered in the random drawing that will take place at the end of the challenge.   Community MembersNumber SolutionsSuper UsersNumber Solutions Deenuji 9 @NathanAlvares24  17 @Anil_g  7 @ManishSolanki  13 @eetuRobo  5 @David_MA  10 @VishnuReddy1997  5 @SpongYe  9JhonatanOB19932 (tie) @Nived_Nambiar  8 @maltie  2 (tie)   @PA-Noob  2 (tie)   @LukeMcG  2 (tie)   @tgut03  2 (tie)       Week 2 Results: Congratulations to the Week 2 qualifiers, you are being entered in the random drawing that will take place at the end of the challenge. Week 2: Community MembersSolutionsSuper UsersSolutionsPower Automate  @Deenuji  12@ManishSolanki 19 @Anil_g  10 @NathanAlvares24  17 @VishnuReddy1997  6 @Expiscornovus  10 @Tjan  5 @Nived_Nambiar  10 @eetuRobo  3 @SudeepGhatakNZ 8     Week 3 Results: Congratulations to the Week 3 qualifiers, you are being entered in the random drawing that will take place at the end of the challenge. Week 3:Community MembersSolutionsSuper UsersSolutionsPower Automate Deenuji32ManishSolanki55VishnuReddy199724NathanAlvares2444Anil_g22SudeepGhatakNZ40eetuRobo18Nived_Nambiar28Tjan8David_MA22   Week 4 Results: Congratulations to the Week 4 qualifiers, you are being entered in the random drawing that will take place at the end of the challenge. Week 4:Community MembersSolutionsSuper UsersSolutionsPower Automate Deenuji11FLMike31Sayan11ManishSolanki16VishnuReddy199710creativeopinion14Akshansh-Sharma3SudeepGhatakNZ7claudiovc2CFernandes5 misc2Nived_Nambiar5 Usernametwice232rzaneti5 eetuRobo2   Anil_g2   SharonS2  

Check Out | 2024 Release Wave 2 Plans for Microsoft Dynamics 365 and Microsoft Power Platform

On July 16, 2024, we published the 2024 release wave 2 plans for Microsoft Dynamics 365 and Microsoft Power Platform. These plans are a compilation of the new capabilities planned to be released between October 2024 to March 2025. This release introduces a wealth of new features designed to enhance customer understanding and improve overall user experience, showcasing our dedication to driving digital transformation for our customers and partners.    The upcoming wave is centered around utilizing advanced AI and Microsoft Copilot technologies to enhance user productivity and streamline operations across diverse business applications. These enhancements include intelligent automation, AI-powered insights, and immersive user experiences that are designed to break down barriers between data, insights, and individuals. Watch a summary of the release highlights.    Discover the latest features that empower organizations to operate more efficiently and adaptively. From AI-driven sales insights and customer service enhancements to predictive analytics in supply chain management and autonomous financial processes, the new capabilities enable businesses to proactively address challenges and capitalize on opportunities.    

Updates to Transitions in the Power Platform Communities

We're embarking on a journey to enhance your experience by transitioning to a new community platform. Our team has been diligently working to create a fresh community site, leveraging the very Dynamics 365 and Power Platform tools our community advocates for.  We started this journey with transitioning Copilot Studio forums and blogs in June. The move marks the beginning of a new chapter, and we're eager for you to be a part of it. The rest of the Power Platform product sites will be moving over this summer.   Stay tuned for more updates as we get closer to the launch. We can't wait to welcome you to our new community space, designed with you in mind. Let's connect, learn, and grow together.   Here's to new beginnings and endless possibilities!   If you have any questions, observations or concerns throughout this process please go to https://aka.ms/PPCommSupport.   To stay up to date on the latest details of this migration and other important Community updates subscribe to our News and Announcements forums: Copilot Studio, Power Apps, Power Automate, Power Pages

Users online (3,358)