cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Lucas_Goncalves
Advocate II
Advocate II

Filter excel file, create a html table and send it by email

Hello, good morning from Brazil 🙂

 

I´m suffering on the last 3 weeks on this flow demmand. I checked google, Reddit, Medium, even here... can´t solve... I can´t sleep, can´t eat, cant be happy.... (Ok, Im joking...)

 

What I´m trying to do:

Trigger: When an item is created in a sharepoint list ( This list has a form where I will imput vendor code, say, 12345)(OK!)

7.png

 

2itemcreated.png

3getittems.png

 

1) List rows present in a table (Properly formated as a table) that has been saved on Sharepoint (file name is FBL1N.xlsx)(OK!)

 

2) Filter this excel with the trigger information (Vendor colum = form imput)(not OK!)

4list.png

3) Create an html table(OK!)

5create.png

 

 

 

4) Style Html table (OK!)

 

[replace(body('Create_HTML_table'), '<table>', '<table border="3" bgcolor="ffffff">')]

 

 

5) Send e-mail with the Styled HTML on it (OK!)

 

 

6styling.png

HTML form on email.png

 

My actual flow:

 

1Overview.png

 

 

What I´m stuck:

 

I cant create the filtered html table. I mean, the e-mail that has been sent on the above flow, is not filtered with the result from the trigger form information.

 

On step 2 (List row in a table) I know that there are a "Filter Query". But when I add the form information, it immediately changes to an "apply to each" and then I cant create html table anymore.

 

 

Are you there, Obi-wan Kenobi? Can you help me? What I am doing wrong? How can I escape the dark side and go to the correct Jedi Flow Pathway?

 

 

28 REPLIES 28
fchopo
Super User
Super User

Hello @Lucas_Goncalves 

Before creating the html table, you could use a "filter array" action, filtering the results by vendor and then creating the table. Have a look at this example:

filter.png

 In this case, I'm filtering by the "expense" value column (greater than 10).

Hope it helps!

Ferran

Did I answer your question? Please consider to mark my post as a solution to help others.
Proud to be a Flownaut!

Hello @fchopo , thanks for your support!

 

When I apply the filter as per your suggestion:

Filter array from value of the Lists Rows present in a table, using colum name "Vendor" is equal to the information present on the form "Title".

 

It forces the "apply to each" and then the same problem persists:

8.png

 

It don´t shows colums informations on Dynamic content to allow me to create the html table:

 

9.png

 

 

 

 

Hello @Lucas_Goncalves 

Just realized that it creates an "apply to each" action when you use the "title" field that you get from the "Get Items" SharePoint action. One question: Why do you use the "Get Items" action? Or what is the purpose of it? As I understand, you want to:

1) When an item is created in SharePoint.

2) Open an excel file and filter the rows according to the vendor value entered in step 1.

3) Export the excel to the HTML Table.

 

Am I right?

Ferran

 

Did I answer your question? Please consider to mark my post as a solution to help others.
Proud to be a Flownaut!

@fchopo Amazing, Apply each solved!

 

But...

 

Filter seems to not finding information as it sends me empty email:

10.png

This is how it is:

13.png

 

This is how it appears in the result: Filter output is empty

12.png

 

Hello @Lucas_Goncalves 

Looking at the screenshots you shared, the vendor code is stored in a column name "Code" and not in the "Title" one. Could you check it? Therefore, you should filter by this column, and not by Title.

Hope it helps!

Ferran

Did I answer your question? Please consider to mark my post as a solution to help others.
Proud to be a Flownaut!

SP did not updated the Renaming of the standart column name "title" as "Codigo" on Flow... they are the same.

 

I figured out that there might be empty row problem, as I got to the excel file, selected the vendor code that appears on first line and the filter worked as it should be.

 

When I check on the second, after the empty rows, it broke:

14.png 

 

Did a workaround to a condition: if empty, do nothing. If no, do that what you teached me. Appeared to work! Will do a few more test before giving you the big winning solution:

15.png

 

@fchopo upon testing here i just noticed that HTML table is comming with dates in wrong format ("Data de Pagamento" and "Emissão" are date columns:

 

16.png

How can I fix that?

 

I´m still testing the filter.

 

@fchopo  Good night!

 

Still with filter error 😞 made 20 different attemps.

 

It sends me an empty e-mail with no HTML table rows (only the columns name). It seems that the error is on the filter array that can´t output the information.

1.png

 

 

Can you check if the below picture can help you to help me? 

 

4.png

 

3.png

 

2.png

 

Hello @Lucas_Goncalves 

Let's try to narrow your problem. Could you change your filter array expression and try it with simple values? For example, try to use an expression like: 

@equals(item()?['vendor'],'127476)

 You should try with different values or expressions until you find out what's happening.

 

On the other hand, if you want to format the dates, in the create html table you could you use an expression like:

formatDatetime(output('data de pagamento','dd/MM/yyyy')

Hope it helps!

Ferran

 

Did I answer your question? Please consider to mark my post as a solution to help others.
Proud to be a Flownaut!

Hi @fchopo , good morning!

 

About the problem: It seems that the filter array is limited to 256 lines on the excel file (it has more than 10k lines).

 

I found this as I checked the test result and found last line it could narrow. That is why all vendor code that is above this line number is suceeded.

 

How can I overpass this limitation? I know it is not pagination as it is for "Sharepoint´s get itens" and it is limited to 5k.

 

Will test your suggestion to specify the vendor code number as you suggested: @equals(item()?['vendor'],'127476) 

@fchopo  figured out the problem. Excel Conector (Get a row) is limited.

 

Its native limit is 256 rows, but I can increase up to 5k rows manually with pagination.

 

I´ve tested and I could get information from rows 2561 and could not get from rows 5819 (my table has 17k rows).

 

Tested the vendor wich has rows between 4950 and 5010 and it prints me the html table up to row 5k.

 

Now... how I can bypass or arrange to get all the information automatically analyzed without changing the excel file?  

@fchopo  I found a workarround on the excel rows limit, and confirmed that the entire rows (17k) information arrives on the Filter array (I checked the imput raw information and it has an information that is only stored on line 17718, per exemple), but still output is empty:

 

1.png

 

Here you can see my workaround that has been done with the link I provided before. It starts with 4000 rows, and skips 4000 rows each get rows until it founds that there is less than 4000 on the total row (4000, then 4000 then 4000 and then 4000. Since the file have 17728 rows, it finishes the "do until" because it gets the remaining 1728 rows, doing a 5 times check):

2.png

 

If you can, lets find out together on why the Filter array is comming with empty information...

Hello @Lucas_Goncalves 

I've been doing some tests on my side and they are working fine. So I don't really know how I can help you with this. Let's see if more experiencied guys like @efialttes @abm @RobElliott @ChristianAbata can give you some support.

Regards,

Ferran

Did I answer your question? Please consider to mark my post as a solution to help others.
Proud to be a Flownaut!
efialttes
Community Champion
Community Champion

OMG... what a challenging thread!

My suggestion is to split the problem in two:

1-First build an Excel table for testing purposes with less than 5k (or even less than 256) rows in order to make your filter strategy work as expected

2-Once you got a proper Filter strategy, test it with your 17k Excel by adding whatever strategy you chose to read the whole table (pagination/do until/etc)

I would focus this thread to the first step/problem only

If you agree on this approach, please let us know your progress with first step

Ánimo!

Did I make your day? If so, mark my response as 'Solution' !!!

También escribo sobre Power Automate en este Blog y en Twitter

EDITED

Hello @efialttes ! Good morning and welcome to this headache!

 

Ok, as I stated before I did a test with less than 256 rows. WORKED (Sent me the html table as spected!)!

 

Test with less than 5k rows. WORKED (Sent me the html table as spected!)!

 

Tested with more than 5k rows. FAILED (Sent me an email with empty) HTML table.

 

So the problem was on Get a row in excel. He could not, due to limitation on this item, get more than 5k rows.

 

As I mentioned before, I found a workaround and, by now, I can read entire 17k rows!

 

BUT

 

Filter array is still not working, as It receives all 17 k rows (I confirmed this by finding an information that is specific on the 17718 row.

 

But the output is going empty, for the 1st row, 256 row and 17th row. It sends me empty e-mail. 

 

What can we do?

 

Help me Master Yoda!

Hi again!

"So the problem was on Get a row in excel. He could not, due to limitation on this item, get more than 5k rows."

Did you activate pagination in yor Excel 'List rows present in a table'? I just managed to read more than 20,000 rows in one shot by activating it and setting a huge Threshold: 100,000.

I am testing with 20,642 rows, and as you can see in the Compose output screenshot, 20,642 is the number displayed, so 'List rows present in a table' is prodiding as output more than 5k. No need to 'Do Until' logic

 

Hope this helps

Flow_excelOver20000.png

Did I make your day? If so, mark my response as 'Solution' !!!

También escribo sobre Power Automate en este Blog y en Twitter

Hello @efialttes  made several tests here:

 

Paginations are limited to 5k.

 

But my workaround I mentioned before solved this part of "get rows":

2.png

 

The problem is within Filter Array.

 

Why I confirm that? Because the filter array had this command: @and(equals(triggerOutputs()?['body/Title'], item()?['Vendor']),equals(item()?['Document Type'], 'CA'))

 

And with this, it gaves me an empty table.

 

So I removed the @and and placed a simple filter:

 

1.png

 

Sucess! It sent me an table with information from row 17728 & 17729 (Both related to vendor 205044):

 

3.png4.png

 

Now I need to figure out how to properly adjust the filter array to filter both information: Title equal to vendor AND Document Type equal to CA.

 

My code is: @and(equals(triggerOutputs()?['body/Title'], item()?['Vendor']),equals(item()?['Document Type'], 'CA'))

 

Can you find out what I made wrong?

@Lucas_Goncalves 

Sorry to insist, but pagination is not limited to 5K, as I have shown you by sharing a screenshot of my test flow design and its results when executing it .

Just guessing, can you doublecheck you do not have 5000 assigned as 'Top Count' ? If so, it explains why you are experiencing a 5,000 limit

Once we get rid of this 5,000 limit in you current flow design, we will simplify the overall picture

Thanx!

Did I make your day? If so, mark my response as 'Solution' !!!

También escribo sobre Power Automate en este Blog y en Twitter

Hello @efialttes  no problem in insisting!

 

Please find error below. No top count and pagination placed in 50k:

1.png

 

 

 

That said, I believe the workaround I made is the only one avaiable... It works! Now the filter is the headache!

Helpful resources

Announcements

Back to Basics: Tuesday Tip #1: All About YOUR Community Account

We are excited to kick off our new #TuesdayTIps series, "Back to Basics." This weekly series is our way of helping the amazing members of our community--both new members and seasoned veterans--learn and grow in how to best engage in the community! Each Tuesday, we will feature new areas of content that will help you best understand the community--from ranking and badges to profile avatars, from Super Users to blogging in the community. Our hope is that this information will help each of our community members grow in their experience with Power Platform, with the community, and with each other!     This Week's Tips: Account Support: Changing Passwords, Changing Email Addresses or Usernames, "Need Admin Approval," Etc.Wondering how to get support for your community account? Check out the details on these common questions and more. Just follow the link below for articles that explain it all.Community Account Support - Power Platform Community (microsoft.com)   All About GDPR: How It Affects Closing Your Community Account (And Why You Should Think Twice Before You Do)GDPR, the General Data Protection Regulation (GDPR), took effect May 25th 2018. A European privacy law, GDPR imposes new rules on companies and other organizations offering goods and services to people in the European Union (EU), or that collect and analyze data tied to EU residents. GDPR applies no matter where you are located, and it affects what happens when you decide to close your account. Read the details here:All About GDPR - Power Platform Community (microsoft.com)   Getting to Know You: Setting Up Your Community Profile, Customizing Your Profile, and More.Your community profile helps other members of the community get to know you as you begin to engage and interact. Your profile is a mirror of your activity in the community. Find out how to set it up, change your avatar, adjust your time zone, and more. Click on the link below to find out how:Community Profile, Time Zone, Picture (Avatar) & D... - Power Platform Community (microsoft.com)   That's it for this week. Tune in for more Tuesday Tips next Tuesday and join the community as we get "Back to Basics."

Announcing the MPPC's Got Power Talent Show at #MPPC23

Are you attending the Microsoft Power Platform Conference 2023 in Las Vegas? If so, we invite you to join us for the MPPC's Got Power Talent Show!      Our talent show is more than a show—it's a grand celebration of connection, inspiration, and shared journeys. Through stories, skills, and collective experiences, we come together to uplift, inspire, and revel in the magic of our community's diverse talents. This year, our talent event promises to be an unforgettable experience, echoing louder and brighter than anything you've seen before.    We're casting a wider net with three captivating categories:  Demo Technical Solutions: Show us your Power Platform innovations, be it apps, flows, chatbots, websites or dashboards... Storytelling: Share tales of your journey with Power Platform. Hidden Talents: Unveil your creative side—be it dancing, singing, rapping, poetry, or comedy. Let your talent shine!    Got That Special Spark? A Story That Demands to Be Heard? Your moment is now!  Sign up to Showcase Your Brilliance: https://aka.ms/MPPCGotPowerSignUp  Deadline for submissions: Thursday, Sept 28th    How It Works:  Submit this form to sign up: https://aka.ms/MPPCGotPowerSignUp  We'll contact you if you're selected. Get ready to be onstage!  The Spotlight is Yours: Each participant has 3-5 minutes to shine, with insightful commentary from our panel of judges. We’re not just giving you a stage; we’re handing you the platform to make your mark.     Be the Story We Tell: Your talents and narratives will not just entertain but inspire, serving as the bedrock for our community’s future stories and successes.    Celebration, Surprises, and Connections: As the curtain falls, the excitement continues! Await surprise awards and seize the chance to mingle with industry experts, Microsoft Power Platform leaders, and community luminaries. It's not just a show; it's an opportunity to forge connections and celebrate shared successes.    Event Details:  Date and Time: Wed Oct 4th, 6:30-9:00PM   Location: MPPC23 at the MGM Grand, Las Vegas, NV, USA  

September User Group Success Story: Reading Dynamics 365 & Power Platform User Group

The Reading Dynamics 365 and Power Platform User Group is a community-driven initiative that started in September 2022. It has quickly earned recognition for its enthusiastic leadership and resilience in the face of challenges. With a focus on promoting learning and networking among professionals in the Dynamics 365 and Power Platform ecosystem, the group has grown steadily and gained a reputation for its commitment to its members!   The group, which had its inaugural event in January 2023 at the Microsoft UK Headquarters in Reading, has since organized three successful gatherings, including a recent social lunch. They maintain a regular schedule of four events per year, each attended by an average of 20-25 enthusiastic participants who enjoy engaging talks and, of course, pizza.   The Reading User Group's presence is primarily spread through LinkedIn and Meetup, with the support of the wider community. This thriving community is managed by a dedicated team consisting of Fraser Dear, Tim Leung, and Andrew Bibby, who serves as the main point of contact for the UK Dynamics 365 and Power Platform User Groups.   Andrew Bibby, an active figure in the Dynamics 365 and Power Platform community, nominated this group due to his admiration for the Reading UK User Group's efforts. He emphasized their remarkable enthusiasm and success in running the group, noting that they navigated challenges such as finding venues with resilience and smiles on their faces. Despite being a relatively new group with 20-30 members, they have managed to achieve high attendance at their meetings.   The group's journey began when Fraser Dear moved to the Reading area and realized the absence of a user group catering to professionals in the Dynamics 365 and Power Platform space. He reached out to Andrew, who provided valuable guidance and support, allowing the Reading User Group to officially join the UK Dynamics 365 and Power Platform User Groups community.   One of the group's notable achievements was overcoming the challenge of finding a suitable venue. Initially, their "home" was the Microsoft UK HQ in Reading. However, due to office closures, they had to seek a new location with limited time. Fortunately, a connection with Stephanie Stacey from Microsoft led them to Reading College and its Institute of Technology. The college generously offered them event space and support, forging a mutually beneficial partnership where the group promotes the Institute and encourages its members to support the next generation of IT professionals.   With the dedication of its leadership team, the Reading Dynamics 365 and Power Platform User Group is poised to continue growing and thriving! Their story exemplifies the power of community-driven initiatives and the positive impact they can have on professional development and networking in the tech industry. As they move forward with their upcoming events and collaborations with Reading College, the group is likely to remain a valuable resource for professionals in the Reading area and beyond.  

A Celebration of What We've Achieved--And Announcing Our Winners

As the sun sets on the #SummerofSolutions Challenge, it's time to reflect and celebrate! The journey we embarked upon together was not just about providing answers – it was about fostering a sense of community, encouraging collaboration, and unlocking the true potential of the Power Platform tools.   From the initial announcement to the final week's push, the Summer of Solutions Challenge has been a whirlwind of engagement and growth. It was a call to action for every member of our Power Platform community, urging them to contribute their expertise, engage in discussions, and elevate collective knowledge across the community as part of the low-code revolution.   Reflecting on the Impact As the challenge ends, it's essential to reflect on the impact it’s had across our Power Platform communities: Community Resilience: The challenge demonstrated the resilience of our community. Despite geographical distances and diverse backgrounds, we came together to contribute, learn, and collaborate. This resilience is the cornerstone of our collective strength.Diverse Expertise: The solutions shared during the challenge underscore the incredible expertise within our community. From intricate technical insights to creative problem-solving, our members showcased their diverse skill sets, enhancing our community's depth.Shared Learning: Solutions spurred shared learning. They provided opportunities for members to grasp new concepts, expand their horizons, and uncover the Power Platform tools' untapped potential. This learning ripple effect will continue to shape our growth. Empowerment: Solutions empowered community members. They validated their knowledge, boosted their confidence, and highlighted their contributions. Each solution shared was a step towards personal and communal empowerment. We are proud and thankful as we conclude the Summer of Solutions Challenge. The challenge showed the potential of teamwork, the benefit of knowledge-sharing, and the resilience of our Power Platform community. The solutions offered by each member are more than just answers; they are the expression of our shared commitment to innovation, growth, and progress!     Drum roll, Please... And now, without further ado, it's time to announce the winners who have risen above the rest in the Summer of Solutions Challenge!   These are the top community users and Super Users who have not only earned recognition but have become beacons of inspiration for us all.   Power Apps Community:  Community User Winner: @SpongYe Super User Winner: Pending Acceptance Power Automate Community:  Community User Winner: @trice602 Super User Winner: @Expiscornovus  Power Virtual Agents Community: Community User Winner: Pending AcceptanceSuper User: Pending Acceptance Power Pages Community: Community User Winner: @OOlashyn Super User Winner: @ChristianAbata   We are also pleased to announced two additional tickets that we are awarding to the Overall Top Solution providers in the following communities:    Power Apps: @LaurensM   Power Automate: @ManishSolanki    Thank you for making this challenge a resounding success. Your participation has reaffirmed the strength of our community and the boundless potential that lies within each of us. Let's keep the spirit of collaboration alive as we continue on this incredible journey in Power Platform together.Winners, we will see you in Vegas! Every other amazing solutions superstar, we will see you in the Community!Congratulations, everyone!

September featured user group leader

 Ayonija Shatakshi, a seasoned senior consultant at Improving, Ohio, is a passionate advocate for M365, SharePoint, Power Platform, and Azure, recognizing how they synergize to deliver top-notch solutions. Recently, we asked Ayonija to share her journey as a user group leader, shedding light on her motivations and the benefits she's reaped from her community involvement.      Ayonija embarked on her role as a user group leader in December 2022, driven by a desire to explore how the community leveraged various Power Platform components. When she couldn't find a suitable local group, she decided to create one herself!    Speaking about the impact of the community on her professional and personal growth, Ayonija says, "It's fascinating to witness how everyone navigates the world of Power Platform, dealing with license constraints and keeping up with new features. There's so much to learn from their experiences.:        Her favorite aspect of being a user group leader is the opportunity to network and engage in face-to-face discussions with fellow enthusiasts, fostering deeper connections within the community. Offering advice to budding user group leaders, Ayonija emphasized the importance of communication and consistency, two pillars that sustain any successful community initiative.      When asked why she encourages others to become user group leaders, Ayonija said, "Being part of a user group is one of the best ways to connect with experienced professionals in the same field and glean knowledge from them. If there isn't a local group, consider starting one; you'll soon find like-minded individuals."      Her highlight from the past year as a user group leader was witnessing consistent growth within the group, a testament to the thriving community she has nurtured. Advocating for user group participation, Ayonija stated, "It's the fastest route to learning from the community, gaining insights, and staying updated on industry trends."   Check out her group: Cleveland Power Platform User Group

An MPPC23 Invitation from Charles Lamanna, CVP of Microsoft Business Applications & Platform

Hear from Corporate Vice President for Microsoft Business Applications & Platform, Charles Lamanna, as he looks ahead to the second annual Microsoft Power Platform Conference from October 3rd-5th 2023 at the MGM Grand in Las Vegas.Have you got your tickets yet? Register today at www.powerplatformconf.com  

Users online (1,889)