cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Anonymous
Not applicable

convert CSV string to table

Hi,

I have an API wich return a text, suppossed to be a csv file, in the form below :

datetime;mois;semaine;joursem;heure;vacance;Text;freQ;Scored Labels
7/15/2017 6:00:00 PM;7;28;7;18;1;29,234;67;148,2313385
10/14/2016 4:00:00 AM;10;42;6;4;0;18,922;0;-9,692166328
02/04/2017 12:00;2;5;7;12;0;9,239;0;39,99219513
05/11/2017 05:00;5;19;5;5;0;17,421;0;1,262338638
10/01/2016 13:00;10;40;7;13;0;22,333;2;-0,870968521
11/20/2016 6:00:00 AM;11;48;1;6;0;11,83;0;-13,13813114
10/18/2016 4:00:00 PM;10;43;3;16;0;20,529;42;46,49481583
2/23/2018 9:00:00 AM;2;8;6;9;0;1,231;0;1,8540411
01/05/2017 05:00;1;1;5;5;1;6,426;0;0,300328046

I don't need to save a csv file, I need to transform this to a table to save 2 specifc columns on a sharepoint list.

I tried create CSV table but, I can't make it work.

 

Thank you for your help.

 

1 ACCEPTED SOLUTION
26 REPLIES 26
tutankh
Advocate IV
Advocate IV

 

The short answer is that there is not currently a csv parsing function in Flow.  The somewhat longer answer is that depending on how reliable your csv content is, it may be possible. You'd need to write some loops to create an array of json objects that contain your data... then you could parse through the json more or less normally

CSV to JSON.png

Anonymous
Not applicable

Thanks you for your helps.

 

Can you give me an exmle of this loop ? le toos an an expemple of the code.

 

Thank you.

asmusz
Advocate II
Advocate II

All the answers on this topic are SOOOO much more complicated than it should be!

 

We have an Import-CSV command in powershell that takes CSV data and makes an object.... there should be the same thing that works just as easily in MS Flow/Logic apps.  

 

So frustrated that MS has not yet fixed this.

 

 

You can use Parse CSV action from Plumsail Documents connector. It allows you to convert CSV into an array and variables for each column. Please read this article demonstrating how it works.

 

Once you parsed CSV file you can iterate through result array and insert specific column values into SharePoint as you wanted.

This would probably work, but I don't think it's reasonable to spend over $300 a year for something that should be a base option.


@anton-khrit wrote:

You can use Parse CSV action from Plumsail Documents connector. It allows you to convert CSV into an array and variables for each column. Please read this article demonstrating how it works.

 

Once you parsed CSV file you can iterate through result array and insert specific column values into SharePoint as you wanted.


 

BryceC
Regular Visitor

I don't have access to the destination forum but need this solution....Could the solution be completely duplicated here?

I still can't believe that Microsoft has not made parsing a CSV part of the basic options/actions available in Power-Automate/Flow.  I've been advocating for this for literally years now.  C'mon MS!! This is a "standard" OOB function in almost all scripting languages, including PowerShell!  This is also one of the oldest and most common "data exchange" formats.

Hi,

I am trying to parse csv to filter it with power automate to distribute the right document to the right person, I am interested by you process, could you share the flow and not the result to really understand what action you are doing within it ?

 

Thanks !

+1

 

also curious of the solution but get hit with permission errors when accessing this link

 

https://powerusers.microsoft.com/t5/Flow-Cookbook/Convert-CSV-data-into-json/m-p/162034#M93

pedwin
Regular Visitor

I tried viewing and getting hit as well.

 

Paulie78
Super User
Super User

I’ve done a video on it which you may find helpful:

https://youtu.be/0RqSco9Til0

Thanks, Paulie,

 

Again, the issue here is not that there is no way to coerce Flow to do what you need, it's that this functionality should be built into PowerAutomate the same way it's baked in with every iteration of PowerShell i.e. 'Import-Csv'.

 

It's unconscionable to expect businesses to have to pay a third party for a connector to do this.  

Your solution is find for small CSV's of normalized data, and is fairly identical to what others (me included) have suggested.  But what happens if you don't know your column headers? What happens when your data fields could contain your delimiter string itself? Well now you have to build all of that conditional logic into the flow.  What if, in addition, your data has a thousand, or ten thousand rows? we're talking about a monstrous time spent in a single PowerAutomate run, just to get it to parse a silly CSV that would take 10 seconds in PowerShell.

MS Needs to build this functionality into PowerAutomate.

 

ok... rant over... 🙂 

Paulie78
Super User
Super User

Nearly all of your points are totally valid. Makes me think I should do a video on using an Azure function that uses convert-csv.

 

The method I used, made use of no variables so you can use concurrency to make it much faster than the methods that use variables. You could set concurrency to 50. But 10,000 rows would still take some time.

This is exactly my point as well.  I know it "can be done" but the steps involved are just ludicrous for something that's so simple in most languages, I.E. PowerShell, Python, PHP, and I'm sure is an extremely common need.

Another issue with concurrency is that, depending on your subscription level, you're likely to get rate limited.  Again, for a simple function like parsing a csv, this seems backwards... I understand why rate limits are invoked, but with larger data sets it's unlikely that you won't get rate limited.

tutankh
Advocate IV
Advocate IV

Just in case anyone else is browsing this... There is a feature request/idea for this topic... Please vote!!

https://powerusers.microsoft.com/t5/Power-Automate-Ideas/Text-CSV-file-get-rows/idc-p/778837#M23876

pedwin
Regular Visitor

Thanks Paulie78 - this definitely helps as my use case involves consuming multiple csv files that has fewer than 50 records. 

But I do agree with tutankh, Microsoft should provide this feature as an builtin action. 

Paulie78
Super User
Super User

@pedwin In addition to the video, I've written up the process for parsing the CSV on my blog: How to Parse CSV files with Power Automate 

You can download my flow from there and import into your environment to get you started quickly.

Helpful resources

Announcements

Register now for the Business Applications Launch Event | Tuesday, April 4, 2023

Join us for an in-depth look into the latest updates across Microsoft Dynamics 365 and Microsoft Power Platform that are helping businesses overcome their biggest challenges today.   Find out about new features, capabilities, and best practices for connecting data to deliver exceptional customer experiences, collaborating, and creating using AI-powered capabilities, driving productivity with automation—and building towards future growth with today’s leading technology.   Microsoft leaders and experts will guide you through the full 2023 release wave 1 and how these advancements will help you: Expand visibility, reduce time, and enhance creativity in your departments and teams with unified, AI-powered capabilities.Empower your employees to focus on revenue-generating tasks while automating repetitive tasks.Connect people, data, and processes across your organization with modern collaboration tools.Innovate without limits using the latest in low-code development, including new GPT-powered capabilities.    Click Here to Register Today!    

Power Platform Connections - Episode 5 | March 16, 2023

Episode Five of Power Platform Connections sees David Warner and Hugo Bernier talk to Vice President of Power Automate, Stephen Siciliano, alongside the latest news, product reviews, and community blogs.     Use the hashtag #PowerPlatformConnects on social media for a chance to have your work featured on the show!      Show schedule in this episode:  0:00 Cold Open  0:34 Show Intro  01:09 Stephen Siciliano Interview  30:42 Blogs & Articles  31:06 PnP Weekly Ep 200  32:51 SharePoint Custom Form Backup  33:38 Power Apps Extreme Makeover  34:56 ChatGPT Control  35:35 Color Data  37:17 Top 7 Features on Dynamics 365 2023 Release Wave 1  38:30 Outro & Bloopers  Check out the blogs and articles featured in this week’s episode:    https://pnp.github.io/blog/microsoft-365-pnp-weekly/episode-200/​ (no tags)   https://grazfuchs.net/post/sharepoint-customform-backup/ @Maximilian Müllerhttps://www.fromzerotoheroes.com/ @Kristine Kolodziejski​ https://github.com/Power-Maverick/PCF-Controls/tree/master/ChatGPTControl @DanzMaverick https://yerawizardcat.com/color/ ​ @CatSchneider https://events.powercommunity.com/dynamics-power-israel/ @VictorDantas  Action requested: Feel free to provide feedback on how we can make our community more inclusive and diverse.  This episode premiered live on our YouTube at 12pm PST on Thursday, 16th March 2023.  Video series available at Power Platform Community YouTube channel.    Upcoming events:  Business Applications Launch – April 4th – Free and Virtual! M365 Conference - May 1-5th - Las Vegas Power Apps Developers Summit – May 19-20th - London European Power Platform conference – Jun. 20-22nd - Dublin Microsoft Power Platform Conference – Oct. 3-5th - Las Vegas  Join our Communities:  Power Apps Community Power Automate Community Power Virtual Agents Community Power Pages Community  If you’d like to hear from a specific community member in an upcoming recording and/or have specific questions for the Power Platform Connections team, please let us know. We will do our best to address all your requests or questions.     

Check out the new Power Platform Communities Front Door Experience!

We are excited to share the ‘Power Platform Communities Front Door’ experience with you!   Front Door brings together content from all the Power Platform communities into a single place for our community members, customers and low-code, no-code enthusiasts to learn, share and engage with peers, advocates, community program managers and our product team members. There are a host of features and new capabilities now available on Power Platform Communities Front Door to make content more discoverable for all power product community users which includes ForumsUser GroupsEventsCommunity highlightsCommunity by numbersLinks to all communities Users can see top discussions from across all the Power Platform communities and easily navigate to the latest or trending posts for further interaction. Additionally, they can filter to individual products as well.   Users can filter and browse the user group events from all power platform products with feature parity to existing community user group experience and added filtering capabilities.     Users can now explore user groups on the Power Platform Front Door landing page with capability to view all products in Power Platform.      Explore Power Platform Communities Front Door today. Visit Power Platform Community Front door to easily navigate to the different product communities, view a roll up of user groups, events and forums.

Microsoft Power Platform Conference | Registration Open | Oct. 3-5 2023

We are so excited to see you for the Microsoft Power Platform Conference in Las Vegas October 3-5 2023! But first, let's take a look back at some fun moments and the best community in tech from MPPC 2022 in Orlando, Florida.   Featuring guest speakers such as Charles Lamanna, Heather Cook, Julie Strauss, Nirav Shah, Ryan Cunningham, Sangya Singh, Stephen Siciliano, Hugo Bernier and many more.   Register today: https://www.powerplatformconf.com/   

Announcing | Super Users - 2023 Season 1

Super Users – 2023 Season 1    We are excited to kick off the Power Users Super User Program for 2023 - Season 1.  The Power Platform Super Users have done an amazing job in keeping the Power Platform communities helpful, accurate and responsive. We would like to send these amazing folks a big THANK YOU for their efforts.      Super User Season 1 | Contributions July 1, 2022 – December 31, 2022  Super User Season 2 | Contributions January 1, 2023 – June 30, 2023    Curious what a Super User is? Super Users are especially active community members who are eager to help others with their community questions. There are 2 Super User seasons in a year, and we monitor the community for new potential Super Users at the end of each season. Super Users are recognized in the community with both a rank name and icon next to their username, and a seasonal badge on their profile.    Power Apps  Power Automate  Power Virtual Agents  Power Pages  Pstork1*  Pstork1*  Pstork1*  OliverRodrigues  BCBuizer  Expiscornovus*  Expiscornovus*  ragavanrajan  AhmedSalih  grantjenkins  renatoromao    Mira_Ghaly*  Mira_Ghaly*      Sundeep_Malik*  Sundeep_Malik*      SudeepGhatakNZ*  SudeepGhatakNZ*      StretchFredrik*  StretchFredrik*      365-Assist*  365-Assist*      cha_cha  ekarim2020      timl  Hardesh15      iAm_ManCat  annajhaveri      SebS  Rhiassuring      LaurensM  abm      TheRobRush  Ankesh_49      WiZey  lbendlin      Nogueira1306  Kaif_Siddique      victorcp  RobElliott      dpoggemann  srduval      SBax  CFernandes      Roverandom  schwibach      Akser  CraigStewart      PowerRanger  MichaelAnnis      subsguts  David_MA      EricRegnier  edgonzales      zmansuri  GeorgiosG      ChrisPiasecki  ryule      AmDev  fchopo      phipps0218   tom_riha      theapurva        Akash17        BCLS776        rampprakash        Rusk        cchannon        a33ik        AaronKnox        Matren        Alex_10        Jeff_Thorpe        poweractivate        Ramole        DianaBirkelbach        DavidZoon        AJ_Z        PriyankaGeethik        BrianS        StalinPonnusamy        HamidBee        CNT        Anonymous_Hippo        Anchov        KeithAtherton        alaabitar        Tolu_Victor        KRider        sperry1625        IPC_ahaas        If an * is at the end of a user's name this means they are a Multi Super User, in more than one community. Please note this is not the final list, as we are pending a few acceptances.  Once they are received the list will be updated. 

Top Solution Authors
Users online (4,796)