cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Anonymous
Not applicable

Create a .csv file that uses UTF-8 character encoding

Hello,

as the title of the subject already suggests: I want to create a .csv file that uses UTF-8 character encoding.

 

The background is the following:

On a daily basis I retrieve data from Dynamics 365, create a new .csv table and save it in our SharePoint.

For example, if it was a table displaying the past invoices, ideally it would look like

 

currency, amount, invoice_id, customer_name

EUR, 100, 20514_abc, some_näme

 

The flow works totally fine so far - however, customer_name from the example above would be displayed as "some_näme" ...

All I got from my research so far is this post and I am still quite lost. What am I missing?

 

Thanks a lot in advance - I am looking forward to your replies.

 

 

1 ACCEPTED SOLUTION

Accepted Solutions
chanwulee
Advocate I
Advocate I

Hi @v-litu-msft ,

 

.csv file is a kind of text file. If you encode it in UTF-8 format, there are two ways to save it.

- Text only

Byte Order Mark(BOM)+Text

BOM is 3 characters (EF BB BF) to mark the file is encoded as UTF-8.

When you generate .csv file in Power Automate, it does not include BOM.

So, when you open the .csv file in excel, special characters(i.e. Korean) will be broken.

 

The solution is to add 3 BOM characters in front of the .csv file content before saving it.

 

concat(uriComponentToString('%EF%BB%BF'),body('Create_CSV_table'))

 

View solution in original post

26 REPLIES 26
v-litu-msft
Community Support
Community Support

Hi @Anonymous,

 

This is a known issue and not caused by Flow, there is no solution could do in the Flow side, sorry.

https://www.i18nqa.com/debug/utf8-debug.html

 

As a workaround, the only way could do in my mind is to use the text replace feature to replace these "ä" to "ä":Annotation 2020-05-15 141458.jpg

 

Best Regards,
Community Support Team _ Lin Tu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Anonymous
Not applicable

Thanks a lot for your fast reply!

Hopefully it's going to be implemented one day, better soon than late.

 

Unfortunately, the workaround won't be a satisfying solution for our issue...

It's way too much effort to use the find and replace option any time for several letters that aren't encoded properly - for any single .csv table created on a daily basis.

 

Maybe there are others having the same issue who just found another workaround that might fit here?

ChristopherBor
Regular Visitor

To my awareness the built in csv creator in flow generates a csv file with UTF-8, the problem stems from the system thinking the csv file is some other format than UTF-8.

 

If you are opening the file in excel, you can use the import function and specify that it is utf-8, which should fix the issue.

 

This guide is old, but the concept is still the same:

https://www.itg.ias.edu/content/how-import-csv-file-uses-utf-8-character-encoding-0

chanwulee
Advocate I
Advocate I

Hi @v-litu-msft ,

 

.csv file is a kind of text file. If you encode it in UTF-8 format, there are two ways to save it.

- Text only

Byte Order Mark(BOM)+Text

BOM is 3 characters (EF BB BF) to mark the file is encoded as UTF-8.

When you generate .csv file in Power Automate, it does not include BOM.

So, when you open the .csv file in excel, special characters(i.e. Korean) will be broken.

 

The solution is to add 3 BOM characters in front of the .csv file content before saving it.

 

concat(uriComponentToString('%EF%BB%BF'),body('Create_CSV_table'))

 

karacsondi
Frequent Visitor

Brilliant solution @chanwulee ! Thanks a lot! 

Anonymous
Not applicable

@chanwulee Your method needs to be more acknowledged. Thank you!

@chanwulee Thanks for this solution, really caused me a headache.

dignus93reply
Advocate I
Advocate I

@chanwulee Works good. You are a legend. Daje forte!

Hi, I have the same issue, but I cannot understand the solution.

How do I use the line of code, when I want to export the data in a table visual?

I only see the option to Export Data and then I am asked where to save the file.

 

Anonymous
Not applicable

In the Create File step, you should put 

concat(uriComponentToString('%EF%BB%BF'),body('Create_CSV_table')) in File Content field.
Anonymous
Not applicable

Great solution
Really does the job
Just one small query, when creating CSV this way - I get a CSV with some rows in crazy heights (e.g 200px or even more).

How can I define in the flow that all rows must be 15px?

Any ideas 💡with latin  characters like 'ñ' 'í' 'ó' 'á', couldn't figure out the BOM characters requiered.

dignus93reply
Advocate I
Advocate I

@chanwulee 
I come back here after my last reply. Everything works except from one character. One cursed characters "à"
It's so strange because the capital version À works fine

@groyet 
all the characters you are listing in your reply works for me.

Any ideas?


That "à" was painful but i solved replacing it manually before creating the file and concat the BOM. In detail my flow had a list rows, parse json, select, create csv table, create file in sharepoint. Here is a screenshot:

dignus93reply_3-1649757470070.png

 

The NOTE UTENTE field is the one with "à" special character. So in the Select action i put this expression

decodeUriComponent(
replace(
uriComponent(item()?['crcef_anagrafica_utenti2.crcef_note'],null),'%C3%A0','à')
)

I find the url code of "à" that is "%C3%A0". I convert the field in uri component, I replace C3A0 with à, then I decode the uri component.
After the Create CSV table 2 action there is the Create file in sharepoint action

dignus93reply_4-1649757634176.png

Where in the file content I put this

concat(uriComponentToString('%EF%BB%BF'),body('Create_CSV_table_2'))

 

Thanks to all your precious tips!

Wonderful! 

BegeNCSU
Advocate II
Advocate II

@chanwuleeis an absolute legend! Thank you very much for this solution.

You saved my Day @chanwulee!👍 Many Thanks for your solution!

Exelente solución, facil y limpia!!!!

Muchas gracias!!!

Perfect solution!

Helpful resources

Announcements

Back to Basics: Tuesday Tip #2: All About Community Ranks

This weekly series is our way of helping the amazing members of our community--both new members and seasoned veterans--learn and grow in how to best engage in the community! Each Tuesday, we will feature new areas of content that will help you best understand the community--from ranking and badges to profile avatars, from Super Users to blogging in the community. Our hope is that this information will help each of our community members grow in their experience with Power Platform, with the community, and with each other!   Have you ever wondered how your fellow community members earn the different ranks available? What is the difference between an Advocate and a Helper, a Solution Sage and a Community Champion? In today's #TuesdayTip, we share the secrets and tips to help YOU keep your ranking growing--and why it's so important to our communities. What are community ranks? - Power Platform Community (microsoft.com)   Get the details in this Knowledge Base article that shows you what ranks are, how they are achieved, and what they mean to you as you engage with other community members on a regular basis. Once you start your journey in the community, ranking up, you'll find the benefits. So get busy with those kudos, solutions, and more! We can't wait to see how you rank!That's it for this week. Tune in for more Tuesday Tips next Tuesday and join the community as we continue to get "Back to Basics."

It's #MPPC23 Week! Check Out the Community Sessions and Events Happening in Vegas

After all the planning and preparing, the annual Microsoft Power Platform Conference is finally here! We are excited to see so many of our community in Las Vegas this week. To help make sure you don't miss any of the workshops, sessions, and events we have planned, make sure to check out this handy Community One-Sheet, and download the pdf today! Make sure to stop by the Community Lounge to meet @hugobernier, @EricArcher, @heaher_italent, and @AshleyFelts from our team!    

Join Us for the First-Ever Biz Apps Community User Group Meeting: Live from MPPC23

      Join us for the first-ever the Biz Apps Community User Group meeting live from the Power Platform Conference! This one hour user group meeting is all about discovering the value and benefits of User Groups! Discover how you can find a group in your local area or about specific topics where you can learn new skills and meet like-minded people as a user group member.   Hear from User Group leaders about why they do what they do and what resources they receive to help them succeed as community ambassadors. If you have never attended a User Group meeting before, this will be a great introduction! We hope you are inspired to find a group that meets your unique interests!   October 5th at 2:15 pm Pacific time   If you're attending #MPPC23 in Las Vegas, join us in person! Find out more here: https://powerplatformconf.com/#!/session/Biz%20Apps%20Community%20User%20Group%20Meeting%20-%20Live%20from%20MPPC/6172   Not at MPPC23? Attend vvirtually by registering here: https://aka.ms/MPPCusergroupmeeting2023    If you can't attend this meeting live, don't worry! We will record this meeting and share it with the Community at powerusers.microsoft.com 

Back to Basics: Tuesday Tip #1: All About YOUR Community Account

We are excited to kick off our new #TuesdayTIps series, "Back to Basics." This weekly series is our way of helping the amazing members of our community--both new members and seasoned veterans--learn and grow in how to best engage in the community! Each Tuesday, we will feature new areas of content that will help you best understand the community--from ranking and badges to profile avatars, from Super Users to blogging in the community. Our hope is that this information will help each of our community members grow in their experience with Power Platform, with the community, and with each other!     This Week's Tips: Account Support: Changing Passwords, Changing Email Addresses or Usernames, "Need Admin Approval," Etc.Wondering how to get support for your community account? Check out the details on these common questions and more. Just follow the link below for articles that explain it all.Community Account Support - Power Platform Community (microsoft.com)   All About GDPR: How It Affects Closing Your Community Account (And Why You Should Think Twice Before You Do)GDPR, the General Data Protection Regulation (GDPR), took effect May 25th 2018. A European privacy law, GDPR imposes new rules on companies and other organizations offering goods and services to people in the European Union (EU), or that collect and analyze data tied to EU residents. GDPR applies no matter where you are located, and it affects what happens when you decide to close your account. Read the details here:All About GDPR - Power Platform Community (microsoft.com)   Getting to Know You: Setting Up Your Community Profile, Customizing Your Profile, and More.Your community profile helps other members of the community get to know you as you begin to engage and interact. Your profile is a mirror of your activity in the community. Find out how to set it up, change your avatar, adjust your time zone, and more. Click on the link below to find out how:Community Profile, Time Zone, Picture (Avatar) & D... - Power Platform Community (microsoft.com)   That's it for this week. Tune in for more Tuesday Tips next Tuesday and join the community as we get "Back to Basics."

Announcing the MPPC's Got Power Talent Show at #MPPC23

Are you attending the Microsoft Power Platform Conference 2023 in Las Vegas? If so, we invite you to join us for the MPPC's Got Power Talent Show!      Our talent show is more than a show—it's a grand celebration of connection, inspiration, and shared journeys. Through stories, skills, and collective experiences, we come together to uplift, inspire, and revel in the magic of our community's diverse talents. This year, our talent event promises to be an unforgettable experience, echoing louder and brighter than anything you've seen before.    We're casting a wider net with three captivating categories:  Demo Technical Solutions: Show us your Power Platform innovations, be it apps, flows, chatbots, websites or dashboards... Storytelling: Share tales of your journey with Power Platform. Hidden Talents: Unveil your creative side—be it dancing, singing, rapping, poetry, or comedy. Let your talent shine!    Got That Special Spark? A Story That Demands to Be Heard? Your moment is now!  Sign up to Showcase Your Brilliance: https://aka.ms/MPPCGotPowerSignUp  Deadline for submissions: Thursday, Sept 28th    How It Works:  Submit this form to sign up: https://aka.ms/MPPCGotPowerSignUp  We'll contact you if you're selected. Get ready to be onstage!  The Spotlight is Yours: Each participant has 3-5 minutes to shine, with insightful commentary from our panel of judges. We’re not just giving you a stage; we’re handing you the platform to make your mark.     Be the Story We Tell: Your talents and narratives will not just entertain but inspire, serving as the bedrock for our community’s future stories and successes.    Celebration, Surprises, and Connections: As the curtain falls, the excitement continues! Await surprise awards and seize the chance to mingle with industry experts, Microsoft Power Platform leaders, and community luminaries. It's not just a show; it's an opportunity to forge connections and celebrate shared successes.    Event Details:  Date and Time: Wed Oct 4th, 6:30-9:00PM   Location: MPPC23 at the MGM Grand, Las Vegas, NV, USA  

September User Group Success Story: Reading Dynamics 365 & Power Platform User Group

The Reading Dynamics 365 and Power Platform User Group is a community-driven initiative that started in September 2022. It has quickly earned recognition for its enthusiastic leadership and resilience in the face of challenges. With a focus on promoting learning and networking among professionals in the Dynamics 365 and Power Platform ecosystem, the group has grown steadily and gained a reputation for its commitment to its members!   The group, which had its inaugural event in January 2023 at the Microsoft UK Headquarters in Reading, has since organized three successful gatherings, including a recent social lunch. They maintain a regular schedule of four events per year, each attended by an average of 20-25 enthusiastic participants who enjoy engaging talks and, of course, pizza.   The Reading User Group's presence is primarily spread through LinkedIn and Meetup, with the support of the wider community. This thriving community is managed by a dedicated team consisting of Fraser Dear, Tim Leung, and Andrew Bibby, who serves as the main point of contact for the UK Dynamics 365 and Power Platform User Groups.   Andrew Bibby, an active figure in the Dynamics 365 and Power Platform community, nominated this group due to his admiration for the Reading UK User Group's efforts. He emphasized their remarkable enthusiasm and success in running the group, noting that they navigated challenges such as finding venues with resilience and smiles on their faces. Despite being a relatively new group with 20-30 members, they have managed to achieve high attendance at their meetings.   The group's journey began when Fraser Dear moved to the Reading area and realized the absence of a user group catering to professionals in the Dynamics 365 and Power Platform space. He reached out to Andrew, who provided valuable guidance and support, allowing the Reading User Group to officially join the UK Dynamics 365 and Power Platform User Groups community.   One of the group's notable achievements was overcoming the challenge of finding a suitable venue. Initially, their "home" was the Microsoft UK HQ in Reading. However, due to office closures, they had to seek a new location with limited time. Fortunately, a connection with Stephanie Stacey from Microsoft led them to Reading College and its Institute of Technology. The college generously offered them event space and support, forging a mutually beneficial partnership where the group promotes the Institute and encourages its members to support the next generation of IT professionals.   With the dedication of its leadership team, the Reading Dynamics 365 and Power Platform User Group is poised to continue growing and thriving! Their story exemplifies the power of community-driven initiatives and the positive impact they can have on professional development and networking in the tech industry. As they move forward with their upcoming events and collaborations with Reading College, the group is likely to remain a valuable resource for professionals in the Reading area and beyond.  

Users online (3,226)