cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Geoff_Olives
Advocate I
Advocate I

Data load for Dataverse for Teams tables

Can someone suggest some solutions for loading data into my Dataverse for Teams application? I've setup tables and have hundreds of records to add, but the only method I see is manually typing in the data.

 

Do we have to create some Power Automate to pick up data in a CSV or Excel file and add it to the tables? Or is there some better way?

 

Thanks for your ideas.


Geoff

2 ACCEPTED SOLUTIONS

Accepted Solutions
Geoff_Olives
Advocate I
Advocate I

I had to build a Power Automate flow. 

There is no "upsert" CDS function, so I had to create a flow that looks at an Excel table and cycles through the records, for each row it queries the database to see if the record alread exists. If so, then update. If not, then insert. 

This is so incredibly complicated for a tool that Microsoft is trying to put into the hands of the user! It took a few hours to learn how to put it all together correctly, and changes to the data are a pain. Tell me that any of my users would be able to do this, even with guidance. 

 

Setup your import file:

  1. Create an Excel file in Teams. Save the file in a channel.
  2. Add columns and data
  3. Format as a table
  4. Name the table the name of your table to help keep it straight.

Import data via Excel in Dataverse for Teams:

  1. Open Power Apps in Teams
  2. Click the Build tab.
  3. Select your team and click See all in the Built by this team panel.
  4. Click the Flows page on the left and then click New.
  5. Create a new flow, from manual trigger.
  6. Add a step - Excel: List rows present in a table 
    1. Point the step to the sharepoint site for the team
    2. Point the Document library to the library in the team
    3. Choose the file. I called mine "data load".
    4. Select the table that was named above.
  7. Add a step - Apply to each
    1. Output from this step is the Excel value
  8. Add a step inside the apply to each - CDS List records. Look for an existing record with the filter.
    1. Set the Entity name to the name of the Dataverse table
    2. Show advanced options
    3. Set Filter query to be the key column of the table, equal to, and set to column from your Excel table.  The name of the column in the Dataverse table is not the same as the description. Open the table to see all the columns with the actual column name. My "Name" column was actually named "cre4f_name".  "eq" mean equals. And then surround the Excel field from the previous step with single tick marks.  The result looks like this:
    4. Query:  cre4f_name eq '[xl]Name'
  9. Add a step inside the apply to each - Condition
    1. Set the condition to be an expression.  Check the length of the output to see if a record came back from the query. "List_records" below is the name of the previous step, with the space replaced by an underscore.
    2. Expression:  length(outputs('List_records')?['body/value'])
  1. Add a step to the Yes condition.
    1. Update a record 2
    2. Set Item ID to Previous CDS entity (My table is called Member)
    3. Set the new values for the fields. I updated Email, first name, last name, phone.  
    4. I had to use a formula to setup dates properly. "If the Join date field isn't empty, then set the join date to start of day(join date).
if(equals(empty(items('Apply_to_each')?['Join Date']),bool('True')),null,startOfDay(items('Apply_to_each')?['Join Date']))
 
 
Add another step to the no condition.
Create a new record. Entity is the CDS members.
Set the key.
Update all the fields as above.
 
 
Test. Fix. Repeat until it actually works.
 
1.png2.png3.png4.png5.png

View solution in original post

Hello @Geoff_Olives,

I'm sure you've seen this post already, but just in case anyone lands here, Microsoft have now provided functionality to import/edit data into Dataverse for Teams via Excel.

Here's the blog post.

Here's the Microsoft Docs.

Thanks,

Garry

View solution in original post

11 REPLIES 11

Hi @Geoff_Olives ,

 

I’m haven’t tried this scenario yet but it looks like you will have to build a Power Automate Flow at this stage based on the documentation.

 

https://docs.microsoft.com/en-us/powerapps/teams/data-platform-faqs#how-do-users-import-data-into-ta...

 

security.

How do users import data into tables in Dataverse for Teams?

Makers have the opportunity to bring in data through both the apps they develop as well as via connectors in Power Apps and Power Automate.

EricRegnier
Super User
Super User

Hi @Geoff_Olives,

Haven't tried this either, but Dataflows might work with the CSV or Excel connector:

https://docs.microsoft.com/en-us/powerapps/maker/common-data-service/create-and-use-dataflows 

 

EDIT: might not be possible after all following this threadhttps://docs.microsoft.com/en-us/powerapps/teams/data-platform-compare#business-intelligence-and-pro...

 

Cheers

Geoff_Olives
Advocate I
Advocate I

I had to build a Power Automate flow. 

There is no "upsert" CDS function, so I had to create a flow that looks at an Excel table and cycles through the records, for each row it queries the database to see if the record alread exists. If so, then update. If not, then insert. 

This is so incredibly complicated for a tool that Microsoft is trying to put into the hands of the user! It took a few hours to learn how to put it all together correctly, and changes to the data are a pain. Tell me that any of my users would be able to do this, even with guidance. 

 

Setup your import file:

  1. Create an Excel file in Teams. Save the file in a channel.
  2. Add columns and data
  3. Format as a table
  4. Name the table the name of your table to help keep it straight.

Import data via Excel in Dataverse for Teams:

  1. Open Power Apps in Teams
  2. Click the Build tab.
  3. Select your team and click See all in the Built by this team panel.
  4. Click the Flows page on the left and then click New.
  5. Create a new flow, from manual trigger.
  6. Add a step - Excel: List rows present in a table 
    1. Point the step to the sharepoint site for the team
    2. Point the Document library to the library in the team
    3. Choose the file. I called mine "data load".
    4. Select the table that was named above.
  7. Add a step - Apply to each
    1. Output from this step is the Excel value
  8. Add a step inside the apply to each - CDS List records. Look for an existing record with the filter.
    1. Set the Entity name to the name of the Dataverse table
    2. Show advanced options
    3. Set Filter query to be the key column of the table, equal to, and set to column from your Excel table.  The name of the column in the Dataverse table is not the same as the description. Open the table to see all the columns with the actual column name. My "Name" column was actually named "cre4f_name".  "eq" mean equals. And then surround the Excel field from the previous step with single tick marks.  The result looks like this:
    4. Query:  cre4f_name eq '[xl]Name'
  9. Add a step inside the apply to each - Condition
    1. Set the condition to be an expression.  Check the length of the output to see if a record came back from the query. "List_records" below is the name of the previous step, with the space replaced by an underscore.
    2. Expression:  length(outputs('List_records')?['body/value'])
  1. Add a step to the Yes condition.
    1. Update a record 2
    2. Set Item ID to Previous CDS entity (My table is called Member)
    3. Set the new values for the fields. I updated Email, first name, last name, phone.  
    4. I had to use a formula to setup dates properly. "If the Join date field isn't empty, then set the join date to start of day(join date).
if(equals(empty(items('Apply_to_each')?['Join Date']),bool('True')),null,startOfDay(items('Apply_to_each')?['Join Date']))
 
 
Add another step to the no condition.
Create a new record. Entity is the CDS members.
Set the key.
Update all the fields as above.
 
 
Test. Fix. Repeat until it actually works.
 
1.png2.png3.png4.png5.png
EricRegnier
Super User
Super User

Yep, there might be a learning curve at first but from a developer/citizen developer perspective promise that you'll get the hang of it quickly. Also, note the Dataverse for Teams just came come out so we should expect a lot of features and enhancements in the next waves...

Unfortunately there isn't an upsert function with the connector but there's is with the SDK.

You should submit that idea at (if it doesn't already exists): https://powerusers.microsoft.com/t5/Power-Apps-Ideas/idb-p/PowerAppsIdeas

Cheers

Hello @Geoff_Olives,

I'm sure you've seen this post already, but just in case anyone lands here, Microsoft have now provided functionality to import/edit data into Dataverse for Teams via Excel.

Here's the blog post.

Here's the Microsoft Docs.

Thanks,

Garry

I had not, but this will be awesome. I'll have to check it out.

 

@GarryPope The information in the

 

Use “Edit in Excel” in Dataverse for Teams

 

link seems incorrect. It says:

 

 

  • From the Build tab select Tables, and then select your table.
  • Expand the ellipses menu to access the “Edit in Excel” feature.

I don't have an ellipsis menu.

 

 

Anonymous
Not applicable

Hi Everyone,

 

The Power Automate approach above looks like a great solution. However, one of the reasons we are using Dataverse in Teams is to avoid the premium costs of connecting to our onsite data, etc. and this Power Automate uses a couple of Premium Actions.

I have also tested the "Edit in Excel" in Dataverse for Teams and it works great, but it is a very manual process. I will need to update my 5 data tables 2-3 times per day so doing this manually will get tedious. Has anyone found another automated solution or built one with Power Automate?  I am still learning Power Automate, so not sure what it's full potential is without using Premium Actions.

Thanks for any advice!

Anonymous
Not applicable


@AlanBourke wrote:

@GarryPopeThe information in the

 

Use “Edit in Excel” in Dataverse for Teams

 

link seems incorrect. It says:

 

 

  • From the Build tab select Tables, and then select your table.
  • Expand the ellipses menu to access the “Edit in Excel” feature.

I don't have an ellipsis menu.

 

 


Hi Alan,

After installing the MS Office PowerApps add-in, it took me a bit to find the ellipsis menu with the appropriate "Edit data in Excel" option within Teams. I discovered that you have to click the Build tab, then click the See All link. The "Edit data in Excel" option will not be on those menus even though your tables may be listed there.  You still have to click the Tables tab on the left panel and only then can you select the ellipsis menu and get the "Edit data in Excel" option.

Hope it helps!

Helpful resources

Announcements

Join Us for the First-Ever Biz Apps Community User Group Meeting: Live from MPPC23

  Join us for the first-ever the Biz Apps Community User Group meeting live from the Power Platform Conference! This one hour user group meeting is all about discovering the value and benefits of User Groups! Discover how you can find a group in your local area or about specific topics where you can learn new skills and meet like-minded people as a user group member.   Hear from User Group leaders about why they do what they do and what resources they receive to help them succeed as community ambassadors. If you have never attended a User Group meeting before, this will be a great introduction! We hope you are inspired to find a group that meets your unique interests!   October 5th at 2:15 pm Pacific time   If you're attending #MPPC23 in Las Vegas, join us in person! Find out more here: https://powerplatformconf.com/#!/session/Biz%20Apps%20Community%20User%20Group%20Meeting%20-%20Live%20from%20MPPC/6172   Not at MPPC23? Attend vvirtually by registering here: https://aka.ms/MPPCusergroupmeeting2023    If you can't attend this meeting live, don't worry! We will record this meeting and share it with the Community at powerusers.microsoft.com 

Back to Basics: Tuesday Tip #1: All About YOUR Community Account

We are excited to kick off our new #TuesdayTIps series, "Back to Basics." This weekly series is our way of helping the amazing members of our community--both new members and seasoned veterans--learn and grow in how to best engage in the community! Each Tuesday, we will feature new areas of content that will help you best understand the community--from ranking and badges to profile avatars, from Super Users to blogging in the community. Our hope is that this information will help each of our community members grow in their experience with Power Platform, with the community, and with each other!     This Week's Tips: Account Support: Changing Passwords, Changing Email Addresses or Usernames, "Need Admin Approval," Etc.Wondering how to get support for your community account? Check out the details on these common questions and more. Just follow the link below for articles that explain it all.Community Account Support - Power Platform Community (microsoft.com)   All About GDPR: How It Affects Closing Your Community Account (And Why You Should Think Twice Before You Do)GDPR, the General Data Protection Regulation (GDPR), took effect May 25th 2018. A European privacy law, GDPR imposes new rules on companies and other organizations offering goods and services to people in the European Union (EU), or that collect and analyze data tied to EU residents. GDPR applies no matter where you are located, and it affects what happens when you decide to close your account. Read the details here:All About GDPR - Power Platform Community (microsoft.com)   Getting to Know You: Setting Up Your Community Profile, Customizing Your Profile, and More.Your community profile helps other members of the community get to know you as you begin to engage and interact. Your profile is a mirror of your activity in the community. Find out how to set it up, change your avatar, adjust your time zone, and more. Click on the link below to find out how:Community Profile, Time Zone, Picture (Avatar) & D... - Power Platform Community (microsoft.com)   That's it for this week. Tune in for more Tuesday Tips next Tuesday and join the community as we get "Back to Basics."

Power Platform Community Newsletter: September 2023

Welcome to our September 2023 Newsletter, where we highlight the latest news, product releases, podcasts, upcoming events, and the great work of our Power Platform Community members. As usual, please make sure you follow our News & Announcements in the Community to stay up to date. Another great way to connect is to join our Power Platform Community on LinkedIn. You can join our LInkedIn community here.   MPPC's Got Power - Submissions end September 28th! Are you ready to showcase your skills at the Microsoft Power Platform Conference in Las Vegas? Don't miss out on the "MPPC's Got Power" talent show, a grand celebration of connection, inspiration, and shared journeys. Whether you're a technical innovator, a talented storyteller, or have a hidden creative side, we want to see what you've got! With three categories to choose from, you have the chance to shine on stage and make your mark in the Microsoft Power Platform community.  Click the GIF to sign up by Thursday 28th September to be part of an unforgettable MPPC23 experience. Now is your time to shine!     Check Out the Low Code Approach Podcast Give the Low Code Approach Podcast a listen! Hosted by Sean Fiene, Wendy Haddad, and Kenric Auguillard, this innovative show shines a light on how Microsoft MVPs, product team members, and Community users are building exciting solutions using Microsoft Power Platform. Plus, with guests like Kartik Kanakasabesan, April Dunnam, Ricardo Duncan Jr., Sonja Gu, Phil Topness, Shane Young and more, this weekly show is a must for all you Business Applications enthusiasts out there. Click the image below to check it out!           COMMUNITY HIGHLIGHTS Check out the most active Community users for August 2023. These hardworking members are posting regularly, answering questions, writing blogs, giving kudos, and providing top solutions in their communities across Power Platform. Huge thanks to these amazing community members for their great contributions last month! trice602poweractivateLaurensMWarrenBelzAmikBCBuizerSamLedcreativeopinion timlExpiscornovusManishSolankiMattJimisonfernandosilvaMisterMarkPstork1saudali_25hafizsultan242Lucas001ragavanrajanp_doc   UPCOMING EVENT: 365 EDUCON CHICAGO Whether you're new to Microsoft 365, Power Platform and SharePoint, or an experienced power user, admin or developer, 365 EduCon has content designed to fit your experience level and area of interest. Their workshops and sessions are taught by Microsoft Certified Trainers, MVPs, Regional Directors, and Engineers. Find out more and register here: Home - Microsoft 365 EduCon Chicago - A Microsoft 365 Conference.  

Announcing the MPPC's Got Power Talent Show at #MPPC23

Are you attending the Microsoft Power Platform Conference 2023 in Las Vegas? If so, we invite you to join us for the MPPC's Got Power Talent Show!      Our talent show is more than a show—it's a grand celebration of connection, inspiration, and shared journeys. Through stories, skills, and collective experiences, we come together to uplift, inspire, and revel in the magic of our community's diverse talents. This year, our talent event promises to be an unforgettable experience, echoing louder and brighter than anything you've seen before.    We're casting a wider net with three captivating categories:  Demo Technical Solutions: Show us your Power Platform innovations, be it apps, flows, chatbots, websites or dashboards... Storytelling: Share tales of your journey with Power Platform. Hidden Talents: Unveil your creative side—be it dancing, singing, rapping, poetry, or comedy. Let your talent shine!    Got That Special Spark? A Story That Demands to Be Heard? Your moment is now!  🚀 Sign up to Showcase Your Brilliance: https://aka.ms/MPPCGotPowerSignUp  🔥 Deadline for submissions: Thursday, Sept 28th    How It Works:  Submit this form to sign up: https://aka.ms/MPPCGotPowerSignUp  We'll contact you if you're selected. Get ready to be onstage!  The Spotlight is Yours: Each participant has 3-5 minutes to shine, with insightful commentary from our panel of judges. We’re not just giving you a stage; we’re handing you the platform to make your mark.     Be the Story We Tell: Your talents and narratives will not just entertain but inspire, serving as the bedrock for our community’s future stories and successes.    Celebration, Surprises, and Connections: As the curtain falls, the excitement continues! Await surprise awards and seize the chance to mingle with industry experts, Microsoft Power Platform leaders, and community luminaries. It's not just a show; it's an opportunity to forge connections and celebrate shared successes.    Event Details:  📆 Date and Time: Wed Oct 4th, 6:30-9:00PM   📍 Location: MPPC23 at the MGM Grand, Las Vegas, NV, USA  

September User Group Success Story: Reading Dynamics 365 & Power Platform User Group

The Reading Dynamics 365 and Power Platform User Group is a community-driven initiative that started in September 2022. It has quickly earned recognition for its enthusiastic leadership and resilience in the face of challenges. With a focus on promoting learning and networking among professionals in the Dynamics 365 and Power Platform ecosystem, the group has grown steadily and gained a reputation for its commitment to its members!   The group, which had its inaugural event in January 2023 at the Microsoft UK Headquarters in Reading, has since organized three successful gatherings, including a recent social lunch. They maintain a regular schedule of four events per year, each attended by an average of 20-25 enthusiastic participants who enjoy engaging talks and, of course, pizza.     The Reading User Group's presence is primarily spread through LinkedIn and Meetup, with the support of the wider community. This thriving community is managed by a dedicated team consisting of Fraser Dear, Tim Leung, and Andrew Bibby, who serves as the main point of contact for the UK Dynamics 365 and Power Platform User Groups.   Andrew Bibby, an active figure in the Dynamics 365 and Power Platform community, nominated this group due to his admiration for the Reading UK User Group's efforts. He emphasized their remarkable enthusiasm and success in running the group, noting that they navigated challenges such as finding venues with resilience and smiles on their faces. Despite being a relatively new group with 20-30 members, they have managed to achieve high attendance at their meetings.   The group's journey began when Fraser Dear moved to the Reading area and realized the absence of a user group catering to professionals in the Dynamics 365 and Power Platform space. He reached out to Andrew, who provided valuable guidance and support, allowing the Reading User Group to officially join the UK Dynamics 365 and Power Platform User Groups community.   One of the group's notable achievements was overcoming the challenge of finding a suitable venue. Initially, their "home" was the Microsoft UK HQ in Reading. However, due to office closures, they had to seek a new location with limited time. Fortunately, a connection with Stephanie Stacey from Microsoft led them to Reading College and its Institute of Technology. The college generously offered them event space and support, forging a mutually beneficial partnership where the group promotes the Institute and encourages its members to support the next generation of IT professionals.   With the dedication of its leadership team, the Reading Dynamics 365 and Power Platform User Group is poised to continue growing and thriving! Their story exemplifies the power of community-driven initiatives and the positive impact they can have on professional development and networking in the tech industry. As they move forward with their upcoming events and collaborations with Reading College, the group is likely to remain a valuable resource for professionals in the Reading area and beyond.

A Celebration of What We've Achieved--And Announcing Our Winners

As the sun sets on the #SummerofSolutions Challenge, it's time to reflect and celebrate! The journey we embarked upon together was not just about providing answers – it was about fostering a sense of community, encouraging collaboration, and unlocking the true potential of the Power Platform tools.   From the initial announcement to the final week's push, the Summer of Solutions Challenge has been a whirlwind of engagement and growth. It was a call to action for every member of our Power Platform community, urging them to contribute their expertise, engage in discussions, and elevate collective knowledge across the community as part of the low-code revolution.   Reflecting on the Impact As the challenge ends, it's essential to reflect on the impact it’s had across our Power Platform communities: Community Resilience: The challenge demonstrated the resilience of our community. Despite geographical distances and diverse backgrounds, we came together to contribute, learn, and collaborate. This resilience is the cornerstone of our collective strength.Diverse Expertise: The solutions shared during the challenge underscore the incredible expertise within our community. From intricate technical insights to creative problem-solving, our members showcased their diverse skill sets, enhancing our community's depth.Shared Learning: Solutions spurred shared learning. They provided opportunities for members to grasp new concepts, expand their horizons, and uncover the Power Platform tools' untapped potential. This learning ripple effect will continue to shape our growth. Empowerment: Solutions empowered community members. They validated their knowledge, boosted their confidence, and highlighted their contributions. Each solution shared was a step towards personal and communal empowerment. We are proud and thankful as we conclude the Summer of Solutions Challenge. The challenge showed the potential of teamwork, the benefit of knowledge-sharing, and the resilience of our Power Platform community. The solutions offered by each member are more than just answers; they are the expression of our shared commitment to innovation, growth, and progress!   Drum roll, Please... And now, without further ado, it's time to announce the winners who have risen above the rest in the Summer of Solutions Challenge!   These are the top community users and Super Users who have not only earned recognition but have become beacons of inspiration for us all.   Power Apps Community:  Community User Winner: @SpongYe Super User Winner: Pending Acceptance Power Automate Community:  Community User Winner: @trice602 Super User Winner: @Expiscornovus  Power Virtual Agents Community: Community User Winner: Pending AcceptanceSuper User: Pending Acceptance Power Pages Community: Community User Winner: @OOlashyn Super User Winner: @ChristianAbata   We are also pleased to announced two additional tickets that we are awarding to the Overall Top Solution providers in the following communities:    Power Apps: @LaurensM   Power Automate: @ManishSolanki    Thank you for making this challenge a resounding success. Your participation has reaffirmed the strength of our community and the boundless potential that lies within each of us. Let's keep the spirit of collaboration alive as we continue on this incredible journey in Power Platform together.Winners, we will see you in Vegas! Every other amazing solutions superstar, we will see you in the Community!Congratulations, everyone!

Top Solution Authors
Top Kudoed Authors
Users online (4,064)