cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
jimmy-pa
Regular Visitor

Refresh Power BI DataFlows with Flow

Hi all, good morning! 

 

Does anyone know if it's possible to create a Flow similar to automatic refresh datasets, but this time refreshing DataFlows?

 

I want to refresh a dataflow and cascade to dataset as soon as a SharePoint file is updated. Have you heard something related to this?

 

Thanks in advance and best!

Jimmy

1 ACCEPTED SOLUTION

Accepted Solutions
v-litu-msft
Community Support
Community Support

Hi @jimmy-pa,

 

Update my reply, you can use the http request to update the Power BI dataFlows with Flow, this is the refresh Dataflow API document of PowerBi, I hope it can help you:

https://docs.microsoft.com/en-us/rest/api/power-bi/dataflows/refreshdataflow

 

If you need any help during create it, please contact with us.

Best Regards,
Community Support Team _ Lin Tu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

24 REPLIES 24
v-litu-msft
Community Support
Community Support

Hi @jimmy-pa,

 

Yes, you can use the Refresh a dataset action in PowerBi connector currently, then create a Recurrence trigger to run the flow:Annotation 2019-10-21 105924.png

You can also refer to this blog updated recently:

https://powerbi.microsoft.com/en-us/blog/refresh-your-power-bi-dataset-using-microsoft-flow/

I hope it can help you.

Best Regards,
Community Support Team _ Lin Tu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

v-litu-msft
Community Support
Community Support

Hi @jimmy-pa,

 

Update my reply, you can use the http request to update the Power BI dataFlows with Flow, this is the refresh Dataflow API document of PowerBi, I hope it can help you:

https://docs.microsoft.com/en-us/rest/api/power-bi/dataflows/refreshdataflow

 

If you need any help during create it, please contact with us.

Best Regards,
Community Support Team _ Lin Tu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Thank you for this link! I'll need to wrap my head around the API, haha.

 

On a related note, it would be great to trigger a dataset refresh when a dataflow (or set of dataflows) finish refreshing.

 

This would give me: SQL > Dataflows > PBIS as one chain of refreshes instead of scheduling dataflows an hour after SQL refreshes start and then dataset refresh to happen an hour after dataflows start.

do you have more details on how to do this http request?

@v-litu-msft do you have any step by step guide?

Hello @v-litu-msft 

 

I managed to build a flow with 3 dataflows which refresh, when running with data from the test I can do the refresh without issues, however after about 30 minutes the authentication stops working, is there an easy way to get a lasting auth key or set it as a new variable at the beginning of each flow?

 

Also, the option for a response seems to exist, however I don't seem to be able to pull this answer in flow

{
  "notifyOption": "MailOnCompletion"
}

 

If you have any ideas please let me know!

I was hoping I could trigger the refresh of the dataset upon the receipt of the notification email from the refresh of the dataflow. 
I have therefore included the option "MailOnCompletion", as in the screenshot below and as I could infer from the API documentation. 
The flow runs fine, the dataflow is refreshed, however, I receive no mail. Yet, I am the creator of the datalfow. 
If someone figures out how to make this option work, that would help trigger the secondary flow to refresh the dataset.

Image 440.png

Oh, and before someone gets puzzled by the screenshot in my previous post, this action is from a custom connector (see how-to), not the oob one. Yet the question remains the same.

Hi,

did you manage how to run this email notification on Completion?

Regards

No. Still waiting for Microsoft support to provide a solution. I will post their answer here when I get it.

 

Anonymous
Not applicable

Regarding the MailOnCompletion issue, have you had any response on that yet? I have the same issue in that I don't receive an email despite being the dataflow owner.

 

 

Hi togehter,

 

I finally got it to work this way:

 

 

Flow_Refresh.JPG

 

To get the group id just open your workspace (where the dataflow is located) in a browser. The group id is shown between:

 

https://app.powerbi.com/groups/XXXXXXXXXXX/list/dashboards

 

To get the dataflow id quickly I used this link:

 

https://docs.microsoft.com/de-de/rest/api/power-bi/dataflows/getdataflows

 

Flow_RestAPI.JPG

 

 

The last tricky final thing to do in the flow is under "Show advanced options": You have to select Authentification "Raw" and then copy and paste the authorizitation code from above (yellow) in it (in my case Bearer xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx)

 

Flow_AdavancedOptions.JPG

 

The really interesting thing was the mail when completed. I made this prozedure to refresh a dataset and got a mail. But with the dataflow it refreshes but doesn`t send a mail altough it is the correct json like in the Rest-API description.

 

Best wishes

 

Marc

 

Marc,

 

how did you find the Authorization code to be used in the Authentication section  ?

 

"The last tricky final thing to do in the flow is under "Show advanced options": You have to select Authentification "Raw" and then copy and paste the authorizitation code from above (yellow) in it (in my case Bearer xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx)"

You just have to follow the posted link in my description:

 

https://docs.microsoft.com/en-ie/rest/api/power-bi/dataflows/getdataflows

 

On the page just click on the green "Try it" field. A new field will pop out and after you are logged in you can see the authorization code under "Request preview":

 

Request preview

 

GET https://api.powerbi.com/v1.0/myorg/groups/%7BgroupId%7D/dataflows

Authorization: Bearer xxxxxxxxxxxxxxxxxxxxxxxxxxxxx

thank you. it is working now.

rjhale
Advocate IV
Advocate IV

I also discovered that you can call the Power BI API through the "HTTP with Azure AD" connector using the "Invoke an HTTP Request" action.  I had to configure the connector like so:

 

Base Resrouce URL: https://api.powerbi.com

Azure AD Resource URI (Application ID URI): https://analysis.windows.net/powerbi/api

 

The connector is a premium connector, so you'll need to have one of the paid for licenses.  This worked better for us because the regular HTTP action requires you to hardcode the bearer token, and in our situation it's difficult to use a custom connector because our tenant admins use DLP rules to heavily restrict what can run.  

 

Hope that helps someone as it took me a while to track down the Azure AD Resrouce URI. 

Awesome! Have looked for this so many hours 🙏 Thank you very much!

@rjhale @Marc_
I followed the same as mentioned it just worked for an hour post that I am facing this issue:- 

 

HarishShades_0-1607661266345.png

Please help, looks like the Bearer authentication is active only for that session or for an hour.. any idea how to set different authentication for access token.

Are you using the "HTTP with Azure AD" connector like I described in my last post?  If it's configured correctly, it should look like this:

HTTP Azure Connector.png

 

This connector should be able to retain your credentials like other connectors using the standard oAuth2 authentication method.  The connector can then use the credentials as long as they're still valid.  

Helpful resources

Announcements

Power Platform Connections Ep 15 | L. Baybutt | Thursday, 1 June 2023

Episode Fifteen of Power Platform Connections sees David Warner and Hugo Bernier talk to Microsoft MVP Lewis Baybutt aka Low Code Lewis, alongside the latest news and community blogs.   Use the hashtag #PowerPlatformConnects on social media for a chance to have your work featured on the show.        Action requested: Feel free to provide feedback on how we can make our community more inclusive and diverse.  This episode premiers live on our YouTube at 12pm PST on Thursday 1st June 2023.  Video series available at Power Platform Community YouTube channel.    Upcoming events:  European Power Platform conference – Jun. 20-22nd - Dublin Microsoft Power Platform Conference – Oct. 3-5th - Las Vegas  Join our Communities:  Power Apps Community Power Automate Community Power Virtual Agents Community Power Pages Community  If you’d like to hear from a specific community member in an upcoming recording and/or have specific questions for the Power Platform Connections team, please let us know. We will do our best to address all your requests or questions.  Action requested: Feel free to provide feedback on how we can make our community more inclusive and diverse.  This episode premiers live on our YouTube at 12pm PST on Thursday 1st June 2023.  Video series available at Power Platform Community YouTube channel.    Upcoming events:  European Power Platform conference – Jun. 20-22nd - Dublin Microsoft Power Platform Conference – Oct. 3-5th - Las Vegas  Join our Communities:  Power Apps Community Power Automate Community Power Virtual Agents Community Power Pages Community  If you’d like to hear from a specific community member in an upcoming recording and/or have specific questions for the Power Platform Connections team, please let us know. We will do our best to address all your requests or questions. 

May 2023 Community Newsletter and Upcoming Events

Welcome to our May 2023 Community Newsletter, where we'll be highlighting the latest news, releases, upcoming events, and the great work of our members inside the Biz Apps communities. If you're new to this LinkedIn group, be sure to subscribe here in the News & Announcements to stay up to date with the latest news from our ever-growing membership network who "changed the way they thought about code".         LATEST NEWS "Mondays at Microsoft" LIVE on LinkedIn - 8am PST - Monday 15th May  - Grab your Monday morning coffee and come join Principal Program Managers Heather Cook and Karuana Gatimu for the premiere episode of "Mondays at Microsoft"! This show will kick off the launch of the new Microsoft Community LinkedIn channel and cover a whole host of hot topics from across the #PowerPlatform, #ModernWork, #Dynamics365, #AI, and everything in-between. Just click the image below to register and come join the team LIVE on Monday 15th May 2023 at 8am PST. Hope to see you there!     Executive Keynote | Microsoft Customer Success Day CVP for Business Applications & Platform, Charles Lamanna, shares the latest #BusinessApplications product enhancements and updates to help customers achieve their business outcomes.         S01E13 Power Platform Connections - 12pm PST - Thursday 11th May Episode Thirteen of Power Platform Connections sees Hugo Bernier take a deep dive into the mind of co-host David Warner II, alongside the reviewing the great work of Dennis Goedegebuure, Keith Atherton, Michael Megel, Cat Schneider, and more. Click below to subscribe and get notified, with David and Hugo LIVE in the YouTube chat from 12pm PST. And use the hashtag #PowerPlatformConnects on social media for a chance to have your work featured on the show.         UPCOMING EVENTS   European Power Platform Conference - early bird ticket sale ends! The European Power Platform Conference early bird ticket sale ends on Friday 12th May 2023! #EPPC23 brings together the Microsoft Power Platform Communities for three days of unrivaled days in-person learning, connections and inspiration, featuring three inspirational keynotes, six expert full-day tutorials, and over eighty-five specialist sessions, with guest speakers including April Dunnam, Dona Sarkar, Ilya Fainberg, Janet Robb, Daniel Laskewitz, Rui Santos, Jens Christian Schrøder, Marco Rocca, and many more. Deep dive into the latest product advancements as you hear from some of the brightest minds in the #PowerApps space. Click here to book your ticket today and save!      DynamicMinds Conference - Slovenia - 22-24th May 2023 It's not long now until the DynamicsMinds Conference, which takes place in Slovenia on 22nd - 24th May, 2023 - where brilliant minds meet, mingle & share! This great Power Platform and Dynamics 365 Conference features a whole host of amazing speakers, including the likes of Georg Glantschnig, Dona Sarkar, Tommy Skaue, Monique Hayward, Aleksandar Totovic, Rachel Profitt, Aurélien CLERE, Ana Inés Urrutia de Souza, Luca Pellegrini, Bostjan Golob, Shannon Mullins, Elena Baeva, Ivan Ficko, Guro Faller, Vivian Voss, Andrew Bibby, Tricia Sinclair, Roger Gilchrist, Sara Lagerquist, Steve Mordue, and many more. Click here: DynamicsMinds Conference for more info on what is sure an amazing community conference covering all aspects of Power Platform and beyond.    Days of Knowledge Conference in Denmark - 1-2nd June 2023 Check out 'Days of Knowledge', a Directions 4 Partners conference on 1st-2nd June in Odense, Denmark, which focuses on educating employees, sharing knowledge and upgrading Business Central professionals. This fantastic two-day conference offers a combination of training sessions and workshops - all with Business Central and related products as the main topic. There's a great list of industry experts sharing their knowledge, including Iona V., Bert Verbeek, Liza Juhlin, Douglas Romão, Carolina Edvinsson, Kim Dalsgaard Christensen, Inga Sartauskaite, Peik Bech-Andersen, Shannon Mullins, James Crowter, Mona Borksted Nielsen, Renato Fajdiga, Vivian Voss, Sven Noomen, Paulien Buskens, Andri Már Helgason, Kayleen Hannigan, Freddy Kristiansen, Signe Agerbo, Luc van Vugt, and many more. If you want to meet industry experts, gain an advantage in the SMB-market, and acquire new knowledge about Microsoft Dynamics Business Central, click here Days of Knowledge Conference in Denmark to buy your ticket today!   COMMUNITY HIGHLIGHTS Check out our top Super and Community Users reaching new levels! These hardworking members are posting, answering questions, kudos, and providing top solutions in their communities.   Power Apps:  Super Users: @WarrenBelz, @LaurensM  @BCBuizer  Community Users:  @Amik@ @mmollet, @Cr1t    Power Automate:  Super Users: @Expiscornovus , @grantjenkins, @abm  Community Users: @Nived_Nambiar, @ManishSolanki    Power Virtual Agents:  Super Users: @Pstork1, @Expiscornovus  Community Users: @JoseA, @fernandosilva, @angerfire1213    Power Pages: Super Users: @ragavanrajan  Community Users: @Fubar, @Madhankumar_L,@gospa  LATEST COMMUNITY BLOG ARTICLES  Power Apps Community Blog  Power Automate Community Blog  Power Virtual Agents Community Blog  Power Pages Community Blog  Check out 'Using the Community' for more helpful tips and information:  Power Apps , Power Automate, Power Virtual Agents, Power Pages 

Announcing | Super Users - 2023 Season 1

Super Users – 2023 Season 1    We are excited to kick off the Power Users Super User Program for 2023 - Season 1.  The Power Platform Super Users have done an amazing job in keeping the Power Platform communities helpful, accurate and responsive. We would like to send these amazing folks a big THANK YOU for their efforts.      Super User Season 1 | Contributions July 1, 2022 – December 31, 2022  Super User Season 2 | Contributions January 1, 2023 – June 30, 2023    Curious what a Super User is? Super Users are especially active community members who are eager to help others with their community questions. There are 2 Super User seasons in a year, and we monitor the community for new potential Super Users at the end of each season. Super Users are recognized in the community with both a rank name and icon next to their username, and a seasonal badge on their profile.  Power Apps  Power Automate  Power Virtual Agents  Power Pages  Pstork1*  Pstork1*  Pstork1*  OliverRodrigues  BCBuizer  Expiscornovus*  Expiscornovus*  ragavanrajan  AhmedSalih  grantjenkins  renatoromao    Mira_Ghaly*  Mira_Ghaly*      Sundeep_Malik*  Sundeep_Malik*      SudeepGhatakNZ*  SudeepGhatakNZ*      StretchFredrik*  StretchFredrik*      365-Assist*  365-Assist*      cha_cha  ekarim2020      timl  Hardesh15      iAm_ManCat  annajhaveri      SebS  Rhiassuring      LaurensM  abm      TheRobRush  Ankesh_49      WiZey  lbendlin      Nogueira1306  Kaif_Siddique      victorcp  RobElliott      dpoggemann  srduval      SBax  CFernandes      Roverandom  schwibach      Akser  CraigStewart      PowerRanger  MichaelAnnis      subsguts  David_MA      EricRegnier  edgonzales      zmansuri  GeorgiosG      ChrisPiasecki  ryule      AmDev  fchopo      phipps0218  tom_riha      theapurva  takolota     Akash17  momlo     BCLS776  Shuvam-rpa     rampprakash  ScottShearer     Rusk  ChristianAbata     cchannon  Koen5     a33ik  Heartholme     AaronKnox  okeks      Matren  David_MA     Alex_10        Jeff_Thorpe        poweractivate        Ramole        DianaBirkelbach        DavidZoon        AJ_Z        PriyankaGeethik        BrianS        StalinPonnusamy        HamidBee        CNT        Anonymous_Hippo        Anchov        KeithAtherton        alaabitar        Tolu_Victor        KRider        sperry1625        IPC_ahaas      zuurg    rubin_boer   cwebb365   Dorrinda   G1124   Gabibalaban   Manan-Malhotra   jcfDaniel   WarrenBelz   Waegemma   drrickryp   GuidoPreite   metsshan    If an * is at the end of a user's name this means they are a Multi Super User, in more than one community. Please note this is not the final list, as we are pending a few acceptances.  Once they are received the list will be updated. 

Check out the new Power Platform Communities Front Door Experience!

We are excited to share the ‘Power Platform Communities Front Door’ experience with you!   Front Door brings together content from all the Power Platform communities into a single place for our community members, customers and low-code, no-code enthusiasts to learn, share and engage with peers, advocates, community program managers and our product team members. There are a host of features and new capabilities now available on Power Platform Communities Front Door to make content more discoverable for all power product community users which includes ForumsUser GroupsEventsCommunity highlightsCommunity by numbersLinks to all communities Users can see top discussions from across all the Power Platform communities and easily navigate to the latest or trending posts for further interaction. Additionally, they can filter to individual products as well.   Users can filter and browse the user group events from all power platform products with feature parity to existing community user group experience and added filtering capabilities.     Users can now explore user groups on the Power Platform Front Door landing page with capability to view all products in Power Platform.      Explore Power Platform Communities Front Door today. Visit Power Platform Community Front door to easily navigate to the different product communities, view a roll up of user groups, events and forums.

Microsoft Power Platform Conference | Registration Open | Oct. 3-5 2023

We are so excited to see you for the Microsoft Power Platform Conference in Las Vegas October 3-5 2023! But first, let's take a look back at some fun moments and the best community in tech from MPPC 2022 in Orlando, Florida.   Featuring guest speakers such as Charles Lamanna, Heather Cook, Julie Strauss, Nirav Shah, Ryan Cunningham, Sangya Singh, Stephen Siciliano, Hugo Bernier and many more.   Register today: https://www.powerplatformconf.com/   

Users online (5,074)