cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
bkrlee1
New Member

Added Column to SQL table but not showing in flow.

Hi All,

 

Apologies as this is probably something very easy but I can't for the life of me find it.

 

I've created a flow which connects to an azure sql database successfully, It creates records and updates them. I've added another column to the SQL table but the column is not showing in flow. It's just a varchar(50) column. Is there a button to update the schema of the table so it shows as a parameter in the sql update action on flow please? Don't fancy recreating the whole sql part of flow everything I add a new column lol.

 

Many thanks.

41 REPLIES 41

Yes, waiting a day should also refresh the existing connection. The issue is caused by the caching of the connection when it is created.  If you don't delete it and create a new one there is no way to manually update the cached definition.  I suspect the cache clears overnight and that's why it works the next day.  If you can afford to wait that is an easier fix.



-------------------------------------------------------------------------
If I have answered your question, please mark your post as Solved.
If you like my response, please give it a Thumbs Up.
PalaniKalyani
New Member

Responding to my previous comment.

"Today, Again I had to make some changes to the table (increase the size of the fields from 25 varchars to 50 varchars). The flow didn't reflect the changes immediately, I will wait till tomorrow to see whether it is getting reflected and will keep you posted. "

It worked now. 

 

-Other way to overcome the original issue is that, I created a copy of my table and used that in the flow, it works as expected. (Just to avoid creating the new connection every time). Still this is not a good solution as we progress further because the table might have been used anywhere else in the application and it will be huge impact across the application. 

Yes but that's nonsense when you are in dev mode and testing various scenarios out. Just like @Peter_Groen mentioned above.  It is a fix Microsoft should have implemented a long time ago. I would go even 1 step further and say:  It is an utter disgrace it is taking so long to get a fix.  And quite frankly, for developers moving over to Power Automate Cloud, there isn't anything to be gained. In fact, not only do you get less control over the internal details of your app, your productivity drops sharply as well.  I'd rather stick to SQL, Python, Powershell, or C# and get things done in a third of the time it takes me to get over the inane bugs of the SQL actions when using a connection to an on-prem DB.  3 years and counting and still no fix... ridiculous.

Fantastic.  We have to wait 24 hours when in the middle of a debug cycle.  What a boost to productivity!  

iso
Advocate IV
Advocate IV

I created 2 connections with exactly the same  config but 2 different names.  When the main connection used in the flow starts misbehaving, I switch over to the other connection that has not been used in the flow, and all the uncalled for error messages disappear, ie the flow starts running as intended and the dev/debug cycle can go on.  Of course, if you need to change a table schema again, or change one of the ODATA params of the action itself, you are in trouble again. Hopefully enough time would have gone by so that the previous connection has reset and switching back to it allows work to go on.  If not, you need a third copy of the connection, and so on ad infinitum.  Bloody hell, it feels like we are back in the prehistoric days of computing when MS-DOS ruled the desktop and COBOL was all the rage!  😉

Pstork1
Multi Super User
Multi Super User

You only have to wait 24 hours if you change the schema of the underlying data source (SQL) and don't want to delete the connection.  If you delete and recreate the connection you can do it right now.  But the best approach is to make sure the schema of the database is set before you start trying to create a workflow around it.



-------------------------------------------------------------------------
If I have answered your question, please mark your post as Solved.
If you like my response, please give it a Thumbs Up.

Yes, I get it but it is not acceptable that it be so rigid.  Even if the schema is set beforehand and never changes throughout the whole dev cycle, every single time if you do a DROP TABLE to reset the DB (I know, instead of a TRUNCATE) then you get in trouble again. 

 

And so you are forced to create a test connection so that all the dozen other flows that use more than a dozen SQL actions over the same connection will not be adversely affected. Imagine if one forgets this, he or she will have to manually go into each flow and change a dozen times the settings because there is no UNDO button either!  Also, because when you are developing something, time is usually of the essence and thus waiting 24 hours is absolutely bonkers. 

 

And so one is forced to delete/recreate the connection every single time a small mistake is made re the steps above.  Anyways, you know it, I know it... but does Microsoft know it?! This is what irks not just me apparently, but many other users... it seems as if MS doesn't give a fig about improving this.  In any case, I'll be going back to the traditional dev env as it affords both faster dev/debug cycles and greater productivity.  RPA in the cloud is a nice concept, but AFAIC a toy concept not yet ready for prime time (not mentioning all the other issues re UI/UX, var scoping, etc...).  Oh and another thing, customers shouldn't feel forced to start moving their on-prem data sources into the cloud in order to get a more seamless experience. I understand that that's the preferential (lucrative) option for MS, still it rubs the wrong way.

Addendum:  since I started writing the above, the goddamn connection did refresh... we are talking about what... 10 -20 mins+ since I left the flow before starting the post.... so that's strange, sometimes it takes 24 hours, and sometimes it takes less than 30 mins.  

Addendum 2:   Unblievable!  I add a new SQL UPDATE action to the flow, thinking that since the connection had refreshed for the previous UPDATE action, I could continue working by adding the next.  But no such luck!  The new action is referring to the old image of the connection, ie the table list is missing tables, whereas the old action, as I mentioned in the previous addendum, suddenly was able to access all the tables.

 

Talk about not making any sense.  

 

Hey Microsoft!  Would it hurt you to add a REFRESH CONNECTION button in the action menu?

iso
Advocate IV
Advocate IV

Addendum 3:  so basically if you copy to My Clipboard the SQL action that is connected to the refreshed image of the connection, then you can add that copy of the action and get immediate access to all your tables.  

PeterSejr
Frequent Visitor

Oh my god! - Thank you for that tip!

This issue has been killing me for ages. How is that even necessary to do!?

Exactly... it's utterly and totally outrageous.  Now, I am having the same problem with a Form Trigger.  I had to recreate the Form, deleting the old one. As a result, the Form connection keeps referencing the deleted Form, no way to get it to understand there is a new Form it should connect to. 

Since this wasn't a rush job, I let it sit for 24h expecting the connection to be reset... but it didn't.  What an awful user experience this is.  I feel sorry for all those people who got lured into this no-code gimmick and who don't have any basic computer science foundation to understand what is really going on.  For simple stuff, like email processing for ex, it works fine.  Anything else more complex where you have to drop down to using Azure functions and so on, forget it--you'll need a dev to do it properly.  

 

Anyway, I could rant on until I am blue in the face when it comes to Power Automate and all its drawbacks.

PeterSejr
Frequent Visitor

The amount of times I've felt the urge to throw my computer out the windows...!

 

For basically all SQL actions, I've started using the "Execute a SQL Query" action instead of any of the other. That way I'm not reliant on the refresh and just string together whatever I want to do as a SQL command. No more wait times.

Because my org has an on-premise SQL Server solution, that particular SQL action I cannot use, unfortunately. I have since been able to carefully navigate these actions. They are useful for rapidly deploying workflows that our company has wanted for a long time, but once we get our custom front-to-back ERP developed and deployed, bye-bye Power Platform (for the most part).

esapp
New Member

This problem hasn't been fixed in over 2 years and is very frustrating. Working with a SQL connection is a pain and forced us to look into and implement different solutions with other providers.

DragonLord
Helper IV
Helper IV

this really needs to be addressed , and QUICKLY !!!!!

 

24 hours?? you are having a laugh here? 

The connections are cached and you have to wait for the cache to timeout.  Its not really 24 hours, but in my experience it is usually overnight.



-------------------------------------------------------------------------
If I have answered your question, please mark your post as Solved.
If you like my response, please give it a Thumbs Up.

@DragonLord LOL  I wish I were!  Oh but leave it to Microsoft not to be undone. Check this out:  it's been 6 years now that the Undo function in the Power App studio is broken with no fix on the horizon.  The community is rampaging, pitchfork in hand and foaming at the mouth.  It seems Saruman has taken over Microsoft and he can't be bothered.

@Pstork1 Yes, 24 hrs!  And if not, it took so long that it might as well have been 24 hrs.  No matter, even 1 hour is too long.  I will repeat it again:  Give me a good code editor and I will run circles around the low-code bros any day of the week.  

lets not forget also, you cant put a checkbox on the right hand side of the text yet ... 

Helpful resources

Announcements

Power Platform Connections Ep 15 | L. Baybutt | Thursday, 1 June 2023

Episode Fifteen of Power Platform Connections sees David Warner and Hugo Bernier talk to Microsoft MVP Lewis Baybutt aka Low Code Lewis, alongside the latest news and community blogs.   Use the hashtag #PowerPlatformConnects on social media for a chance to have your work featured on the show.        Action requested: Feel free to provide feedback on how we can make our community more inclusive and diverse.  This episode premiers live on our YouTube at 12pm PST on Thursday 1st June 2023.  Video series available at Power Platform Community YouTube channel.    Upcoming events:  European Power Platform conference – Jun. 20-22nd - Dublin Microsoft Power Platform Conference – Oct. 3-5th - Las Vegas  Join our Communities:  Power Apps Community Power Automate Community Power Virtual Agents Community Power Pages Community  If you’d like to hear from a specific community member in an upcoming recording and/or have specific questions for the Power Platform Connections team, please let us know. We will do our best to address all your requests or questions.  Action requested: Feel free to provide feedback on how we can make our community more inclusive and diverse.  This episode premiers live on our YouTube at 12pm PST on Thursday 1st June 2023.  Video series available at Power Platform Community YouTube channel.    Upcoming events:  European Power Platform conference – Jun. 20-22nd - Dublin Microsoft Power Platform Conference – Oct. 3-5th - Las Vegas  Join our Communities:  Power Apps Community Power Automate Community Power Virtual Agents Community Power Pages Community  If you’d like to hear from a specific community member in an upcoming recording and/or have specific questions for the Power Platform Connections team, please let us know. We will do our best to address all your requests or questions. 

May 2023 Community Newsletter and Upcoming Events

Welcome to our May 2023 Community Newsletter, where we'll be highlighting the latest news, releases, upcoming events, and the great work of our members inside the Biz Apps communities. If you're new to this LinkedIn group, be sure to subscribe here in the News & Announcements to stay up to date with the latest news from our ever-growing membership network who "changed the way they thought about code".         LATEST NEWS "Mondays at Microsoft" LIVE on LinkedIn - 8am PST - Monday 15th May  - Grab your Monday morning coffee and come join Principal Program Managers Heather Cook and Karuana Gatimu for the premiere episode of "Mondays at Microsoft"! This show will kick off the launch of the new Microsoft Community LinkedIn channel and cover a whole host of hot topics from across the #PowerPlatform, #ModernWork, #Dynamics365, #AI, and everything in-between. Just click the image below to register and come join the team LIVE on Monday 15th May 2023 at 8am PST. Hope to see you there!     Executive Keynote | Microsoft Customer Success Day CVP for Business Applications & Platform, Charles Lamanna, shares the latest #BusinessApplications product enhancements and updates to help customers achieve their business outcomes.         S01E13 Power Platform Connections - 12pm PST - Thursday 11th May Episode Thirteen of Power Platform Connections sees Hugo Bernier take a deep dive into the mind of co-host David Warner II, alongside the reviewing the great work of Dennis Goedegebuure, Keith Atherton, Michael Megel, Cat Schneider, and more. Click below to subscribe and get notified, with David and Hugo LIVE in the YouTube chat from 12pm PST. And use the hashtag #PowerPlatformConnects on social media for a chance to have your work featured on the show.         UPCOMING EVENTS   European Power Platform Conference - early bird ticket sale ends! The European Power Platform Conference early bird ticket sale ends on Friday 12th May 2023! #EPPC23 brings together the Microsoft Power Platform Communities for three days of unrivaled days in-person learning, connections and inspiration, featuring three inspirational keynotes, six expert full-day tutorials, and over eighty-five specialist sessions, with guest speakers including April Dunnam, Dona Sarkar, Ilya Fainberg, Janet Robb, Daniel Laskewitz, Rui Santos, Jens Christian Schrøder, Marco Rocca, and many more. Deep dive into the latest product advancements as you hear from some of the brightest minds in the #PowerApps space. Click here to book your ticket today and save!      DynamicMinds Conference - Slovenia - 22-24th May 2023 It's not long now until the DynamicsMinds Conference, which takes place in Slovenia on 22nd - 24th May, 2023 - where brilliant minds meet, mingle & share! This great Power Platform and Dynamics 365 Conference features a whole host of amazing speakers, including the likes of Georg Glantschnig, Dona Sarkar, Tommy Skaue, Monique Hayward, Aleksandar Totovic, Rachel Profitt, Aurélien CLERE, Ana Inés Urrutia de Souza, Luca Pellegrini, Bostjan Golob, Shannon Mullins, Elena Baeva, Ivan Ficko, Guro Faller, Vivian Voss, Andrew Bibby, Tricia Sinclair, Roger Gilchrist, Sara Lagerquist, Steve Mordue, and many more. Click here: DynamicsMinds Conference for more info on what is sure an amazing community conference covering all aspects of Power Platform and beyond.    Days of Knowledge Conference in Denmark - 1-2nd June 2023 Check out 'Days of Knowledge', a Directions 4 Partners conference on 1st-2nd June in Odense, Denmark, which focuses on educating employees, sharing knowledge and upgrading Business Central professionals. This fantastic two-day conference offers a combination of training sessions and workshops - all with Business Central and related products as the main topic. There's a great list of industry experts sharing their knowledge, including Iona V., Bert Verbeek, Liza Juhlin, Douglas Romão, Carolina Edvinsson, Kim Dalsgaard Christensen, Inga Sartauskaite, Peik Bech-Andersen, Shannon Mullins, James Crowter, Mona Borksted Nielsen, Renato Fajdiga, Vivian Voss, Sven Noomen, Paulien Buskens, Andri Már Helgason, Kayleen Hannigan, Freddy Kristiansen, Signe Agerbo, Luc van Vugt, and many more. If you want to meet industry experts, gain an advantage in the SMB-market, and acquire new knowledge about Microsoft Dynamics Business Central, click here Days of Knowledge Conference in Denmark to buy your ticket today!   COMMUNITY HIGHLIGHTS Check out our top Super and Community Users reaching new levels! These hardworking members are posting, answering questions, kudos, and providing top solutions in their communities.   Power Apps:  Super Users: @WarrenBelz, @LaurensM  @BCBuizer  Community Users:  @Amik@ @mmollet, @Cr1t    Power Automate:  Super Users: @Expiscornovus , @grantjenkins, @abm  Community Users: @Nived_Nambiar, @ManishSolanki    Power Virtual Agents:  Super Users: @Pstork1, @Expiscornovus  Community Users: @JoseA, @fernandosilva, @angerfire1213    Power Pages: Super Users: @ragavanrajan  Community Users: @Fubar, @Madhankumar_L,@gospa  LATEST COMMUNITY BLOG ARTICLES  Power Apps Community Blog  Power Automate Community Blog  Power Virtual Agents Community Blog  Power Pages Community Blog  Check out 'Using the Community' for more helpful tips and information:  Power Apps , Power Automate, Power Virtual Agents, Power Pages 

Announcing | Super Users - 2023 Season 1

Super Users – 2023 Season 1    We are excited to kick off the Power Users Super User Program for 2023 - Season 1.  The Power Platform Super Users have done an amazing job in keeping the Power Platform communities helpful, accurate and responsive. We would like to send these amazing folks a big THANK YOU for their efforts.      Super User Season 1 | Contributions July 1, 2022 – December 31, 2022  Super User Season 2 | Contributions January 1, 2023 – June 30, 2023    Curious what a Super User is? Super Users are especially active community members who are eager to help others with their community questions. There are 2 Super User seasons in a year, and we monitor the community for new potential Super Users at the end of each season. Super Users are recognized in the community with both a rank name and icon next to their username, and a seasonal badge on their profile.  Power Apps  Power Automate  Power Virtual Agents  Power Pages  Pstork1*  Pstork1*  Pstork1*  OliverRodrigues  BCBuizer  Expiscornovus*  Expiscornovus*  ragavanrajan  AhmedSalih  grantjenkins  renatoromao    Mira_Ghaly*  Mira_Ghaly*      Sundeep_Malik*  Sundeep_Malik*      SudeepGhatakNZ*  SudeepGhatakNZ*      StretchFredrik*  StretchFredrik*      365-Assist*  365-Assist*      cha_cha  ekarim2020      timl  Hardesh15      iAm_ManCat  annajhaveri      SebS  Rhiassuring      LaurensM  abm      TheRobRush  Ankesh_49      WiZey  lbendlin      Nogueira1306  Kaif_Siddique      victorcp  RobElliott      dpoggemann  srduval      SBax  CFernandes      Roverandom  schwibach      Akser  CraigStewart      PowerRanger  MichaelAnnis      subsguts  David_MA      EricRegnier  edgonzales      zmansuri  GeorgiosG      ChrisPiasecki  ryule      AmDev  fchopo      phipps0218  tom_riha      theapurva  takolota     Akash17  momlo     BCLS776  Shuvam-rpa     rampprakash  ScottShearer     Rusk  ChristianAbata     cchannon  Koen5     a33ik  Heartholme     AaronKnox  okeks      Matren  David_MA     Alex_10        Jeff_Thorpe        poweractivate        Ramole        DianaBirkelbach        DavidZoon        AJ_Z        PriyankaGeethik        BrianS        StalinPonnusamy        HamidBee        CNT        Anonymous_Hippo        Anchov        KeithAtherton        alaabitar        Tolu_Victor        KRider        sperry1625        IPC_ahaas      zuurg    rubin_boer   cwebb365   Dorrinda   G1124   Gabibalaban   Manan-Malhotra   jcfDaniel   WarrenBelz   Waegemma   drrickryp   GuidoPreite   metsshan    If an * is at the end of a user's name this means they are a Multi Super User, in more than one community. Please note this is not the final list, as we are pending a few acceptances.  Once they are received the list will be updated. 

Check out the new Power Platform Communities Front Door Experience!

We are excited to share the ‘Power Platform Communities Front Door’ experience with you!   Front Door brings together content from all the Power Platform communities into a single place for our community members, customers and low-code, no-code enthusiasts to learn, share and engage with peers, advocates, community program managers and our product team members. There are a host of features and new capabilities now available on Power Platform Communities Front Door to make content more discoverable for all power product community users which includes ForumsUser GroupsEventsCommunity highlightsCommunity by numbersLinks to all communities Users can see top discussions from across all the Power Platform communities and easily navigate to the latest or trending posts for further interaction. Additionally, they can filter to individual products as well.   Users can filter and browse the user group events from all power platform products with feature parity to existing community user group experience and added filtering capabilities.     Users can now explore user groups on the Power Platform Front Door landing page with capability to view all products in Power Platform.      Explore Power Platform Communities Front Door today. Visit Power Platform Community Front door to easily navigate to the different product communities, view a roll up of user groups, events and forums.

Microsoft Power Platform Conference | Registration Open | Oct. 3-5 2023

We are so excited to see you for the Microsoft Power Platform Conference in Las Vegas October 3-5 2023! But first, let's take a look back at some fun moments and the best community in tech from MPPC 2022 in Orlando, Florida.   Featuring guest speakers such as Charles Lamanna, Heather Cook, Julie Strauss, Nirav Shah, Ryan Cunningham, Sangya Singh, Stephen Siciliano, Hugo Bernier and many more.   Register today: https://www.powerplatformconf.com/   

Users online (5,137)