cancel
Showing results for 
Search instead for 
Did you mean: 
Reply

Create Text With GPT - Manual approval action required now?

Hi,

 

We recently started running into an issue where the "Create text with GPT" action in Power Automate is requiring an approval action afterwards (each time the action is used) or it will give the error message below.  Previously, this was just a warning but now it appears to be mandatory and won't let you save the flow.  It also appears to be blocking previously built flows that used this action.  The error goes away if we add in the Start and wait for approval.  

 

Was wondering if anyone else has ran into this (or have any work-arounds) but for us requiring a manual approval each time the action is used would eliminate many of the use cases to automate certain tasks.

 

CGX_bwang_0-1695842526530.png

 

Thanks!

2 ACCEPTED SOLUTIONS

Accepted Solutions
BadToro
New Member

Hey, I also don't need to check the output generated by GPT for what I'm doing. Here's a trick I found:

  1. After the GPT step, throw in a 'Start and wait for an approval of text' action.
  2. Make sure to turn on the 'Static Result' option on the approval action.

It'll then run the approval without having to sit and wait for it. 

 

BadToro_1-1695854903678.png

 

 

BadToro_3-1695853245368.png

 

 

 

View solution in original post

gbego
Power Apps
Power Apps

Thank you all for your feedback on this topic. Update from the product team: We've reverted the human in the loop approval to a non-mandatory warning, after successfully testing out that the feature meets all of our latest Responsible AI guidelines. The fixes are rolling out today in the US, and tomorrow in EU.

We set a very high bar for Responsible AI at Microsoft, and the initial decision to force human in the loop approval was meant as a protective measure to force customers to always review AI-generated text before using it in a workflow. Now that the feature is Generally Available, we are making this step recommended but not mandatory, for you to choose. Thanks again for your feedback on this topic and looking forward to hearing about what you are building with GPT Prompts!

View solution in original post

37 REPLIES 37
takolota
Multi Super User
Multi Super User

@CGX_bwang 

 

This doesn’t make sense & makes MS look out of touch for not understanding that many use-cases may involve reviews & approvals outside the immediate flow.

 

In the meantime, I’d suggest trying to just add the content approval to the very bottom of the flow & set its run after setting to only trigger if the previous action times out. Maybe if the action is present it will remove the error even if it never gets triggered.

@takolota  Thanks for the suggestion, I had tried setting the "configure run after" for the approval action to only when the previous action (GPT action) was failed/timeout/skipped but the error still picked it up. 

 

The approval requirement appears to actually apply on each use of the Create text with GPT action, meaning that if you have multiple GPT actions, it's requiring the approval action after each one or it'll show the error and refuse to save (meaning you can't just have one approval at the end sadly). 

 

Just seems unfortunate that we just started experiencing it this week so wasn't sure if it was a change on our end or from MS.       

Ridiculous.

 

The other thing I would think to do is set a Dataverse action to auto-approve the approval, but that’s a lot more work that shouldn’t be necessary.

 

https://youtu.be/bqOftVN7J_Y?si=rOuyxDZL2egXe-Q0

takolota
Multi Super User
Multi Super User

BadToro
New Member

Hey, I also don't need to check the output generated by GPT for what I'm doing. Here's a trick I found:

  1. After the GPT step, throw in a 'Start and wait for an approval of text' action.
  2. Make sure to turn on the 'Static Result' option on the approval action.

It'll then run the approval without having to sit and wait for it. 

 

BadToro_1-1695854903678.png

 

 

BadToro_3-1695853245368.png

 

 

 

@BadToro  That worked!  Would've never thought of using that feature, thanks so much! 

 

Not sure if MS intended for us to have to use that work-around, seems like it would be easier to just make the approval requirement a toggle or option.    

I just noticed it today after trying to modify a prompt and it wouldn't let me save it again. Making it mandatory to have an approval action doesn't make sense at all, specially for data extraction.

 

If anything, we can review the data, after it's been extracted, no need to be approving every single action.

 

¯\_(ツ)_/¯

@BadToro Thanks!! 👍🏻  'Start and wait for an approval of text' action with a 'Static Result' option is like setting up a cardboard cutout of a bouncer at the club entrance. Looks intimidating but lets everyone waltz right in 🕺💃😅

Are you still able to set a static result today?  I cannot enable it, say it is not allowed for that action. 

BadToro
New Member

Before you can turn on the 'Static Result', you've got to run the flow at least once. Cheers.

ARB_wcc
Super User
Super User

@takolota  / @plarrue / @JoeF-MSFT We have a new solution where we are using the GPT connector to "parse" folder names, extract relevant information from the name and populate file attributes.

 

Example below:

 

Test.png

 

See below the prompt:

 

Prompt.jpg

Now, let's talk numbers: we're dealing with a whopping 38,000+ folders. Just picture having to manually approve each file to be renamed in this sea of folders. It would be like playing a never-ending game of "Whack-a-Mole," but with folders instead of moles! 😂 📁📁📁📁

Hi there,

We understand your frustrations and concerns regarding the recent changes requiring manual approval for the "Create Text with GPT" feature in Power Automate. It's clear that these changes may seem restrictive, particularly when the intended use cases involve lower variance, like classification.

We want to assure you that the intention behind this requirement is not to undermine the expertise of our developer community or impose a top-down approach. Rather, it's a response to the unique challenges posed by Generative AI. These models, while incredibly advanced, sometimes have a tendency to fabricate information or are susceptible to prompt injection.  

 

As part of our commitment to responsible AI, we already have measures in place to moderate content and prevent the generation of inappropriate responses. However, controlling the tendency of the model to fabricate responses isn't as straightforward. Even though we guide the model to stay as factual as possible, it can sometimes deviate and produce misleading outputs. Moreover, there's also a significant risk related to 'prompt injection' in the data. Even with well-crafted prompts and automation, compromised incoming data can lead to unexpected results.


The landscape of risks associated with automation using Generative AI is a relatively new and not yet fully understood territory. As we navigate this space, we're taking a cautious approach to ensure human oversight and control over AI-generated content.

That said, we're actively committed to developing robust safety systems, and, as we gain a deeper understanding, restoring as much control as possible back to developers. Our ultimate goal is to evolve this capability collectively with you, the developer community.

Your feedback regarding the stability of prompts and the potential for versioning control is incredibly valuable. We recently upgraded to the latest gpt-3.5-turbo-16k-0613 model. Our goal to bring the latest and greatest of the GPT models to our citizen developers. The latest model also quadruples the token window from 4k to 16k. Model update might be a reason for the variance in response that you were experiencing.

Please bear in mind that this feature is still in preview. As we gather more insights and navigate this emerging field, we're continually refining and tweaking our offerings to improve the user experience. 
Your patience, understanding, and input are greatly appreciated as we work towards creating an environment that is responsive to the knowledge and feedback of developer community. Thank you for being a part of this journey with us.


Ashish

Happymadness
Frequent Visitor

@Ashbhatia I just experienced the issue that OP is reporting. That is, a sudden change of the "action doesn't have a content approval action after it" message from Warning to Error, now preventing me from saving/testing/running my flow.

 

While it would be ridiculously annoying to manually approve EACH flow, especially since my use of 'Create text with GPT' is simply capturing verbatim text from .txt files and extracting to an organized .json object. However, it's something I am willing to do since my flow works like magic to automate my menial, hours-long, copy/pasting tasks.  

 

However, I'm unable to even implement ANY sort of approval in my environment since my Microsoft account is Enterprise level. Now, I'm plagued with this error: "This operation violates admin data policy 'MyCompany's Standard Policy', which restricts the use of business connector 'shared approvals' with non-business connector 'shared commondataserviceforapps'".

 

So, this mandatory requirement to manually approve is basically preventing me from using the 'Create text with GPT' action or any other AI builder content creation tool AT ALL! Like I said, this was a warning before today, and I had no issues before it went from Warning → Error.

 

I know I cannot use any business connectors with non-business (eg, AI builder tools). This is not an issue and never has been. My Enterprise admin's data policy is reasonable since my company works with sensitive data, and I would never open connections between GPT & company data on Power Automate. My flow fetches publicly available, published text and uses GPT to classify, structure, and reorganize the text word-for word so that it can be used easily in spreadsheets/tables. Nothing outrageous or morally questionable about it.

 

I understand Microsoft's rationale for mandating human approval & promoting responsible AI, but I hope Microsoft can revisit and optimize this policy since it can be seemingly more harmful than helpful. And I need this resolved- please advise on how to proceed! This is really harming my established, automated workflow. Thanks!

@Ashbhatia Please relegate this back to a warning. It is unrealistic to expect someone to approve many individual AI responses and have the flow run for long periods of time waiting for approvals. Especially in scenarios where we know that it doesn't cause a harmful effect if the information is incorrect or the AI is simply just extracting text from a document. We deserve the choice. This has impacted my current flows and I need this fixed ASAP as this is disrupting my company's workflow.

takolota
Multi Super User
Multi Super User

EDIT: Found a way to make the connection work. Still using the previously mentioned static result work-around though to negate this needless approval requirement across 8 different GPT actions in the workflow. This is just stupid, I've been fuming most of the morning after both this & the GPT action just not working for a larger 4 page PDF document with a bad request / timeout error.

Happymadness
Frequent Visitor

@Ashbhatia @plarrue @jk_one @Antrod @JoeF-MSFT @Chris @antoinec @Antoine2F 

 

Can we get a solution for this? The approval requirement is evidently doing more harm than good. Would appreciate hearing from AI Builder staff as soon as possible.

Please share if you have the time! I'm still stonewalled by the business vs. non-business connection issue. Feels hopeless...

@Happymadness 

For the solutions connection issue you have to select to manually test the flow once so it confirms your use of the connections. It just can't automatically run past flow runs before the new connections were added.

On the other issue I am having with the Create text with GPT timeout / bad request error, I've had to set something in a parallel branch to run if the 1st data extraction is taking too long. That will take only the 1st 5000 characters of the document text for the prompt & extract data from that 5000 characters. Then it returns that data to the app & terminates the flow so the other initial GPT action doesn't take 2 minutes before failing. 

NowFlow.png

ARB_wcc
Super User
Super User

This has become the most popular thread on the forum, +2k views 😂

Helpful resources

Announcements

Community will be READ ONLY July 16th, 5p PDT -July 22nd

Dear Community Members,   We'd like to let you know of an upcoming change to the community platform: starting July 16th, the platform will transition to a READ ONLY mode until July 22nd.   During this period, members will not be able to Kudo, Comment, or Reply to any posts.   On July 22nd, please be on the lookout for a message sent to the email address registered on your community profile. This email is crucial as it will contain your unique code and link to register for the new platform encompassing all of the communities.   What to Expect in the New Community: A more unified experience where all products, including Power Apps, Power Automate, Copilot Studio, and Power Pages, will be accessible from one community.Community Blogs that you can syndicate and link to for automatic updates. We appreciate your understanding and cooperation during this transition. Stay tuned for the exciting new features and a seamless community experience ahead!

Summer of Solutions | Week 4 Results | Results posted on July 24th

We are excited to announce the Summer of Solutions Challenge!    This challenge is kicking off on Monday, June 17th and will run for (4) weeks.  The challenge is open to all Power Platform (Power Apps, Power Automate, Copilot Studio & Power Pages) community members. We invite you to participate in a quest to provide solutions to as many questions as you can. Answers can be provided in all the communities.    Entry Period: This Challenge will consist of four weekly Entry Periods as follows (each an “Entry Period”)   - 12:00 a.m. PT on June 17, 2024 – 11:59 p.m. PT on June 23, 2024 - 12:00 a.m. PT on June 24, 2024 – 11:59 p.m. PT on June 30, 2024 - 12:00 a.m. PT on July 1, 2024 – 11:59 p.m. PT on July 7, 2024 - 12:00 a.m. PT on July 8, 2024 – 11:59 p.m. PT on July 14, 2024   Entries will be eligible for the Entry Period in which they are received and will not carryover to subsequent weekly entry periods.  You must enter into each weekly Entry Period separately.   How to Enter: We invite you to participate in a quest to provide "Accepted Solutions" to as many questions as you can. Answers can be provided in all the communities. Users must provide a solution which can be an “Accepted Solution” in the Forums in all of the communities and there are no limits to the number of “Accepted Solutions” that a member can provide for entries in this challenge, but each entry must be substantially unique and different.    Winner Selection and Prizes: At the end of each week, we will list the top ten (10) Community users which will consist of: 5 Community Members & 5 Super Users and they will advance to the final drawing. We will post each week in the News & Announcements the top 10 Solution providers.  At the end of the challenge, we will add all of the top 10 weekly names and enter them into a random drawing.  Then we will randomly select ten (10) winners (5 Community Members & 5 Super Users) from among all eligible entrants received across all weekly Entry Periods to receive the prize listed below. If a winner declines, we will draw again at random for the next winner.  A user will only be able to win once overall. If they are drawn multiple times, another user will be drawn at random.  Individuals will be contacted before the announcement with the opportunity to claim or deny the prize.  Once all of the winners have been notified, we will post in the News & Announcements of each community with the list of winners.   Each winner will receive one (1) Pass to the Power Platform Conference in Las Vegas, Sep. 18-20, 2024 ($1800 value). NOTE: Prize is for conference attendance only and any other costs such as airfare, lodging, transportation, and food are the sole responsibility of the winner. Tickets are not transferable to any other party or to next year’s event.   ** PLEASE SEE THE ATTACHED RULES for this CHALLENGE**   Week 1 Results: Congratulations to the Week 1 qualifiers, you are being entered in the random drawing that will take place at the end of the challenge.   Community MembersNumber SolutionsSuper UsersNumber Solutions Deenuji 9 @NathanAlvares24  17 @Anil_g  7 @ManishSolanki  13 @eetuRobo  5 @David_MA  10 @VishnuReddy1997  5 @SpongYe  9JhonatanOB19932 (tie) @Nived_Nambiar  8 @maltie  2 (tie)   @PA-Noob  2 (tie)   @LukeMcG  2 (tie)   @tgut03  2 (tie)       Week 2 Results: Congratulations to the Week 2 qualifiers, you are being entered in the random drawing that will take place at the end of the challenge. Week 2: Community MembersSolutionsSuper UsersSolutionsPower Automate  @Deenuji  12@ManishSolanki 19 @Anil_g  10 @NathanAlvares24  17 @VishnuReddy1997  6 @Expiscornovus  10 @Tjan  5 @Nived_Nambiar  10 @eetuRobo  3 @SudeepGhatakNZ 8     Week 3 Results: Congratulations to the Week 3 qualifiers, you are being entered in the random drawing that will take place at the end of the challenge. Week 3:Community MembersSolutionsSuper UsersSolutionsPower Automate Deenuji32ManishSolanki55VishnuReddy199724NathanAlvares2444Anil_g22SudeepGhatakNZ40eetuRobo18Nived_Nambiar28Tjan8David_MA22   Week 4 Results: Congratulations to the Week 4 qualifiers, you are being entered in the random drawing that will take place at the end of the challenge. Week 4:Community MembersSolutionsSuper UsersSolutionsPower Automate Deenuji11FLMike31Sayan11ManishSolanki16VishnuReddy199710creativeopinion14Akshansh-Sharma3SudeepGhatakNZ7claudiovc2CFernandes5 misc2Nived_Nambiar5 Usernametwice232rzaneti5 eetuRobo2   Anil_g2   SharonS2  

Check Out | 2024 Release Wave 2 Plans for Microsoft Dynamics 365 and Microsoft Power Platform

On July 16, 2024, we published the 2024 release wave 2 plans for Microsoft Dynamics 365 and Microsoft Power Platform. These plans are a compilation of the new capabilities planned to be released between October 2024 to March 2025. This release introduces a wealth of new features designed to enhance customer understanding and improve overall user experience, showcasing our dedication to driving digital transformation for our customers and partners.    The upcoming wave is centered around utilizing advanced AI and Microsoft Copilot technologies to enhance user productivity and streamline operations across diverse business applications. These enhancements include intelligent automation, AI-powered insights, and immersive user experiences that are designed to break down barriers between data, insights, and individuals. Watch a summary of the release highlights.    Discover the latest features that empower organizations to operate more efficiently and adaptively. From AI-driven sales insights and customer service enhancements to predictive analytics in supply chain management and autonomous financial processes, the new capabilities enable businesses to proactively address challenges and capitalize on opportunities.    

Updates to Transitions in the Power Platform Communities

We're embarking on a journey to enhance your experience by transitioning to a new community platform. Our team has been diligently working to create a fresh community site, leveraging the very Dynamics 365 and Power Platform tools our community advocates for.  We started this journey with transitioning Copilot Studio forums and blogs in June. The move marks the beginning of a new chapter, and we're eager for you to be a part of it. The rest of the Power Platform product sites will be moving over this summer.   Stay tuned for more updates as we get closer to the launch. We can't wait to welcome you to our new community space, designed with you in mind. Let's connect, learn, and grow together.   Here's to new beginnings and endless possibilities!   If you have any questions, observations or concerns throughout this process please go to https://aka.ms/PPCommSupport.   To stay up to date on the latest details of this migration and other important Community updates subscribe to our News and Announcements forums: Copilot Studio, Power Apps, Power Automate, Power Pages

Top Solution Authors
Users online (2,543)