cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Iwarzon
Helper I
Helper I

Conversation boosting with Azure OpenAi connection only returns Blank answers and result in Fallback

We have been trouble shooting a CopilotStudio setup that originally worked flawless. The first solution used a separate setup that we re-created in a new location.

Both the old and the new solution builds on a GPT35turbo deployment an Cognitive search and a Storage account with a chat container deployed.

 

Custom data was first uploaded through the Azure Open Ai studio Playground -> Add data -> Upload data. It successfully uploaded the data to the SA and created a chunks container. An index and indexer was added to the Search instance and it all worked good in the Playground. We deployed to a Copilot, changed the url to the specific custom Environment and created the Azure OpenAi connection. Verified it in make.powerapps.com/connections.

After that we created the Copilot manually, setup the Generative Ai option, adjusted the Conversation boosting and Generative text by selecting the AOI connection option, added Connections properties with same Deployment as in Playground, API version: 2023-08-01-preview, 800 tokens, 0 temp, 1 Top P .  Added model data:

Iwarzon_0-1708634637392.png

But this time it only throws blank answers and automatically Fallsback with the dummy: I’m sorry, I’m not sure how to help with that. Can you try rephrasing?

We have verified that the new setup works outside CopilotStudio, but with app deployment and api calls. We have tried removing and renewing the AOI connections in Power platform but without success and now would appreciate any guidance...



1 ACCEPTED SOLUTION

Accepted Solutions
Iwarzon
Helper I
Helper I

This took way to long and is still kind of on-going. But we are now 99% positive that this is a time out issue. After a lot of support and meetings with Microsoft engineers across all platforms, the Azure specialists could provide us with some logging for what was hitting the Cognitive search. Logs showed us a lot of bad requests but could not support on why, since the call looks correct. Later down the lane the Power platform engineers reported back that they now could see Client time outs. By this time the client and we had already moved on to use Power automate flows calling the AOI and data instead of the OOTB MCS system topic solution, but in the flows we eventually also got time out issues. However PA uses a 120 second threshold and 8 retriest in HTTP action per default, so this was almost never an issue.

 

But after receiving this new time out log finding from the PP engineers, we switched back to GPT3.5-turbo and limited the token query and all of a sudden it started working again, hitting back accurate and nicely formated responses instead of a the default Fallback topic...

It turns out MCS uses a 30 second timeout and no retries in the call, which is currently way to limited and will then result in a "no match" fallback response...

Best of luck!

View solution in original post

1 REPLY 1
Iwarzon
Helper I
Helper I

This took way to long and is still kind of on-going. But we are now 99% positive that this is a time out issue. After a lot of support and meetings with Microsoft engineers across all platforms, the Azure specialists could provide us with some logging for what was hitting the Cognitive search. Logs showed us a lot of bad requests but could not support on why, since the call looks correct. Later down the lane the Power platform engineers reported back that they now could see Client time outs. By this time the client and we had already moved on to use Power automate flows calling the AOI and data instead of the OOTB MCS system topic solution, but in the flows we eventually also got time out issues. However PA uses a 120 second threshold and 8 retriest in HTTP action per default, so this was almost never an issue.

 

But after receiving this new time out log finding from the PP engineers, we switched back to GPT3.5-turbo and limited the token query and all of a sudden it started working again, hitting back accurate and nicely formated responses instead of a the default Fallback topic...

It turns out MCS uses a 30 second timeout and no retries in the call, which is currently way to limited and will then result in a "no match" fallback response...

Best of luck!

Helpful resources

Announcements

Celebrating the May Super User of the Month: Laurens Martens

  @LaurensM  is an exceptional contributor to the Power Platform Community. Super Users like Laurens inspire others through their example, encouragement, and active participation. We are excited to celebrated Laurens as our Super User of the Month for May 2024.   Consistent Engagement:  He consistently engages with the community by answering forum questions, sharing insights, and providing solutions. Laurens dedication helps other users find answers and overcome challenges.   Community Expertise: As a Super User, Laurens plays a crucial role in maintaining a knowledge sharing environment. Always ensuring a positive experience for everyone.   Leadership: He shares valuable insights on community growth, engagement, and future trends. Their contributions help shape the Power Platform Community.   Congratulations, Laurens Martens, for your outstanding work! Keep inspiring others and making a difference in the community!   Keep up the fantastic work!        

Check out the Copilot Studio Cookbook today!

We are excited to announce our new Copilot Cookbook Gallery in the Copilot Studio Community. We can't wait for you to share your expertise and your experience!    Join us for an amazing opportunity where you'll be one of the first to contribute to the Copilot Cookbook—your ultimate guide to mastering Microsoft Copilot. Whether you're seeking inspiration or grappling with a challenge while crafting apps, you probably already know that Copilot Cookbook is your reliable assistant, offering a wealth of tips and tricks at your fingertips--and we want you to add your expertise. What can you "cook" up?   Click this link to get started: https://aka.ms/CS_Copilot_Cookbook_Gallery   Don't miss out on this exclusive opportunity to be one of the first in the Community to share your app creation journey with Copilot. We'll be announcing a Cookbook Challenge very soon and want to make sure you one of the first "cooks" in the kitchen.   😊Don't miss your moment--start submitting in the Copilot Cookbook Gallery today!     Thank you,  Engagement Team

Announcing Power Apps Copilot Cookbook Gallery

We are excited to share that the all-new Copilot Cookbook Gallery for Power Apps is now available in the Power Apps Community, full of tips and tricks on how to best use Microsoft Copilot as you develop and create in Power Apps. The new Copilot Cookbook is your go-to resource when you need inspiration--or when you're stuck--and aren't sure how to best partner with Copilot while creating apps.   Whether you're looking for the best prompts or just want to know about responsible AI use, visit Copilot Cookbook for regular updates you can rely on--while also serving up some of your greatest tips and tricks for the Community. Check Out the new Copilot Cookbook for Power Apps today: Copilot Cookbook - Power Platform Community.  We can't wait to see what you "cook" up!      

Welcome to the Copilot Studio Community!

You are now a part of a vibrant growing group of peers and industry experts who are here to network, share knowledge, and even have a little fun!   If you have not yet registered, please visit here to learn how to register!   Now that you are a member, you can enjoy the following resources:   The Microsoft Copilot Studio Community Forums If you are looking for support with any part of Microsoft Copilot Studio, our forums are the place to go. They are titled "Forums" and there you will find technical professionals with years of experience who are ready and eager to answer your questions. You now have the ability to post, reply and give "kudos" on the Copilot Studio Community forums! Make sure you conduct a quick search before creating a new post because your question may have already been asked and answered!   Microsoft Copilot Studio Ideas Do you have an idea to improve the Microsoft Copilot Studio experience, or a feature request for future product updates? Then the "Copilot Studio Ideas" section is where you can contribute your suggestions and vote for ideas posted by other Community members. We constantly look to the most voted Ideas when planning updates, so your suggestions and votes will always make a difference.   News & Announcements The Copilot Studio Community News & Announcements is your stop to get all the latest news around Community events and announcements. This is where we share with the Community what is going on and how to participate!   Copilot Studio Samples, Learning and Video Galleries We have galleries that can assist you with information on creating a bot in our Webinars and Video Gallery,  and the ability to share the bots you have created in our Bot Sharing Gallery.  Check out the awesome content being shared there today!   Again, we are excited to welcome you to the Microsoft Copilot Studio Community family! Whether you are brand new to the world of bot creation or you are a seasoned Copilot Studio veteran, our goal is to shape the Community to be your ‘go to’ for support, networking, education, inspiration and encouragement as we enjoy this adventure together!   Let us know in the Community Feedback if you have any questions or comments about your Community experience. To learn more about the Community and your account be sure to visit our Community Support Area boards to learn more!   We look forward to seeing you in the Copilot Studio Community!The Copilot Studio Community Team

Tuesday Tip | How to Report Spam in Our Community

It's time for another TUESDAY TIPS, your weekly connection with the most insightful tips and tricks that empower both newcomers and veterans in the Power Platform Community! Every Tuesday, we bring you a curated selection of the finest advice, distilled from the resources and tools in the Community. Whether you’re a seasoned member or just getting started, Tuesday Tips are the perfect compass guiding you across the dynamic landscape of the Power Platform Community.   As our community family expands each week, we revisit our essential tools, tips, and tricks to ensure you’re well-versed in the community’s pulse. Keep an eye on the News & Announcements for your weekly Tuesday Tips—you never know what you may learn!   Today's Tip: How to Report Spam in Our Community We strive to maintain a professional and helpful community, and part of that effort involves keeping our platform free of spam. If you encounter a post that you believe is spam, please follow these steps to report it: Locate the Post: Find the post in question within the community.Kebab Menu: Click on the "Kebab" menu | 3 Dots, on the top right of the post.Report Inappropriate Content: Select "Report Inappropriate Content" from the menu.Submit Report: Fill out any necessary details on the form and submit your report.   Our community team will review the report and take appropriate action to ensure our community remains a valuable resource for everyone.   Thank you for helping us keep the community clean and useful!

The Copilot Studio community is thrilled to share some exciting news!

We are embarking on a journey to enhance your experience by transitioning to a new community platform. Our team has been diligently working to create a fresh community site, leveraging the very Dynamics 365 and Power Platform tools that our community advocates for.  We're proud to announce that the Copilot Studio community will pioneer this migration starting in June 2024. The move will mark the beginning of a new chapter, and we're eager for you to be a part of it. Following our lead, the rest of the Power Platform product sites will join us over the summer.   Stay tuned for more updates as we get closer to the launch. We can't wait to welcome you to our new community space, designed with you in mind, to connect, learn, and grow together.   Here's to new beginnings and endless possibilities!   If you have any questions, observations or concerns throughout this process please go to https://aka.ms/PPCommSupport. To stay up to date on the latest details of this migration and other important Community updates subscribe to our News and Announcements forums: Copilot Studio, Power Apps, Power Automate, Power Pages  

Users online (3,111)