Hello
I'm stuck with this failure, any ideas are welcome.
Yesterday this action worked perfectly, today, it does not work at all. Tested on the same text that it worked on yesterday, on two different installations that are exact. Nothing has changed, I copied the flow and tested; to exclude any of the hidden issues that sometimes can break a flow.
Error says it cannot find the text. =(
I have further tried to improve the action by setting X1 Y1 and X2 Y2 cords to help but to no avail.
Ideas welcome
Regards
Daniel Olsson
Solved! Go to Solution.
The solution :
I had a call with Microsoft support engineer Sunil Barate and he explained a few useful things. Below is an example of a flow and how you can set it up if it does not seem to work.
1. Add config on the start ORC engine action to 2 2. This enables zooming in to help read the text.
2. The Get Window action seems to help the ORC to work better, even if we can see the window without the Get action in my flow it didn't work. It's a pretty good idea to focus the windows that the OCR should read, so I will always set that in the future.
3. A wait after starting ORC engine and focusing window, to help it all be in the correct state before moving the mouse by OCR start is as well recommended, the 5 sec is excessive but as it works you could test 4 3 2 etc.
4. To know the ORC can read the text, you can add an extract text with ORC and check that the text you look for is in the output variable.
Good luck!
ocr recogniziont working erratically, pretty much an hit or miss feature.
I've experienced same thing and gave up using it, I can't understand why same word in the same page doesn't get recognized anymore
Have you found an alternative? I will log a support ticket. if the static text can be read and later not, the product has a flaw. OCR is very important.
I've worked with OCR in the past and noticed that, sometimes, changing the multiplier helps you achieve a better result:
With this in mind, I created a "retry" structure: if multiplier 1 doesn't bring any result, I'd then retry OCR with multiplier 2. Then, if failed again, I'd try multiplier 3. Also, when you reduce the screen area to search for a text, the failure rate is lower than trying to read the entire screen (and a lot faster as well). The disadvantage is that if you have a text appearing in different parts of the screen each time you run a flow then you'll need a very complex solution. At that time, I had to create another "retry structure level" with different sections of the screen: for example, if the search failed for the entire screen for all three multipliers, then I divided the screen by two (first vertically and then horizontally) and tried to look for the same text again in the first half and then the second half for all three multipliers again, if it has failed again then I'd further divide the screen in three or four parts (depends on the resolution) and look for the text again. This made the solution a lot more reliable (say it, from a failure rate of 1 in 10 to 1 in 40), sacrificing speed and increasing complexity though.
Also notice that if you are working with Citrix, the images presented on the screen might look the same but they can be sufficiently different for the OCR engine to not recognize it. This is because of an "adaptive compression" mechanism Citrix uses that sends a different resolution depending on the currently available GPU power, network bandwith and other parameters. Long story short: when using Citrix, expect it will fail from time to time because there will always be a "new image" it never sent before.
Thank you very much. I will set up and test this and let you know if it makes a difference. ( I bet it will ) in addition, I will share the outcome of the support ticket.
The solution :
I had a call with Microsoft support engineer Sunil Barate and he explained a few useful things. Below is an example of a flow and how you can set it up if it does not seem to work.
1. Add config on the start ORC engine action to 2 2. This enables zooming in to help read the text.
2. The Get Window action seems to help the ORC to work better, even if we can see the window without the Get action in my flow it didn't work. It's a pretty good idea to focus the windows that the OCR should read, so I will always set that in the future.
3. A wait after starting ORC engine and focusing window, to help it all be in the correct state before moving the mouse by OCR start is as well recommended, the 5 sec is excessive but as it works you could test 4 3 2 etc.
4. To know the ORC can read the text, you can add an extract text with ORC and check that the text you look for is in the output variable.
Good luck!
Thanks for sharing!
I have had this same issue many times. I use the recognize text step to look for a specific word on the page and then click it. I have done all the steps recommended below and the step still randomly fails--magnification is at 2/2, I have the flow focusing on the desired window, I have a wait before the OCR step, but it still randomly breaks.
The only thing that temporarily fixes the issue is to paste a copy of the failing OCR step and delete the original step. I have no idea why this works, but so far it has worked every time. I can only assume it is some type of caching issue related to engineers trying to speed up inefficient code.
This will give me another random number of days of the OCR working, after which I will have to repeat to get it working again. I have sat through the entire flow multiple times and watched the text I am seeking show up clearly on the screen but not get recognized.
I have had the exact same issue with clicking on UI Elements--they worked for a while but then stopped and the only way to repair them was to select the UI element again in the failing step--even though the UI element had not changed.
I really hope Microsoft is able to fix this product-breaking issue, because without consistently working dynamic UI element/text recognition Power Automate is almost useless.
Hello,
Nice others notice....
I am a Senior System Engineer IT and have been working for over 25 years with MS products, We are MS partner and reseller.
The OCR function of flow/Power Automate is absolute unuseable. If the OCR should work better in a zoom 2x2 why don't they intergrate in their code direct?
This all looks nice at the beginning but is just the worst terrible MS solution/Code we have ever seen in 20 years.
We do NOT recommend to automate anything business related in Enterprise with this solution.
You just move cost from regular backoffice to IT 2nd level if this keeps on working like this.
Worst is that it's run fully from their cloud. My PA on W11 PRO before W10 22H2 fully patches crashed again and there is no solution to recover the changes we made. Thought it may get better with W11.
Episode Seven of Power Platform Connections sees David Warner and Hugo Bernier talk to Dian Taylor, alongside the latest news, product reviews, and community blogs. Use the hashtag #PowerPlatformConnects on social media for a chance to have your work featured on the show.
Super Users – 2023 Season 1 We are excited to kick off the Power Users Super User Program for 2023 - Season 1. The Power Platform Super Users have done an amazing job in keeping the Power Platform communities helpful, accurate and responsive. We would like to send these amazing folks a big THANK YOU for their efforts. Super User Season 1 | Contributions July 1, 2022 – December 31, 2022 Super User Season 2 | Contributions January 1, 2023 – June 30, 2023 Curious what a Super User is? Super Users are especially active community members who are eager to help others with their community questions. There are 2 Super User seasons in a year, and we monitor the community for new potential Super Users at the end of each season. Super Users are recognized in the community with both a rank name and icon next to their username, and a seasonal badge on their profile. Power Apps Power Automate Power Virtual Agents Power Pages Pstork1* Pstork1* Pstork1* OliverRodrigues BCBuizer Expiscornovus* Expiscornovus* ragavanrajan AhmedSalih grantjenkins renatoromao Mira_Ghaly* Mira_Ghaly* Sundeep_Malik* Sundeep_Malik* SudeepGhatakNZ* SudeepGhatakNZ* StretchFredrik* StretchFredrik* 365-Assist* 365-Assist* cha_cha ekarim2020 timl Hardesh15 iAm_ManCat annajhaveri SebS Rhiassuring LaurensM abm TheRobRush Ankesh_49 WiZey lbendlin Nogueira1306 Kaif_Siddique victorcp RobElliott dpoggemann srduval SBax CFernandes Roverandom schwibach Akser CraigStewart PowerRanger MichaelAnnis subsguts David_MA EricRegnier edgonzales zmansuri GeorgiosG ChrisPiasecki ryule AmDev fchopo phipps0218 tom_riha theapurva takolota Akash17 momlo BCLS776 Shuvam-rpa rampprakash ScottShearer Rusk ChristianAbata cchannon Koen5 a33ik Heartholme AaronKnox okeks Matren David_MA Alex_10 Jeff_Thorpe poweractivate Ramole DianaBirkelbach DavidZoon AJ_Z PriyankaGeethik BrianS StalinPonnusamy HamidBee CNT Anonymous_Hippo Anchov KeithAtherton alaabitar Tolu_Victor KRider sperry1625 IPC_ahaas zuurg rubin_boer cwebb365 Dorrinda G1124 Gabibalaban Manan-Malhotra jcfDaniel WarrenBelz Waegemma drrickryp GuidoPreite If an * is at the end of a user's name this means they are a Multi Super User, in more than one community. Please note this is not the final list, as we are pending a few acceptances. Once they are received the list will be updated.
Join us for an in-depth look into the latest updates across Microsoft Dynamics 365 and Microsoft Power Platform that are helping businesses overcome their biggest challenges today. Find out about new features, capabilities, and best practices for connecting data to deliver exceptional customer experiences, collaborating, and creating using AI-powered capabilities, driving productivity with automation—and building towards future growth with today’s leading technology. Microsoft leaders and experts will guide you through the full 2023 release wave 1 and how these advancements will help you: Expand visibility, reduce time, and enhance creativity in your departments and teams with unified, AI-powered capabilities.Empower your employees to focus on revenue-generating tasks while automating repetitive tasks.Connect people, data, and processes across your organization with modern collaboration tools.Innovate without limits using the latest in low-code development, including new GPT-powered capabilities. Click Here to Register Today!
We are excited to share the ‘Power Platform Communities Front Door’ experience with you! Front Door brings together content from all the Power Platform communities into a single place for our community members, customers and low-code, no-code enthusiasts to learn, share and engage with peers, advocates, community program managers and our product team members. There are a host of features and new capabilities now available on Power Platform Communities Front Door to make content more discoverable for all power product community users which includes ForumsUser GroupsEventsCommunity highlightsCommunity by numbersLinks to all communities Users can see top discussions from across all the Power Platform communities and easily navigate to the latest or trending posts for further interaction. Additionally, they can filter to individual products as well. Users can filter and browse the user group events from all power platform products with feature parity to existing community user group experience and added filtering capabilities. Users can now explore user groups on the Power Platform Front Door landing page with capability to view all products in Power Platform. Explore Power Platform Communities Front Door today. Visit Power Platform Community Front door to easily navigate to the different product communities, view a roll up of user groups, events and forums.
We are so excited to see you for the Microsoft Power Platform Conference in Las Vegas October 3-5 2023! But first, let's take a look back at some fun moments and the best community in tech from MPPC 2022 in Orlando, Florida. Featuring guest speakers such as Charles Lamanna, Heather Cook, Julie Strauss, Nirav Shah, Ryan Cunningham, Sangya Singh, Stephen Siciliano, Hugo Bernier and many more. Register today: https://www.powerplatformconf.com/
User | Count |
---|---|
23 | |
10 | |
9 | |
6 | |
5 |
User | Count |
---|---|
36 | |
27 | |
17 | |
15 | |
15 |