UI elements from Java web app

[visheshjain]

Hello everyone,

I am trying to create a flow in desktop based on a web application that is running on Java.

When I try to add a UI element in my flow it always selects the whole pane (see top right corner) and I am unable to select any UI elements on the page.

Please can anyone suggest how can I go about it getting the UI elements in the flow.

Here is a screenshot of the web app.

Thank you,

Vishesh Jain

[kinuasa]

Would the following site be helpful?

*Automate Java applications - Power Automate
https://docs.microsoft.com/en-us/power-automate/desktop-flows/how-to/java

[visheshjain]

Hello @kinuasa,

Thank you for responding.

I'll keep in mind your solution for future use, but as of now it did not work.

The web app is probably using some old version of Java and as soon as I updated Java, in order to get the settings mentioned in the docs, the web app stopped working altogether.

Thank you for taking the time to respond.

Vishesh Jain

[Ankesh_49]

@visheshjain Could you please try automating it using sendkeys. I understand it will take time. However, if nothing works then sendkeys would be good option.

[visheshjain]

Hi @Ankesh_49,

I tried it already but  send keys is not a robust process as the process is quite long for extracting data for a single location.

On top of that the procedure will have to be repeated for every single location which is like 40+ times.

Thank you for responding.

Vishesh Jain

[Ankesh_49]

@visheshjain Would you mind trying below:

[ryule]

As @Ankesh_49 I have had to do images with Java apps as well, but obviously that doesn't work if your process is too dynamic.

If you need a double click, you can untoggle the click option and send a double click mouse event after it.

[visheshjain]

Hello,

I agree with @ryule that the process is too dynamic and taking pictures for multiple clicks will not work.

Thank you all for responding.

Vishesh Jain

[ryule]

Not sure if you saw this, but there is some additional Java functionality in the latest release of PAD: https://powerautomate.microsoft.com/en-us/blog/power-automate-for-desktop-june-2022-update/

Only applies to "SWT framework applications", which I know nothing about, but perhaps it may help.....I'm crossing my fingers it'll help out my java apps 🙂