Is it possible for adb shell
console to access an Android app's specific button using its id? or text?
I'm trying to automate the button click on the device. This is a web app accessed from a browser. So if I have that button id can I send an action to that button?
Yes you can, although it's not pretty.
You can get the view hierarchy by using this command:
adb exec-out uiautomator dump /dev/tty
, which prints the output to the screen as an XML file. Unfortunately it's not valid XML, as there's some text appended. So let's filter that out:adb exec-out uiautomator dump /dev/tty | awk '{gsub("UI hierchary dumped to: /dev/tty", "");print}'
Now we've got a valid XML. Let's run this through XPath:
adb exec-out uiautomator dump /dev/tty | awk '{gsub("UI hierchary dumped to: /dev/tty", "");print}' | xpath '//node[@resource-id="com.example:id/btnDone"]' 2> /dev/null
, which will search for all nodes with the specific ID. Now you got the node, and you can do some more stuff on this.If you were to get only the viewbounds, you'd have to do this:
adb exec-out uiautomator dump /dev/tty | awk '{gsub("UI hierchary dumped to: /dev/tty", "");print}' | xpath '//node[@resource-id="com.example:id/btnDone"]/@bounds' 2> /dev/null | awk '{$1=$1};1' | awk '{gsub("bounds=", "");print}' | awk '{gsub("\"", "");print}'
, which cleans up the string afterwards and just outputs[294,1877][785,1981]
.The source of the specific node is:
<node index="1" text="Let’s get started!" resource-id="com.example:id/btnDone" class="android.widget.Button" package="com.example" content-desc="" checkable="false" checked="false" clickable="true" enabled="true" focusable="true" focused="false" scrollable="false" long-clickable="false" password="false" selected="false" bounds="[294,1877][785,1981]" />
if me, i use python to do that, combine cmd command with subprocess.Popen, the script would be:
then when you have a button coord to tap just do this:
when you want to swipe:
to get the coordinate of button or a point, use 'uiautomatorviewer.bat' that exists in folder 'sdk\tools\bin'
or you can use apricot, erm3nda or Vinicius Dantas method,
UI automator gives resource IDs, text, and the bounds of the UI element. An XML viewer or Chrome browser can be used to get a better view of the file.
The UI element's bounds can be be extracted and the mid point can be calculated. Replace
text=
withresource-id=
orcontent-desc=
as needed.Now we have the coordinates of the UI element's center in
$coords
and we just need to send a tap event.You won't be able to use the button id, but you can get the button coordinates and simulate a tap event.
Android comes with an input command-line tool that can simulate miscellaneous input events. To simulate tapping, use:
You can use the adb shell to run the command remotely:
Other options are:
I think the best you can do is to inject touch based on a coordinate.
Please see send touch event from ADB to a device and simulating touch using ADB
You might get a coordinate of a button from dumpsys window or activity.
You could also check out Monkeyrunner.