17 Commits

Author	SHA1	Message	Date
Tianbao Xie	a156f8a3d6	Modify the namespace of a11y tree (#62)	2024-07-25 20:20:34 +08:00
Timothyxxx	9c75df5dce	Clean code; Refactor environment to pass screenshot content instead of path	2024-04-13 23:34:01 +08:00
Timothyxxx	172123ab2c	Support downsampling; Fix bugs in windows a11y tree; Add a11y_tree trim	2024-03-25 18:02:48 +08:00
Timothyxxx	3ce7636abd	Fix one multi_app example; remove some broken examples; Support downsampling	2024-03-21 22:05:16 +08:00
David Chang	4df088e2ad	ver Mar19thv2 ... supplemented at info back for som setting	2024-03-19 18:41:55 +08:00
David Chang	b5d58b8ecd	ver Mar19th ... a tiny fix	2024-03-19 17:43:34 +08:00
David Chang	13e6040148	ver Mar15thv2 ... fixed a bug	2024-03-15 22:50:22 +08:00
David Chang	e166106b6a	ver Mar15th ... added an option to keep buttons without text information but with an image for SoM setting	2024-03-15 22:46:14 +08:00
David Chang	0c9c2f214a	ver Mar11thv2 ... minor adjustment	2024-03-11 22:45:16 +08:00
David Chang	e95e8e55ea	ver Mar11th ... updated filter_nodes	2024-03-11 12:33:47 +08:00
David Chang	f08fa4912c	ver Mar10th ... changed AT element filtering	2024-03-10 18:03:02 +08:00
David Chang	d8a497a417	ver Jan29th ... updated the position of SoM marks	2024-01-29 21:49:53 +08:00
David Chang	eef5158663	ver Jan26thv3 ... fixed bug caused by an empty node.text remove nodes whose name and text are all empty	2024-01-26 23:49:15 +08:00
Timothyxxx	f88331416c	Refactor baselines code implementations	2024-01-20 18:55:21 +08:00
Timothyxxx	09f3e776ae	Initialize all baselines: screenshot, a11y tree, both, SoM, SeeAct	2024-01-20 00:13:46 +08:00
Timothyxxx	20b1d950a0	FIx corner cases (val connection in chrome when using playwright, and action parsing for agent, and accessibility tree xml handling)	2024-01-16 22:00:01 +08:00
Timothyxxx	186bf2e97c	Implement heuristic cutting on the accessibility tree to get the important nodes; Finish accessibility tree text agent	2024-01-16 16:43:32 +08:00