Commit Graph

62 Commits

Author SHA1 Message Date
tsuky_chen
70c04d3270 add scraper for Reddit 2023-12-20 15:53:07 +08:00
tsuky_chen
8faba1c8ee add Rappid api Tiktok script 2023-12-20 11:34:00 +08:00
Timothyxxx
05d3b5863d Update the script on server for ubuntu 2023-12-18 19:53:22 +08:00
211250101
facfcf1b3c add to YouTube scrape 2023-12-17 20:50:27 +08:00
211250101
a381a8a818 add to YouTube scrape 2023-12-17 20:05:15 +08:00
Timothyxxx
4faf8099ce Add nextPageToken call for exhausting the content 2023-12-16 22:10:11 +08:00
Timothyxxx
4100a1db1e Initialize youtube collection script 2023-12-16 21:57:04 +08:00
Timothyxxx
30064ff816 Fix conflicts 2023-12-16 21:32:43 +08:00
tsuky_chen
fe2e5332a7 debug dragTo 2023-12-13 00:09:34 +08:00
tsuky_chen
c628a4e0e8 debug dragTo 2023-12-13 00:05:43 +08:00
Timothyxxx
a37f8a39e0 Initialize evaluation protocols and examples; Implement one kind of eval; Update requirements 2023-12-12 18:12:37 +08:00
Timothyxxx
2ca36109b5 Initialize evaluation protocols and examples; Implement one kind of eval; Update requirements 2023-12-12 18:10:55 +08:00
Timothyxxx
4b3af14b8f Merge remote-tracking branch 'origin/main' 2023-12-06 22:59:29 +08:00
Timothyxxx
343b40ecac Fix action_space setup 2023-12-06 22:59:19 +08:00
tsuky_chen
f545e4ebed compress scroll, click(x,y), drag, press and type 2023-12-06 21:35:30 +08:00
Timothyxxx
b9c317f0f5 Setup initial examples 2023-12-06 17:04:33 +08:00
Timothyxxx
4ba053998d Improve the logic of env setup; add change wallpaper; add example 2023-12-05 17:32:24 +08:00
Timothyxxx
8301096fd4 Add open_file function in server 2023-12-05 13:10:06 +08:00
Timothyxxx
a5dd4408fe Merge remote-tracking branch 'origin/main'
# Conflicts:
#	main.py
2023-12-05 11:48:30 +08:00
Timothyxxx
8818779329 Update compressor for data annotation 2023-12-04 00:51:33 +08:00
Jing Hua
e808cf84a7 setup controller 2023-12-03 21:09:05 +08:00
Jing Hua
b10908b4fa add longer retries 2023-12-03 17:24:44 +08:00
Jing Hua
58e9807a70 automate vm ip address 2023-12-03 17:17:25 +08:00
Timothyxxx
8cb31f1bb0 Fix the implementation of action 13 of computer 2023-12-03 01:00:26 +08:00
Timothyxxx
9471de4768 Fix the implementation of action 13 of computer 2023-12-03 00:59:02 +08:00
Timothyxxx
487fb8005b Improve: fix bugs; add back the cursor in screenshot; add pause in env.step 2023-12-02 22:14:50 +08:00
Timothyxxx
e51ef4b91d Make up 2023-12-02 18:02:45 +08:00
Timothyxxx
9b214b3d23 Action space thoughts 2023-12-02 18:02:06 +08:00
Timothyxxx
992d8f8fce Refactor with pyautogui 2023-12-02 17:52:00 +08:00
Jing Hua
3aebeffec3 add desktop get mouse pos 2023-11-30 17:37:04 +08:00
Jing Hua
ebb5f1cbc5 add mouse cursor to screenshot 2023-11-30 17:31:46 +08:00
Timothyxxx
e52ba2ab13 Fix the width and height of vm, make agent perform more accurate 2023-11-30 12:10:41 +08:00
Timothyxxx
ecb62d7eb4 Resolve fixed todos 2023-11-29 20:23:59 +08:00
Timothyxxx
80b148793d Initialize visual components such as SAM for assistance 2023-11-29 20:22:48 +08:00
Timothyxxx
3d0d9d7758 Run through gpt_4v agent pipeline 2023-11-29 20:21:57 +08:00
Timothyxxx
28c6edd6b3 Add data marker tool 2023-11-28 00:40:04 +08:00
Timothyxxx
8470264884 Initialize GPT-4v agent, and prompt for current observation space 2023-11-28 00:38:22 +08:00
Timothyxxx
7ab3799d30 Remove figure for space 2023-11-28 00:31:19 +08:00
Timothyxxx
0d9a03454e Update with iamge processing tool for marking the click point 2023-11-28 00:30:05 +08:00
Timothyxxx
054f545942 Initialize GPT-4v agent, and prompt for current observation space 2023-11-28 00:23:50 +08:00
Timothyxxx
3fb1dd42d3 README fix 2023-11-27 02:05:26 +08:00
Timothyxxx
eefef4d42d Add heuristic compression of action series on key/scroll/mouse down&up 2023-11-27 02:04:39 +08:00
Timothyxxx
e7fb85aa2f Merge remote-tracking branch 'origin/main' 2023-11-27 00:35:51 +08:00
Jing Hua
21c323a255 ducktrack converter 2023-11-27 00:35:40 +08:00
Timothyxxx
8272e93953 Add DuckTrack as initial annotation tool; Initial multimodal test 2023-11-27 00:34:57 +08:00
Timothyxxx
8c0525c20e Adapt for Windows os; Refine README 2023-11-27 00:29:09 +08:00
Jing Hua
6dee58252e add key down key up 2023-11-26 23:54:43 +08:00
Jing Hua
ddd1da2d78 remove old code 2023-11-26 23:48:20 +08:00
Jing Hua
203fae5798 update screenshot command 2023-11-11 02:38:16 +08:00
Jing Hua
a8aebf5d15 mouse and keyboard controllers for windows and linux 2023-11-08 09:22:43 +08:00