add img; finalize readme

This commit is contained in:
alckasoc
2025-03-11 22:46:52 -07:00
parent 1cecd86d98
commit d94514e79c
4 changed files with 25 additions and 14 deletions
+25 -14
View File
@@ -1,17 +1,23 @@
<h1 align="center">
<img src="images/agent_s.png" alt="Logo" style="vertical-align:middle" width="60"> Agent S:
<small>Using Computers Like a Human</small>
<img src="images/agent_s.png" alt="Logo" style="vertical-align:middle" width="60"> Agent S2:
<small>An Open, Modular, and Scalable Framework for Computer Use Agents</small>
</h1>
<p align="center">
🌐 <a href="https://www.simular.ai/agent-s">[Website]</a>
📄 <a href="https://arxiv.org/abs/2410.08164">[Paper]</a>
🎥 <a href="https://www.youtube.com/watch?v=OBDE3Knte0g">[Video]</a>
🗨️ <a href="https://discord.gg/E2XfsK9fPV">[Discord]</a>
<p align="center">&nbsp;
🌐 <a href="https://www.simular.ai/agent-s2">[S2 blog]</a>&nbsp;
📄 [S2 Paper] (Coming Soon)&nbsp;
🎥 <a href="https://www.youtube.com/watch?v=wUGVQl7c0eg">[S2 Video]</a>
🗨️ <a href="https://discord.gg/E2XfsK9fPV">[Discord]</a>&nbsp;
</p>
<p align="center">&nbsp;
🌐 <a href="https://www.simular.ai/agent-s">[S1 blog]</a>&nbsp;
🎥 <a href="https://www.youtube.com/watch?v=OBDE3Knte0g">[S1 Video]</a>
📄 <a href="https://arxiv.org/abs/2410.08164">[S1 Paper]</a>&nbsp;
</p>
## 🥳 Updates
- [x] **2025/03/11**: Released Agent S2 along with v0.2.0 of [gui-agents](https://github.com/simular-ai/Agent-S), the new state-of-the-art on OSWorld, outperforming OpenAI's CUA and Anthropic's Claude 3.7 Sonnet!
- [x] **2025/03/12**: Released Agent S2 along with v0.2.0 of [gui-agents](https://github.com/simular-ai/Agent-S), the new state-of-the-art on OSWorld, outperforming OpenAI's CUA and Anthropic's Claude 3.7 Sonnet!
- [x] **2025/01/22**: The [Agent S paper](https://arxiv.org/abs/2410.08164) is accepted to ICLR 2025!
- [x] **2025/01/21**: Released v0.1.2 of [gui-agents](https://github.com/simular-ai/Agent-S) library, with support for Linux and Windows!
- [x] **2024/12/05**: Released v0.1.0 of [gui-agents](https://github.com/simular-ai/Agent-S) library, allowing you to use Agent-S for Mac, OSWorld, and WindowsAgentArena with ease!
@@ -23,13 +29,13 @@
2. [🎯 Current Results](#-current-results)
3. [🛠️ Installation](#%EF%B8%8F-installation)
4. [🚀 Usage](#-usage)
5. [🙌 Contributors](#-contributors)
5. [🤝 Acknowledgements](#-acknowledgements)
6. [💬 Citation](#-citation)
## 💡 Introduction
<p align="center">
<img src="./images/teaser.png" width="800">
<img src="./images/agent_s2_teaser.png" width="800">
</p>
Welcome to **Agent S**, an open-source framework designed to enable autonomous interaction with computers through Agent-Computer Interface. Our mission is to build intelligent GUI agents that can learn from past experiences and perform complex tasks autonomously on your computer.
@@ -39,11 +45,16 @@ Whether you're interested in AI, automation, or contributing to cutting-edge age
## 🎯 Current Results
<p align="center">
<img src="./images/results.png" width="600">
<img src="./images/agent_s2_osworld_result.png" width="600">
<br>
Results of Successful Rate (%) on the OSWorld full test set of all 369 test examples using Image + Accessibility Tree input.
Results of Agent S2's Successful Rate (%) on the OSWorld full test set of all 369 test examples using Image input.
</p>
| Benchmark | Agent S2 | Previous SOTA | Δ improve |
|-----------|----------|--------------|-----------|
| OSWorld (15 step) | 27.0% | 22.7% (ByteDance UI-TARS) | +4.3% |
| OSWorld (50 step) | 34.5% | 32.6% (OpenAI CUA) | +1.9% |
| AndroidWorld | 60.0% | 46.8% (ByteDance UI-TARS) | +13.2% |
## 🛠️ Installation & Setup
@@ -173,9 +184,9 @@ Refer to `gui_agents/s2/cli_app.py` for more details on how the inference loop w
To deploy Agent S2 in OSWorld, follow the [OSWorld Deployment instructions](OSWorld.md).
## 🙌 Contributors
## 🤝 Acknowledgements
Were grateful to all the [amazing people](https://github.com/simular-ai/Agent-S/graphs/contributors) who have contributed to this project. Additionally, we'd like to thank OSWorld author Tianbao Xie and UI-TARS authors Yujia Qin and Shihao Liang for collaborating and discussing our challenges with us. Thank you! 🙏
We extend our sincere thanks to Tianbao Xie for developing OSWorld. We also appreciate the engaging discussions with Tianbao Xie, Yujia Qin, and Shihao Liang regarding UI-TARS. Their insights and collaborative spirit helped us navigate challenges and refine our work!
## 💬 Citation
```
Binary file not shown.

After

Width:  |  Height:  |  Size: 106 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 158 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 455 KiB