mirror of
https://github.com/simular-ai/Agent-S.git
synced 2026-09-01 15:02:27 +08:00
add img; finalize readme
This commit is contained in:
@@ -1,17 +1,23 @@
|
||||
<h1 align="center">
|
||||
<img src="images/agent_s.png" alt="Logo" style="vertical-align:middle" width="60"> Agent S:
|
||||
<small>Using Computers Like a Human</small>
|
||||
<img src="images/agent_s.png" alt="Logo" style="vertical-align:middle" width="60"> Agent S2:
|
||||
<small>An Open, Modular, and Scalable Framework for Computer Use Agents</small>
|
||||
</h1>
|
||||
|
||||
<p align="center">
|
||||
🌐 <a href="https://www.simular.ai/agent-s">[Website]</a>
|
||||
📄 <a href="https://arxiv.org/abs/2410.08164">[Paper]</a>
|
||||
🎥 <a href="https://www.youtube.com/watch?v=OBDE3Knte0g">[Video]</a>
|
||||
🗨️ <a href="https://discord.gg/E2XfsK9fPV">[Discord]</a>
|
||||
<p align="center">
|
||||
🌐 <a href="https://www.simular.ai/agent-s2">[S2 blog]</a>
|
||||
📄 [S2 Paper] (Coming Soon)
|
||||
🎥 <a href="https://www.youtube.com/watch?v=wUGVQl7c0eg">[S2 Video]</a>
|
||||
🗨️ <a href="https://discord.gg/E2XfsK9fPV">[Discord]</a>
|
||||
</p>
|
||||
|
||||
<p align="center">
|
||||
🌐 <a href="https://www.simular.ai/agent-s">[S1 blog]</a>
|
||||
🎥 <a href="https://www.youtube.com/watch?v=OBDE3Knte0g">[S1 Video]</a>
|
||||
📄 <a href="https://arxiv.org/abs/2410.08164">[S1 Paper]</a>
|
||||
</p>
|
||||
|
||||
## 🥳 Updates
|
||||
- [x] **2025/03/11**: Released Agent S2 along with v0.2.0 of [gui-agents](https://github.com/simular-ai/Agent-S), the new state-of-the-art on OSWorld, outperforming OpenAI's CUA and Anthropic's Claude 3.7 Sonnet!
|
||||
- [x] **2025/03/12**: Released Agent S2 along with v0.2.0 of [gui-agents](https://github.com/simular-ai/Agent-S), the new state-of-the-art on OSWorld, outperforming OpenAI's CUA and Anthropic's Claude 3.7 Sonnet!
|
||||
- [x] **2025/01/22**: The [Agent S paper](https://arxiv.org/abs/2410.08164) is accepted to ICLR 2025!
|
||||
- [x] **2025/01/21**: Released v0.1.2 of [gui-agents](https://github.com/simular-ai/Agent-S) library, with support for Linux and Windows!
|
||||
- [x] **2024/12/05**: Released v0.1.0 of [gui-agents](https://github.com/simular-ai/Agent-S) library, allowing you to use Agent-S for Mac, OSWorld, and WindowsAgentArena with ease!
|
||||
@@ -23,13 +29,13 @@
|
||||
2. [🎯 Current Results](#-current-results)
|
||||
3. [🛠️ Installation](#%EF%B8%8F-installation)
|
||||
4. [🚀 Usage](#-usage)
|
||||
5. [🙌 Contributors](#-contributors)
|
||||
5. [🤝 Acknowledgements](#-acknowledgements)
|
||||
6. [💬 Citation](#-citation)
|
||||
|
||||
## 💡 Introduction
|
||||
|
||||
<p align="center">
|
||||
<img src="./images/teaser.png" width="800">
|
||||
<img src="./images/agent_s2_teaser.png" width="800">
|
||||
</p>
|
||||
|
||||
Welcome to **Agent S**, an open-source framework designed to enable autonomous interaction with computers through Agent-Computer Interface. Our mission is to build intelligent GUI agents that can learn from past experiences and perform complex tasks autonomously on your computer.
|
||||
@@ -39,11 +45,16 @@ Whether you're interested in AI, automation, or contributing to cutting-edge age
|
||||
## 🎯 Current Results
|
||||
|
||||
<p align="center">
|
||||
<img src="./images/results.png" width="600">
|
||||
<img src="./images/agent_s2_osworld_result.png" width="600">
|
||||
<br>
|
||||
Results of Successful Rate (%) on the OSWorld full test set of all 369 test examples using Image + Accessibility Tree input.
|
||||
Results of Agent S2's Successful Rate (%) on the OSWorld full test set of all 369 test examples using Image input.
|
||||
</p>
|
||||
|
||||
| Benchmark | Agent S2 | Previous SOTA | Δ improve |
|
||||
|-----------|----------|--------------|-----------|
|
||||
| OSWorld (15 step) | 27.0% | 22.7% (ByteDance UI-TARS) | +4.3% |
|
||||
| OSWorld (50 step) | 34.5% | 32.6% (OpenAI CUA) | +1.9% |
|
||||
| AndroidWorld | 60.0% | 46.8% (ByteDance UI-TARS) | +13.2% |
|
||||
|
||||
## 🛠️ Installation & Setup
|
||||
|
||||
@@ -173,9 +184,9 @@ Refer to `gui_agents/s2/cli_app.py` for more details on how the inference loop w
|
||||
|
||||
To deploy Agent S2 in OSWorld, follow the [OSWorld Deployment instructions](OSWorld.md).
|
||||
|
||||
## 🙌 Contributors
|
||||
## 🤝 Acknowledgements
|
||||
|
||||
We’re grateful to all the [amazing people](https://github.com/simular-ai/Agent-S/graphs/contributors) who have contributed to this project. Additionally, we'd like to thank OSWorld author Tianbao Xie and UI-TARS authors Yujia Qin and Shihao Liang for collaborating and discussing our challenges with us. Thank you! 🙏
|
||||
We extend our sincere thanks to Tianbao Xie for developing OSWorld. We also appreciate the engaging discussions with Tianbao Xie, Yujia Qin, and Shihao Liang regarding UI-TARS. Their insights and collaborative spirit helped us navigate challenges and refine our work!
|
||||
|
||||
## 💬 Citation
|
||||
```
|
||||
|
||||
Binary file not shown.
|
After Width: | Height: | Size: 106 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 158 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 455 KiB |
Reference in New Issue
Block a user