bytedance/UI-TARS
Pioneering Automated GUI Interaction with Native Agents
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
The project lists 9 contributors on GitHub.
Use Cases & Benefits
- Implements a multimodal agent that automates GUI interactions using vision-language models and native agents for diverse virtual environments.
- Delivers state-of-the-art reasoning and action execution in GUI tasks by integrating reinforcement learning and inference-time scaling.
- Use for automating desktop GUI workflows including mouse, keyboard, and application control on Windows, Linux, or macOS.
- Use for controlling mobile device interfaces and Android emulators with mobile-specific actions like long press and app navigation.
- Use for research and evaluation of multimodal interaction systems focusing on action grounding without reasoning outputs.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
Watch-outs
- No commits in the last six months (last push Jan 2026).
- No GitHub releases; pin a commit or tag instead of a release.
General guidance from repository metadata, not legal advice. How we score
From the README
🖥️ UI-TARS-desktop   🏄 Midscene (Browser Automation)   |   🫨 Discord  
We also offer a UI-TARS-desktop version, which can operate on your local personal device. To use it, please visit https://github.com/bytedance/UI-TARS-desktop. To use UI-TARS in web automation, you may refer to the open-source project Midscene.js. ❗Notes: Since Qwen 2.5vl based models ultilizes absolute coordinates to ground objects, please kindly refer to our illustration about how to process coordinates in this guide.
UI-TARS-1.5, an open-source multimodal agent built upon a powerful vision-language model. It is capable of effectively performing diverse tasks within virtual worlds.
Leveraging the foundational architecture introduced in our recent paper, UI-TARS-1.5 integrates advanced reasoning enabled by reinforcement learning. This allows the model to reason through its thoughts before taking action, significantly enhancing its performance and adaptability, particularly in inference-time scaling. Our new 1.5 version achieves state-of-the-art results across a variety of standard benchmarks, demonstrating strong reasoning capabilities and notable improvements over prior models.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
Forks
888+23
Open issues
59+4
Compared with peers in Backend
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| anthropics/skills | 187.8K | +2.9K | 15 | — |
| DuarteSantos8/openGym | 19.7K | +2.4K | 60 | 2 days ago |
| shiyu-coder/Kronos | 47.0K | +2.3K | 16 | — |
| NationalSecurityAgency/ghidra | 98.2K | +2.3K | 64 | 14 days ago |
| microsoft/VibeVoice | 56.0K | +1.1K | 29 | — |
| bytedance/UI-TARS | 11.7K | — | 10 | — |
| Category median | 56.0K | +2.3K | 29 | — |
Also by bytedance
Other repositories from this maintainer that GStars tracks
- Python84.6K stars
deer-flow
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
- TypeScript39.4K stars
UI-TARS-desktop
The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra
- Python12.2K stars
trae-agent
Trae Agent is an LLM-based agent for general purpose software engineering tasks.
- Go9.7K stars
sonic
A blazingly fast JSON serializing & deserializing library
- Python9.1K stars
Dolphin
The official repo for “Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting”, ACL, 2025.
Discover Repositories
Search across tracked repositories by name or description