ConsoleY — Virtual Desktop for AI Agents

Imagine an AI agent having its own computer desktop like an employee, able to browse the web, gather information, and operate software anytime, anywhere?

Anthropic's Computer Use project is an interesting attempt in this direction. However, in their official demo, the chat interface and desktop are integrated and cannot be used separately or accessed remotely through APIs.

ConsoleY is a Docker-based remote desktop environment that containerizes the Ubuntu desktop environment. It's not only accessible through a browser but also provides remote control capabilities through an API service implemented in Rust, making it compatible with any local or cloud-based AI assistants that support tool calling.