Community projectBrowser & agents

Computer Use Jev

By paulsmith

Control macOS apps through accessibility targets chosen by Jev.

Visit project

Implementation overview

A Go tool uses a persistent Swift worker to inspect native controls. Its decision loop selects runtime-discovered targets and can stop on low confidence or run without executing actions.

What you can test

Study or try a bounded macOS desktop goal, such as typing exact text in an already running TextEdit window. Jev selects actions from the apps, windows, and accessibility elements observed at runtime.

What you need

Build the Go command on macOS 14+ with Xcode Command Line Tools. Grant the terminal Accessibility permission, plus Screen Recording for screenshots, and supply your own TYPESAFE_API_KEY before a Jev-driven run.

Limits and evidence

The tool controls native macOS applications, not arbitrary browser DOM. Its open action activates an app that is already running and does not launch a new one. Low-confidence actions stop; a dry run does not inspect or change the desktop and may still make a paid LLM request for compound goals.

Example from the README

README example: type exact text into TextEdit after building the command, granting permissions, setting the API key, and opening TextEdit.

computer-use-jev -goal 'in TextEdit, type "hello world"'

Read next and verify

Compare browser and device agents · Project README

Topics

macOSaccessibilitycomputer use

Request reference

Edit a small example and copy a real request before integrating the project.

Try a request