#

screen-understanding

Here are 6 public repositories matching this topic...

Core-Mate / OpenGUI

OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.

Updated Jul 5, 2026
Kotlin

NITISH-R-G / ScreenSaathi

Open-source AI copilot for Android: understands the live screen via the Accessibility API, resolves the exact UI element you need in natural language (Hindi, Tamil, English), and visually guides you to it — built for people who find modern app UIs hard to navigate.

android kotlin multilingual ai accessibility hindi tamil assistive-technology voice-assistant ai-agent ai-copilot android-ai agentic-ai sarvam-ai screen-understanding android-accessibility-service elderly-accessibility

Updated Aug 15, 2026
Kotlin

badalraj9 / Marey

A modular perception engine for AI agents that enables efficient screen understanding, reasoning, and autonomous interaction.

computer-vision desktop-automation gui-automation ai-agents computer-use screen-understanding screen-perception

Updated Aug 9, 2026
Python

aumi-group / MIND

A camada de presença entre você e a máquina. Agente desktop open source que vê tela, lê cursor, ouve voz e aprende padrões. Tauri + Rust, AGPL.

windows rust agpl ui-automation voice-assistant ai-agents tauri privacy-first ai-native whisper-cpp local-ai open-source-ai desktop-agent computer-use agent-os screen-understanding

Updated Jun 23, 2026
Rust

veersaraf / here

macOS-native, screen-aware AI teacher that lives in your menu bar.

macos swift assistant ai-agent screen-understanding

Updated Jul 21, 2026
Swift

qubie

shinyobjectz / qubie

🧊 a little buddy who lives on your Mac — talks, sees your screen, remembers how you work

desktop-app macos swift rust lua graph-database adhd on-device-ai local-first neural-engine personal-knowledge-management apple-silicon ai-agent ai-companion screen-understanding

Updated Jul 26, 2026
Rust

Improve this page

Add a description, image, and links to the screen-understanding topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the screen-understanding topic, visit your repo's landing page and select "manage topics."