6 Commits

Include renames

Author	SHA1	Message	Date
q792602257	41006b098a	feat(perception): sample OCR text foreground/background colors ... PaddleOCR itself returns no color info, only text/bounds/confidence. Add pixel-level post-processing in perception/ocr.py: crop the screenshot to each OCR box, split pixels into two luminance clusters via Otsu threshold, and treat the minority cluster as the text stroke (foreground) and the majority as the background. New SceneElement.foreground_color/background_color fields ("#rrggbb", None when not OCR-sourced or sampling fails) round-trip through to_dict/from_dict alongside the existing accessibility-state fields. Planner system prompt documents the new fields as a secondary signal. pillow is promoted from an implicit paddleocr transitive dependency to an explicit direct dependency since perception/ocr.py now imports PIL directly; uv.lock re-resolved with no version change (already locked at 12.3.0).	2026-07-15 20:58:47 +08:00
q792602257	361dada276	feat(perception): surface accessibility interaction state on UI-tree elements ... SceneElement gains enabled/clickable/selected/checked/focused (bool | None), populated from the literal attributes Appium's XCUITest and UiAutomator2 page_source already emit (iOS: enabled only; Android: all five). None means "not reported by this platform", not false. to_dict() omits unset fields to keep the LLM-facing scene JSON compact; planner_prompts.py documents the new fields so the AI planner knows how to use them (e.g. don't tap disabled elements, use selected/checked to judge whether a toggle already matches the goal).	2026-07-15 18:10:53 +08:00
q792602257	ccde30e378	feat(runtime): capture step evidence in console	2026-07-15 10:12:09 +08:00
q792602257	1bdc3784dc	fix(device-pool): scope primary key by host and thread through capability_tags ... - pooled_devices primary key changed from device_id alone to (host_id, device_id), so two hosts reporting the same local device_id no longer crash sync_host_devices() with an uncaught sqlite3.IntegrityError. - Device gained a capability_tags field so DevicePool.sync_host_devices() can actually populate PooledDevice.capability_tags from a real host sync instead of always falling back to an empty list. openspec: device-pool capability, archived change cloud-runtime	2026-07-07 08:30:47 +08:00
q792602257	5658735bca	feat: checkpoint device agent runtime milestones	2026-07-06 17:24:03 +08:00
q792602257	02ef4d23f2	Implement Apex Agent MVP scaffold	2026-07-06 13:22:15 +08:00