4 Commits

Include renames

Author	SHA1	Message	Date
q792602257	41006b098a	feat(perception): sample OCR text foreground/background colors ... PaddleOCR itself returns no color info, only text/bounds/confidence. Add pixel-level post-processing in perception/ocr.py: crop the screenshot to each OCR box, split pixels into two luminance clusters via Otsu threshold, and treat the minority cluster as the text stroke (foreground) and the majority as the background. New SceneElement.foreground_color/background_color fields ("#rrggbb", None when not OCR-sourced or sampling fails) round-trip through to_dict/from_dict alongside the existing accessibility-state fields. Planner system prompt documents the new fields as a secondary signal. pillow is promoted from an implicit paddleocr transitive dependency to an explicit direct dependency since perception/ocr.py now imports PIL directly; uv.lock re-resolved with no version change (already locked at 12.3.0).	2026-07-15 20:58:47 +08:00
q792602257	17a709c92f	fix(perception): disable PaddleOCR doc-unwarping for screenshots ... PaddleOCR's OCR.yaml pipeline defaults to use_doc_orientation_classify and use_doc_unwarping enabled, which are meant for photographed paper documents. Applied to a flat, upright device screenshot, UVDoc geometrically warps the image before detection, and returns box coordinates in that warped space with no inverse mapping back to the original image. Verified on a real screenshot: with unwarping on, the same detected element ("新项目") shifts from y=158 to y=71 versus the original image, and 2 boxes near the top edge (status bar time/battery) are dropped entirely. Disabling both flags by default (still overridable via explicit kwargs) makes detected boxes match the original screenshot.	2026-07-15 16:51:36 +08:00
q792602257	6e511111c4	fix(perception): harden PaddleOCR result handling	2026-07-14 20:07:49 +08:00
q792602257	5658735bca	feat: checkpoint device agent runtime milestones	2026-07-06 17:24:03 +08:00