Marc Mintel
746eeb767d
BREAKING: IntentResolver now resolves intents by SEEING the screenshot instead of parsing XML text descriptions. Architecture: - PRIMARY: Visual Discovery (SoM) — annotates screenshot with numbered bounding boxes, sends to VLM, VLM visually picks the right box - FALLBACK: Text-based VLM resolution (only when no device available) - Removed: _visual_critic (redundant — visual discovery IS visual) - Removed: _humanize_desc regex (the VLM reads the actual screen now) Key innovations: - Spatial Deduplication: child nodes fully contained in parent bounds are suppressed (83 → ~19 boxes), eliminating visual noise - System UI filtering: statusbar, notifications excluded from candidates - VLM prompt is pure visual: 'look at the numbered boxes and pick one' Proven by live LLM test: VLM correctly identifies 'following' (not 'followers') by SEEING the screen content, with zero string matching.
GramPilot
Full Self-Driving for Instagram.
An autonomous Agentic Engine that navigates the Instagram App like a human.
Originally derived from GramAddict, completely re-architected.
Created by Marc Mintel <marc@mintel.me>
🏎️ What is GramPilot?
GramPilot is not a traditional script. Traditional bots rely on fixed UI locators (like XPaths) or external APIs, causing them to crash with every Instagram update or get banned within days.
GramPilot introduces a Telepathic Full Self-Driving (FSD) approach to UI navigation: It uses a 3-Stage Resolution Cascade backed by CPU Fast-Paths, Ollama Vector Similarity, and OpenRouter LLMs (Gemini/Qwen) to "read" the screen, understand context, and learn new UI layouts asynchronously.
If Instagram updates its app and moves a button, GramPilot doesn't crash. It falls back to its Agentic LLM reasoning, dynamically reasons about the new layout using raw XML structure, clicks the right button, and never hallucinates on that button again.
✨ Core Features
- 🚫 Zero Limits Configuration: Forget about configuring "max_likes" or "delays". GramPilot uses a Dopamine Pacing Engine to simulate human boredom. If the content isn't interesting, it skips it or ends the session early.
- ⚖️ Active Inference (Shadow Mode): The bot continuously predicts the outcome of its clicks. If it lands on a popup instead of a profile, it registers a "Prediction Error", presses back, and dynamically recalibrates without panicking.
- ⛩️ Telepathic Engine: A strictly tiered resolution cascade (Keyword -> Vectors -> LLM) that ensures 90% of navigation happens at 0-token cost while maintaining fallback AI resilience.
- 🧬 Resonance Oracle: The bot only interacts with content that matches a pre-defined persona aesthetic, completely bypassing spam or low-quality content.
- 🛡️ Honeypot Radome: Instagram plants invisible, 1x1 pixel trap buttons for bots. Our Radome Sensor sanitizes the XML view before the agent ever sees it, mathematically guaranteeing evasion of tracker traps.
🏗️ Project Status (April 2026)
The engine has undergone a massive stabilization refactor to achieve 100% TDD compliance on critical navigation paths.
- Navigation Reliability: Resolved 'Identity Shadowing' bugs to ensure deterministic detection of
OWN_PROFILE. - Autonomous Recovery: Hardened the
SituationalAwarenessEngine(SAE) to handle 12+ anomaly states including system dialogs and persistent survey modals. - Zero-Latency Memory: Optimized Qdrant vector retrieval for sub-second navigational decisions.
🚀 Quick Start
Prerequisites
- A physical Android device or emulator
- Python 3.10+
adb(Android Debug Bridge) installed and added to your PATH
Installation
-
Clone the repository:
git clone https://github.com/marcmintel/grampilot.git cd grampilot -
Initialize Environment & Dependencies:
python3 -m venv .venv source .venv/bin/activate pip install -r requirements.txt -
Start the Engine:
python3 run.py --config config.yml
Note
Unlike legacy bots, GramPilot requires zero maintenance. It will automatically re-learn the UI over time using its integrated Qdrant memory vectors.