Marc Mintel
f6f15ebd9a
CONTRACT 6: extract_json() — LLM Response Sanitizer (9 tests)
Previously COMPLETELY untested. Every single LLM response in the entire
system passes through this function. Tests:
- Clean JSON, markdown fences (json+plain), thinking block purge
- Text prefix before JSON, truncated JSON fuzzy recovery
- Garbage/empty/None resilience
CONTRACT 7: _visual_discovery Pre-Filters (8 tests)
The guards INSIDE _visual_discovery() that run BEFORE the VLM ever
sees the candidates. If they fail, the VLM gets garbage and hallucinates.
Tests:
- Area filter: tiny nodes (<200px²) and huge containers (>400000px²)
- SystemUI filter: Android system elements, notifications, battery
- Strict Button Guard: long text captions excluded for button intents
- Grid Item Guard: non-grid elements excluded, fallthrough on no match
- Author/Username Guard: nav tabs excluded for author intents
CONTRACT 8: verify_success Structural Delta (8 tests)
The post-click verification logic that decides if a click actually worked.
Tests:
- Toggle massive XML shift = navigation error (False)
- Toggle small diff = success (True)
- Toggle zero diff = inconclusive (None)
- Follow success with 'Requested' marker (private accounts)
- Follow success with German locale ('Abonniert')
- View post with clips_viewer marker (Reels)
- View post still on grid = inconclusive (None)
- Semantic gate blocks wrong toggle element (caption != like button)
GramPilot
Full Self-Driving for Instagram.
An autonomous Agentic Engine that navigates the Instagram App like a human.
Originally derived from GramAddict, completely re-architected.
Created by Marc Mintel <marc@mintel.me>
🏎️ What is GramPilot?
GramPilot is not a traditional script. Traditional bots rely on fixed UI locators (like XPaths) or external APIs, causing them to crash with every Instagram update or get banned within days.
GramPilot introduces a Telepathic Full Self-Driving (FSD) approach to UI navigation: It uses a 3-Stage Resolution Cascade backed by CPU Fast-Paths, Ollama Vector Similarity, and OpenRouter LLMs (Gemini/Qwen) to "read" the screen, understand context, and learn new UI layouts asynchronously.
If Instagram updates its app and moves a button, GramPilot doesn't crash. It falls back to its Agentic LLM reasoning, dynamically reasons about the new layout using raw XML structure, clicks the right button, and never hallucinates on that button again.
✨ Core Features
- 🚫 Zero Limits Configuration: Forget about configuring "max_likes" or "delays". GramPilot uses a Dopamine Pacing Engine to simulate human boredom. If the content isn't interesting, it skips it or ends the session early.
- 🎯 Mission-Driven Navigation: Say goodbye to abstract goal configurations. Define a
strategy(likeaggressive_growthornurture_community) inconfig.yml, and the Goal Decomposer Engine automatically orchestrates the optimal routing and task allocation using enabled plugins. - ⚖️ Active Inference (Shadow Mode): The bot continuously predicts the outcome of its clicks. If it lands on a popup instead of a profile, it registers a "Prediction Error", presses back, and dynamically recalibrates without panicking.
- ⛩️ Telepathic Engine: A strictly tiered resolution cascade (Keyword -> Vectors -> LLM) that ensures 90% of navigation happens at 0-token cost while maintaining fallback AI resilience.
- 🧬 Resonance Oracle: The bot only interacts with content that matches a pre-defined persona aesthetic, completely bypassing spam or low-quality content.
- 🛡️ Honeypot Radome: Instagram plants invisible, 1x1 pixel trap buttons for bots. Our Radome Sensor sanitizes the XML view before the agent ever sees it, mathematically guaranteeing evasion of tracker traps.
🏗️ Project Status (April 2026)
The engine has undergone a massive stabilization refactor to achieve 100% TDD compliance on critical navigation paths.
- Navigation Reliability: Resolved 'Identity Shadowing' bugs to ensure deterministic detection of
OWN_PROFILE. - Autonomous Recovery: Hardened the
SituationalAwarenessEngine(SAE) to handle 12+ anomaly states including system dialogs and persistent survey modals. - Zero-Latency Memory: Optimized Qdrant vector retrieval for sub-second navigational decisions.
🚀 Quick Start
Prerequisites
- A physical Android device or emulator
- Python 3.10+
adb(Android Debug Bridge) installed and added to your PATH
Installation
-
Clone the repository:
git clone https://github.com/marcmintel/grampilot.git cd grampilot -
Initialize Environment & Dependencies:
python3 -m venv .venv source .venv/bin/activate pip install -r requirements.txt -
Start the Engine:
python3 run.py --config config.yml
Note
Unlike legacy bots, GramPilot requires zero maintenance. It will automatically re-learn the UI over time using its integrated Qdrant memory vectors.