Nova Assistant Roadmap
This document outlines planned features and improvements for Nova Assistant.
Human-readable docs also live in docs/ (GitHub Pages).
Current Status (v0.3.0)
- Basic chat interface with streaming responses
- Multiple AI model support (SmolLM, FastVLM, Gemma 3, Gemma 4)
- Automatic model selection based on query complexity
- Voice input via speech-to-text
- TTS speak response on assistant bubbles
- Screen capture and image attachment (on-demand MediaProjection)
- Tool execution (alarms, apps, web search, weather, SMS)
- Tool visualization + streaming progress (EventChannel)
- RAG memory + custom memories
- Memory overview (stored vs derived, promote, ask-about-me)
- Message limits (model-aware caps + pre-send guards)
- Follow-up suggestions (bulb button chips + reroll)
- Settings JSON backup (export/import, no models)
- Knowledge base UI + real PDF text extraction → RAG
- Conversation summaries (extractive, injected into RAG)
- Edit user message + resend
- Response regeneration (reroll)
- Prompt presets
- Agent identity + assistant roles
- Model download, HF token, custom import (
.litertlm/.task) - Beginner/Expert modes + onboarding
- Tasks, notes, document analysis helpers
- MCP client (HTTP/SSE + stdio + Streamable HTTP + OAuth/PKCE)
- Notification tap + quick actions (open tasks / chat / ask Nova)
- Parallel sessions (capped to 1 on Android for RAM safety)
- CI + release workflows; docs GitHub Pages workflow
- Stability: no idle unload during LiteRT streaming (SIGABRT fix)
- Stability: vision engines always load with
supportImage - Stability: screenshot bytes via dedicated channel; capture not continuous
- Agent skill
.cursor/skills/nova-dev
Phase 1: Stability and Polish
High Priority
- Fix model re-download (canonical filename consistency)
- Fix tool call truncation / multi-call support
- Error handling (
ModelException+ action chips) - Memory management (RAG scoring / truncation)
- Battery optimization (idle release, lifecycle-aware)
- Offline mode indicator with Install action
- Inference lifecycle hardening (stream vs unload race)
- Vision engine always-on for vision models
- Low-RAM Android defaults (shorter idle, session cap, memory warning)
Medium Priority
- File/URL attachment, export, history search, timestamps, copy, reactions
- Onboarding + beginner/expert + model browser + import + selector
- Debug mode + HF token + external tool providers
- Strip leftover debug
AGENT_DBGinstrumentation after soak verification - Optional crash reporting (opt-in only)
Phase 2: Enhanced Intelligence
High Priority
- Context window management
- Multi-turn tool calls + visualization + streaming progress
- Model performance metrics
- MCP-like tool schemas + auto-model selection
- MCP Streamable HTTP + OAuth
Medium Priority
- Semantic search (TF-IDF)
- Conversation summaries
- Proactive suggestions (bulb follow-up chips)
- Multi-language support
- Code syntax highlighting (Markdown)
- Document extract/chunk + Knowledge base UI + PDF extract
- Prompt presets
- Conversation branching
- Response regeneration (reroll)
- Parallel session management
- Platform adaptation helpers
Phase 3: Platform Expansion
High Priority
- Windows support (native)
- Linux support (native)
- Watch companion
- Widget support (home screen widget; polish ongoing)
- Notification actions
Medium Priority
- Voice synthesis (TTS)
- Wake word detection
- Real-time translation
Phase 4: Advanced Features
High Priority
- Multi-modal input (audio/video/docs beyond current attachments)
- Plugin system
- Optional encrypted cloud sync
- MCP client (SSE/stdio/Streamable HTTP)
- MCP Streamable HTTP transport
Medium Priority
- Collaboration
- Learning mode
- Custom tool creation UI
Phase 5: Ecosystem
High Priority
- Public plugin marketplace
- Third-party model adapters
- Community prompt/tool packs
Non-goals (near term)
- GGUF inference
- Re-warming FGS
ModelService - Continuous screenshot encode
Suggested v0.3.x / v0.4 follow-ons
| Feature | Notes |
|---|---|
| Conversation branching | Non-linear history model |
| Share message sheet | Export exists; bubble share does not |
| Continuous dictation | record package unused beyond STT |
| Free-RAM gate before Gemma 4 | Soft warning exists |
Strip AGENT_DBG |
Hygiene after soak |
| Desktop (Windows) scaffold | Large platform lift |
| Wake word | Battery/privacy cost |
| Custom tool creator UI | After MCP HTTP soak |