Askive — Chat with your documents
Upload a PDF, DOCX or TXT file and ask it questions. Every answer cites the exact passages it came from. Version 2 adds accounts, hybrid search, caching and a Kubernetes deployment, load-tested with Locust.
- Goal
- Chat with your own documents, and be able to trust the answers.
- Built
- Hybrid search (embeddings + BM25, merged with Reciprocal Rank Fusion) over ChromaDB; Gemini answers only from the retrieved passages. JWT accounts, Redis caching, Postgres, Docker and Kubernetes with autoscaling.
- Hurdle
- Queries took 5+ minutes, uploads hit embedding rate limits, and a load test showed one pod failing 11.7% of requests at 100 users.
- Fix
- Moved the blocking LLM call off FastAPI's event loop (under 10 s per query) and batched embeddings. Fixed three bottlenecks the load test found; autoscaled to 3 pods: 0.1% errors at 100 users.
Python · FastAPI · ChromaDB · Voyage AI · Gemini · Redis · Postgres · Docker · Kubernetes
View code