Proxmox CT 107 // High-Performance Retrieval

Local-First AI Research & Bioinformatics Hub

Proxmox CT 107 Sub-10ms Hybrid Retrieval FastMCP Server Zero Per-Query API Cost 100% On-Prem & Private
Checking Cluster Status...

To empower autonomous AI coding and scientific agents without token leakage, rate limits, or slow external web scraping, Elijah built a dedicated, private research and bioinformatics search engine inside Proxmox CT 107. By uniting DuckDB inverted BM25 full-text indexing, Google-style Zoekt trigram code indexing, local NCBI BLAST+ nucleotide/protein alignment, and offline Kiwix ZIM archives behind the Model Context Protocol (FastMCP), local AI models can execute thousands of deep literature, repository, and genomics lookups in single-digit milliseconds.

Live Cluster Telemetry

Indexed Corpus & Engine Status

Real-time status proxied directly from CT 107:8080 via the Proxmox homelab API backend. When operating offline or outside the local network, verified baseline snapshots are displayed.

arXiv Preprints Indexed
71,500+
CS, AI, & q-bio abstracts with DuckDB BM25 ranking
Viral Genome Records
19,625
RefSeq & GenBank viral databases indexed for BLAST+
Zoekt Trigram Shards
65 Shards
59 upstream scientific & ML repositories
Offline Kiwix ZIM Archives
4 Dumps
2.4 GB offline StackExchange scientific knowledge
Offline ZIM Knowledge Dumps
Bioinformatics StackExchange Biology StackExchange Chemistry StackExchange CrossValidated Stats StackExchange
Background Ingestion Status
zoekt_sync idle / synced
arxiv_ingest indexed
blast_db ready
Systems Topology

Agent-to-Engine Retrieval Topology

How agent reasoning loops interact with CT 107 over standardized Model Context Protocol tools.

CLIENT LAYER
AI Coding & Research Agent
Antigravity / Local LLMs / Claude Code
JSON-RPC over SSE / stdio
ORCHESTRATION LAYER (CT 107:8080)
FastMCP Server & Query Dispatcher
Python + AsyncIO + uvloop Microservice
search_arxiv() • search_code() • run_blast() • query_zim()
PILLAR 1
DuckDB BM25
71.5k+ arXiv papers, inverted BM25 scoring in ~3ms
PILLAR 2
Zoekt Trigrams
59 repos, 65 shards, sub-10ms regex & symbol search
PILLAR 3
NCBI BLAST+
RefSeq viral aligner, Taxdump relational queries
PILLAR 4
Kiwix ZIM Dumps
2.4 GB offline StackExchange scientific archives
Deep Engineering

The 4 Pillars of the Research Hub

Eliminating external API dependence through purpose-built local database and indexing engines.

01

DuckDB Full-Text BM25 Literature Engine

Public paper search APIs are notoriously slow, rate-limited, and lack rich full-text search syntax. We ingested over 71,500 arXiv preprints (spanning machine learning, artificial intelligence, quantitative biology, and computational neuroscience) directly into a columnar DuckDB database.

  • Inverted Index: Pre-built BM25 scoring across titles, abstracts, and author affiliations.
  • Sub-Millisecond Response: Average query latency of 2.8 ms, allowing agents to test 20+ query reformulations in seconds.
  • Zero Per-Query Cost: Zero external LLM token overhead or paid search engine credits.
02

Zoekt Sub-10ms Trigram Code Search

When an AI agent investigates an algorithm, reading papers isn't enough—it needs ground-truth source code. We deployed Zoekt (Google's open-source trigram search engine) indexed across 59 upstream scientific and ML repositories.

  • 65 Pre-Indexed Shards: PyTorch, Hugging Face Transformers, Biopython, AlphaFold tools, RDKit, and local project repos.
  • Instant Regex & Symbols: Exact symbol definitions, function signatures, and imports returned in under 8 ms.
  • No Repository Cloning: Agents query millions of lines of upstream source code without polluting local disk or agent context windows.
03

Local NCBI BLAST+ & RefSeq Genomics

Web-based NCBI BLAST queues can take minutes during peak hours and leak proprietary sequence fragments over public networks. CT 107 houses a complete, locally managed NCBI BLAST+ 2.15+ toolchain with optimized binary indices.

  • 19,625 Viral Genomes: RefSeq and GenBank viral nucleotide/protein reference databases formatted with makeblastdb.
  • Relational Taxdump: Integrated NCBI Taxonomy relational SQLite database linking Accession IDs to lineage trees in real time.
  • Deterministic Alignment: E-values, bitscores, and query coverages returned in 40–120 ms directly to AI reasoning agents.
04

FastMCP Agent Protocol Layer

To make all three engines natively accessible to modern AI assistants, we unified them behind the Model Context Protocol (FastMCP) running over high-speed HTTP SSE and JSON-RPC.

  • Agent Tool Interface: Clean function calling definitions (search_arxiv, search_code, run_blast, query_archive).
  • Single Reasoning Loop: An agent can search literature, verify the algorithm's code implementation, and align biological data within a single continuous thought stream.
  • Interoperable: Natively compatible with Google Antigravity, Claude Code, Cursor, and custom LangGraph/CrewAI agents.
Execution Walkthrough

How an AI Agent Uses CT 107 in Real Time

A concrete trace of an autonomous research session executing across local tools.

FastMCP Agent Execution Log // CT 107
Sub-10ms Verified
> [Agent Goal] Investigate transformer attention implementations for viral sequence motifs.
[1/3] FastMCP Tool Call: search_arxiv(query="discrete attention viral genome sequence", top_k=3)
→ DuckDB BM25 matched 14 papers in 3.1 ms. Top hit: arXiv:2310.04821 ("Genomic Foundations for Variant Impact").
[2/3] FastMCP Tool Call: search_code(query="def flash_attn_func", file_filter="*.py")
→ Zoekt scanned 59 repositories across 65 shards in 6.8 ms. Matched 4 definitions in upstream PyTorch/FlashAttention.
[3/3] FastMCP Tool Call: run_local_blast(seq="ATGGTGCACCTGACTCCTGAGGAG...", db="viral_refseq")
→ BLAST+ aligned against 19,625 records in 42.4 ms. Identity: 99.8% (E-value: 2e-94, Taxon: Betacoronavirus).
✓ Synthesis completed in 64.3 ms total retrieval time. Zero external tokens billed. Zero public API calls.
Enterprise & Production AI Consulting

Want a Private RAG Pipeline, Custom MCP Server, or Sub-10ms Search Index?

Whether your organization needs private document retrieval over internal technical specifications, a custom FastMCP server connecting AI agents to proprietary databases, or on-premises semantic search with zero cloud token leaks, let's build it together.