← Back to projects
Taken Group LLC · Agentic Research Platform

AI Research & Codebase Intelligence

A quantitative ML research copilot that connects technical literature to source code. Hybrid retrieval and a staged LangGraph workflow support research analysis and experiment proposals with a dedicated evaluation harness.

PythonFastAPIOpen WebUILangGraphChromaDBBM25Cross Encoder RerankingMCPDockerLLM Evaluation
Architecture

From source documents to research decisions

Knowledge ingestion and retrieval support the agent workflow. Evaluation runs inspect retrieval behavior and response quality separately.

Four architecture layers: source documents feed knowledge ingestion and retrieval. LangGraph orchestrates research responses. Evaluation compares saved runs and research proposals.
Open the diagram to examine full size. Dashed connections show optional cross encoder reranking and configured MCP tool access.
Knowledge & Retrieval

Context across code and literature

Document extraction and metadata enrichment feed SentenceTransformers embeddings in ChromaDB and a BM25 index. Hybrid search combines dense and lexical rankings through reciprocal rank fusion with corpus weighting and source diversification.

A filesystem watcher tracks changes. Content hashes and embedding version checks support selective reindexing.

Optional cross encoder reranking is available through the dense search API. The core graph uses dense or hybrid retrieval.

Agent Orchestration

A staged research workflow

Heuristic task routing selects a research mode and adjusts retrieval scope and corpus weights. LangGraph runs retrieval then planning and research synthesis. An optional implementation mapping stage precedes final review.

Configured MCP tools can supply context before planning. Responses request evidence references and structured recommendations or experiment proposals.

Engineering

Modular services and model access

Open WebUI provides the conversational interface. FastAPI exposes agent and evaluation endpoints. Docker Compose connects the agent API with document processing and separate reranker and MCP proxy services.

OpenAI compatible inference supports configurable models through OpenAI or OpenRouter while retaining the retrieval and evaluation infrastructure.

Evaluation Framework

Research quality and retrieval diagnostics

A dedicated evaluation harness runs curated test cases against retrieval and agent workflows. Metrics track retrieval relevance, response quality, research synthesis, and execution latency.

Saved evaluation runs support performance comparisons, case-level inspection, and experiment notes.

Demonstration

Research interface and evaluation workspace

A look inside the research agent and its dedicated evaluation framework.

Research Agent

Interactive research workspace for technical literature and codebase analysis.

Research workspace with model selection and research controls.
Research workspace with OpenRouter model selection and configurable research modes.
Research agent generating a structured experiment proposal.
Example of a structured research and experiment proposal. Prior conversations and indexed research materials omitted for publication.

Evaluation Dashboard

Evaluation tools for analyzing retrieval and research-agent performance.

Evaluation dashboard showing research-agent performance metrics.
Evaluation dashboard for saved runs and performance metrics.
Detailed evaluation results for retrieval and agent responses.
Detailed evaluation results and case-level inspection.

Conversation history and selected project details omitted for publication.

Architecture is simplified for public presentation. Private research materials and sensitive configuration are omitted.