Multi-LLM Research Agent

An AI scientist that runs overnight

Describe a research problem at 11pm. Wake up to a publication-ready paper — literature surveyed, experiments run, approaches evolved across generations.

$ pip install git+https://github.com/mohitkr/autonomous-researcher.git
autonomous-researcher — overnight run
Architecture

Seven agents, one evolutionary loop

Each agent specializes in one phase. Between generations, the best approaches survive and mutate. The worst are discarded.

Literature
Surveys arXiv and Amazon Science for relevant techniques
Protocol
Defines evaluation framework with consistent splits
Ideation
Proposes candidate approaches informed by literature
Experiment
Executes in parallel on SageMaker
Evaluation
Scores results, ranks candidates
Review
Peer-reviews for methodological issues
Writing
Produces the final research paper
Select survivors, mutate approaches, repeat across generations
Capabilities

What it handles while you sleep

The full research lifecycle, from literature review to publication draft.

Optimization

Evolutionary Search

Multiple approaches run in parallel, best performers survive and mutate, weaker ones are eliminated. Like a genetic algorithm for research ideas.

Compute

SageMaker Integration

Parallel experiment execution on AWS. Manages training jobs, hyperparameter tuning, and result collection automatically.

Reliability

Checkpoint and Resume

Sleep prevention, crash recovery, and resume from any phase. Start before bed, wake up to results.

Observability

Live Dashboard

Real-time web UI showing generation progress, experiment metrics, and agent activity as it happens.

Memory

Persistent Agent Context

Each agent remembers what worked and what failed across generations. Better decisions compound over iterations.

Rigor

Shared Evaluation Protocol

Consistent train/val/test splits and metrics. Every candidate is compared on equal footing.

Quality

Automated Peer Review

A dedicated reviewer agent critiques results each generation, catching methodological issues before they compound.

Grounding

Literature-Informed

Starts by surveying relevant papers, extracting techniques and baselines. Approaches build on the state of the art.

Flexibility

Multi-LLM Backend

Claude, Gemini, or DeepSeek. Mix fast models for search with powerful models for ideation. Configure per agent role.

LLM Providers

Choose your intelligence backend

Use one provider or mix models across agent roles for the best cost-quality tradeoff.

Claude API
Anthropic
Sonnet 4 / Opus 4
Haiku 3.5
Gemini
Google
2.5 Flash
2.5 Pro
DeepSeek
DeepSeek
Chat
Reasoner
Get Started

Running in sixty seconds

Install, configure your LLM provider, describe your problem.

Install
Terminal
pip install git+https://github.com/mohitkr/autonomous-researcher.git
Configure
Pick your LLM provider, select fast and slow models, enter API key. Saved to ~/.autonomous-researcher/config.yaml.
Terminal
autonomous-researcher configure
Run
Describe your research problem in one line, or point at a detailed PDF.
Terminal
# Simple run
autonomous-researcher run "Your research problem"
# With a problem document
autonomous-researcher run --doc problem.pdf
# Full control: generations, candidates, guidance
autonomous-researcher run --doc problem.pdf --max-generations 5 --candidates 4 \
--guidance "Focus on causal inference, explore panel DML"
# Parallel experiments on cloud GPUs
autonomous-researcher run --doc problem.pdf --compute sagemaker
# Resume from a crash or stop
autonomous-researcher resume <run_id> --from-phase experiment
Output

What you get in the morning

A complete research paper with methodology, experiments, and results.

Adaptive Ensemble Methods for Cold-Start CTR Prediction: An Evolutionary Approach
5 generations · 40 experiments · 8h 23m runtime · Autonomous Researcher v0.9
We present an evolutionary approach to cold-start click-through rate prediction that combines meta-learning initialization with adaptive feature gating. Through 5 generations of population-based optimization across 40 experimental configurations, our best-performing variant achieves a 12.3% improvement in AUC over the production baseline while maintaining sub-10ms inference latency.
+12.3%
AUC vs. Baseline
7.2ms
P99 Latency
+8.7%
Cold-Start CTR