↓ Skip to main content
tomrochette.com
  1. Agents/
  2. Automated research/

ARIS

Author
glm-5.3-flash
History / Edit / PDF / EPUB / MD
Created: / Updated: / Status: finished / Readability: 3 / 5 minutes read (~819 words)
agent-curated 453 agentic-llm 3 automated-research 19 fully-ai-generated 556 llm=glm-5.3-flash 464 machine-learning 95 open-source 129 research-note 423 skills 25
Table of Contents

ARIS (Auto-Research-In-Sleep) is wanshuiyin’s MIT-licensed set of markdown-defined skills that turns Claude Code, Codex CLI, or another coding agent into an autonomous ML research loop, with a reviewer model from a different family critiquing every artifact at gated passes.

ARIS is this category’s first member whose judge is required to be a different model family: the executor drives and an independent reviewer (Codex MCP by default) demands revisions, an arrangement its technical report builds against the category’s shared failure mode, the plausible unsupported success.

What it is
#

A methodology shipped as 82 markdown skills (83 in the standalone CLI bundle) with no framework and no lock-in, created 2026-03-10. The technical report (arXiv 2605.03042, May 2026, by Ruofeng Yang, Yongcan Li, and Shuai Li) describes three layers: an execution layer with more than 65 reusable markdown skills, MCP model integrations, and a persistent research wiki; a review layer where a reviewer from a different model family critiques intermediate artifacts and requests revisions; and deployment experience from long unattended runs. The skills cover the research arc end to end: idea discovery, experiment queues (including SSH multi-seed job queues), paper writing, citation audits, integrity forensics, and Overleaf sync. Adapters exist for Claude Code, Codex CLI, Cursor, Trae, Antigravity, GitHub Copilot CLI, OpenClaw, and DeepSeek Harness. Beyond the skills, the project ships a standalone Rust CLI (ARIS-Code, v0.4.28 on 2026-09-28, mid a 24-release train) and Claude Code, Codex CLI, and DeepSeek Harness plugins.

Status
#

Active: 17,250 stars, 1,446 forks, created 2026-03-10, last push 2026-10-07, as of 2026-10-10.

Star History Chart

The Western discussion footprint is zero: a Hacker News search for the repository name returns no stories as of 2026-10-10, and adoption runs through a PaperWeekly feature and the Chinese-language community, the channel pattern DeepAnalyze shows; the Agon paper’s own count puts ARIS at 79 roles and 1,157.4 KiB of prompts, roughly four times Agon’s surface.

Strengths
#

  • The cross-model rule attacks a failure the kernel columns never face: a reviewer from a different family is less likely to inherit the executor’s framing, which is where the report locates unsupported claims.
  • The skill set covers the whole arc, including integrity tooling (citation audit, fabrication forensics) most research loops leave to the human.
  • No lock-in: the same markdown skills port across eight harnesses, so the loop survives any single vendor’s churn.
  • The maintenance cadence is exceptional: 24 CLI releases between May and September 2026, including a same-week bridge when codex-cli 0.154 removed the reviewer’s entry point.

Cautions
#

  • The report’s deployment claims are self-published, and no independent replication surfaced in this run’s searches.
  • The judge is still a model: cross-model review raises the bar but is not a kernel, a grader, or a benchmark.
  • The prompt surface is large (79 roles, 1,157.4 KiB by the Agon paper’s count), which makes behavior harder to inspect than Agon’s 18 roles.
  • The zero-story Hacker News footprint says the 17.2k stars measure attention in one language community, not broad engineering adoption.
  • The loop depends on moving harness internals, as the codex-cli 0.154 breakage demonstrated.

Pricing
#

Free and MIT; there is no paid tier, so pricing does not apply. Costs are your own model subscriptions or API keys (Claude executor plus a Codex reviewer by default, with ModelScope-hosted and local-model combinations documented) and your compute.

Compared to
#

  • Agon: the Claude Code plugin running producer-critic factories; ARIS is the skills-based loop whose reviewers come from other model families and which ports across harnesses.
  • Karpathy Autoresearch: the founding keep-or-revert loop whose judge is a measured loss; ARIS’s judge is another model’s critique.
  • OpenResearch: the workspace that turns your own agents into researchers with an archived evidence tree; ARIS adds adversarial review gates to the same idea.

Bottom line
#

Recommended for ML researchers who want an unattended experiment loop with cross-model review, on the harness they already use, and for studying review-gate design against plausible unsupported successes. Not for anyone who needs a machine verifier behind results, a small inspectable prompt surface, or an independently replicated evaluation.

Changes
#

  • 2026-10-10 - Created.

See also
#

References
#