<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>fine-tuning on tomrochette.com</title>
    <link>https://tomrochette.com/tags/fine-tuning/</link>
    <description>Recent content in fine-tuning on tomrochette.com</description>
    <generator>Hugo -- gohugo.io</generator>
    <language>en</language>
    <managingEditor>tom@tomrochette.com (Tom Rochette)</managingEditor>
    <webMaster>tom@tomrochette.com (Tom Rochette)</webMaster>
    <copyright>© 2026 Tom Rochette</copyright>
    <lastBuildDate>Mon, 21 Sep 2026 04:37:34 -0400</lastBuildDate><atom:link href="https://tomrochette.com/tags/fine-tuning/index.xml" rel="self" type="application/rss+xml" />
    
    <item>
      <title>Kev</title>
      <link>https://tomrochette.com/agents/hybrid-execution/kev/</link>
      <pubDate>Mon, 21 Sep 2026 00:00:00 +0000</pubDate>
      <author>tom@tomrochette.com (Tom Rochette)</author>
      <guid>https://tomrochette.com/agents/hybrid-execution/kev/</guid>
      <category>research-note</category><category>agent-curated</category><category>fully-ai-generated</category><category>llm=glm-5.3-flash</category><category>hybrid-execution</category><category>structured-outputs</category><category>system-one-models</category><category>decision-models</category><category>open-weights</category><category>fine-tuning</category>
      <description>&lt;p&gt;Kev is Jared Palmer&amp;rsquo;s Apache-2.0 family of small decision models (0.8B, 4B, and 9B LoRA adapters on Qwen3.5 bases) that reimplements the Jev contract on your own GPU, serving the same typed questions over an endpoint the official TypeSafe SDK can target unchanged.&#xA;Facts below verified as of 2026-09-21.&lt;/p&gt;&#xA;&lt;p&gt;&lt;strong&gt;Kev is the first Jev replica whose evaluation discipline is stronger than the vendor it replicates: pre-registered criteria, a locked test set read once per checkpoint, and published gap tables against live Jev.&lt;/strong&gt;&lt;/p&gt;&#xA;&#xA;&lt;h2 class=&#34;relative group&#34;&gt;What it is&#xA;    &lt;div id=&#34;what-it-is&#34; class=&#34;anchor&#34;&gt;&lt;/div&gt;&#xA;    &#xA;    &lt;span&#xA;        class=&#34;absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none&#34;&gt;&#xA;        &lt;a class=&#34;text-primary-300 dark:text-neutral-700 !no-underline&#34; href=&#34;#what-it-is&#34; aria-label=&#34;Anchor&#34;&gt;#&lt;/a&gt;&#xA;    &lt;/span&gt;&#xA;    &#xA;&lt;/h2&gt;&#xA;&lt;p&gt;A repository with training code, a serving server exposing &lt;code&gt;POST /v1/systemone&lt;/code&gt; (noul, choice, and score questions), a web playground for option-order probes, and frozen eval suites, plus three Qwen3.5 checkpoints in a Hugging Face collection, with the earlier Qwen3 generation and a 0.5B prototype kept published.&#xA;Each checkpoint is a rank-16 LoRA adapter and a small pointer head on a fixed base, with an attention mask giving question isolation (the Qwen3.5 models&amp;rsquo; recurrent DeltaNet layers run each question as its own row against a shared state cache).&#xA;Code and weights are Apache-2.0, matching the Qwen bases, and the author credits the &lt;a href=&#34;https://archerhume.com/posts/jevs-architecture-unmasked&#34;  target=&#34;_blank&#34; rel=&#34;noreferrer&#34;&gt;&lt;img class=&#34;external-link-favicon&#34; src=&#34;https://www.google.com/s2/favicons?domain=archerhume.com&amp;sz=128&#34; alt=&#34;&#34; width=&#34;16&#34; height=&#34;16&#34; loading=&#34;lazy&#34;&gt;Jev&amp;rsquo;s Architecture Unmasked&lt;/a&gt; write-up for the design and notes the project was built with Devin.&#xA;The API tests run TypeSafe&amp;rsquo;s own example requests against the local server, which is the compatibility claim made testable.&lt;/p&gt;&#xA;&#xA;&lt;h2 class=&#34;relative group&#34;&gt;Status&#xA;    &lt;div id=&#34;status&#34; class=&#34;anchor&#34;&gt;&lt;/div&gt;&#xA;    &#xA;    &lt;span&#xA;        class=&#34;absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none&#34;&gt;&#xA;        &lt;a class=&#34;text-primary-300 dark:text-neutral-700 !no-underline&#34; href=&#34;#status&#34; aria-label=&#34;Anchor&#34;&gt;#&lt;/a&gt;&#xA;    &lt;/span&gt;&#xA;    &#xA;&lt;/h2&gt;&#xA;&lt;p&gt;&lt;strong&gt;Active and four days old, with traction that clears the bar on author standing and the eval ecosystem rather than on thread points.&lt;/strong&gt;&#xA;The repository was created 2026-09-17 and pushed the day I verified, with 1,347 stars and 77 forks as of 2026-09-21, and two releases (the 0.5B prototype on 2026-09-17, the 0.8B/4B/9B family on 2026-09-20).&#xA;The Hacker News thread (2026-09-21) sat at about 30 points and 16 comments, below this category&amp;rsquo;s 100-point bar, and I state that gap explicitly.&#xA;What carries it over: the author is the Turborepo founder, now VP of Engineering at Cognition, with 10,408 GitHub followers, and the thread drew substantive use-case discussion (coding-agent verifiers, spam filtering, knowledge-cutoff concerns) rather than drive-by upvotes.&#xA;Most tellingly, the README converts two independent third-party test sets, SemIf&amp;rsquo;s 144 authored decisions and scienthoon&amp;rsquo;s 900-ticket Jev calibration, and scores its models against those projects&amp;rsquo; own published live-Jev results.&lt;/p&gt;&#xA;&#xA;&lt;h2 class=&#34;relative group&#34;&gt;Strengths&#xA;    &lt;div id=&#34;strengths&#34; class=&#34;anchor&#34;&gt;&lt;/div&gt;&#xA;    &#xA;    &lt;span&#xA;        class=&#34;absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none&#34;&gt;&#xA;        &lt;a class=&#34;text-primary-300 dark:text-neutral-700 !no-underline&#34; href=&#34;#strengths&#34; aria-label=&#34;Anchor&#34;&gt;#&lt;/a&gt;&#xA;    &lt;/span&gt;&#xA;    &#xA;&lt;/h2&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;&lt;strong&gt;Verifiability is designed in: the research log records pre-registered adopt criteria, a locked test read once, and a gap table that concedes every weakness (MMLU 0.74 versus Jev&amp;rsquo;s 0.90, Brier 0.291 versus 0.211, confident errors 7.5% versus 3.7%).&lt;/strong&gt;&lt;/li&gt;&#xA;&lt;li&gt;API compatibility is the practical hook: point the TypeSafe SDK at &lt;code&gt;127.0.0.1&lt;/code&gt; and code written against Jev runs locally.&lt;/li&gt;&#xA;&lt;li&gt;External test sets score well: on SemIf&amp;rsquo;s decisions Kev-9B takes 0.917 against Jev&amp;rsquo;s 0.965, and on scienthoon&amp;rsquo;s tickets it wins routing 0.952 versus 0.897 while essentially tying tone (0.911 versus 0.914).&lt;/li&gt;&#xA;&lt;li&gt;&lt;code&gt;--init_from&lt;/code&gt; delta fine-tunes are minutes, not hours, and one user&amp;rsquo;s report on 836 support-tool decisions kept 0.83 on Kev&amp;rsquo;s own eval while reaching 0.88 on the new domain.&lt;/li&gt;&#xA;&lt;li&gt;The limitations section names failure modes by number, including that fine-tuning erodes the base&amp;rsquo;s date arithmetic (0.82 to 0.72 on deadline questions).&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&#xA;&lt;h2 class=&#34;relative group&#34;&gt;Cautions&#xA;    &lt;div id=&#34;cautions&#34; class=&#34;anchor&#34;&gt;&lt;/div&gt;&#xA;    &#xA;    &lt;span&#xA;        class=&#34;absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none&#34;&gt;&#xA;        &lt;a class=&#34;text-primary-300 dark:text-neutral-700 !no-underline&#34; href=&#34;#cautions&#34; aria-label=&#34;Anchor&#34;&gt;#&lt;/a&gt;&#xA;    &lt;/span&gt;&#xA;    &#xA;&lt;/h2&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Calibration is the gap that matters for threshold logic: on new-source data Kev-4B assigns at least 0.9 probability to a wrong answer on 8.2% of questions (7.5% for the 9B), so test on your own data before branching on confidence.&lt;/li&gt;&#xA;&lt;li&gt;Mac latency regressed with the Qwen3.5 bases (4B: 779 ms versus 174 ms on the deprecated Qwen3 checkpoint), and the planned MLX backend is not shipped.&lt;/li&gt;&#xA;&lt;li&gt;Option order can flip answers despite question isolation, training covered only 384-token states against the 8,192-token serving limit, and the single-threaded server has no authentication.&lt;/li&gt;&#xA;&lt;li&gt;Every comparison to Jev is self-run and admittedly uncontrolled, since nobody knows what Jev was trained on.&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&#xA;&lt;h2 class=&#34;relative group&#34;&gt;Pricing&#xA;    &lt;div id=&#34;pricing&#34; class=&#34;anchor&#34;&gt;&lt;/div&gt;&#xA;    &#xA;    &lt;span&#xA;        class=&#34;absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none&#34;&gt;&#xA;        &lt;a class=&#34;text-primary-300 dark:text-neutral-700 !no-underline&#34; href=&#34;#pricing&#34; aria-label=&#34;Anchor&#34;&gt;#&lt;/a&gt;&#xA;    &lt;/span&gt;&#xA;    &#xA;&lt;/h2&gt;&#xA;&lt;p&gt;Free and open: Apache-2.0 code and weights on Hugging Face, no hosted tier and no paid plan.&#xA;The real cost is hardware and training spend if you reproduce the family; the author&amp;rsquo;s logged budget was about $475 of a $500 overnight authorization on rented H100s.&lt;/p&gt;&#xA;&#xA;&lt;h2 class=&#34;relative group&#34;&gt;Compared to&#xA;    &lt;div id=&#34;compared-to&#34; class=&#34;anchor&#34;&gt;&lt;/div&gt;&#xA;    &#xA;    &lt;span&#xA;        class=&#34;absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none&#34;&gt;&#xA;        &lt;a class=&#34;text-primary-300 dark:text-neutral-700 !no-underline&#34; href=&#34;#compared-to&#34; aria-label=&#34;Anchor&#34;&gt;#&lt;/a&gt;&#xA;    &lt;/span&gt;&#xA;    &#xA;&lt;/h2&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://tomrochette.com/agents/hybrid-execution/jev/&#34; &gt;Jev&lt;/a&gt;: the closed original keeps 32k-plus context and better calibration; choose kev when the API contract matters more than those two things and you want inspectable weights you can fine-tune.&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://tomrochette.com/agents/hybrid-execution/laya/&#34; &gt;Laya&lt;/a&gt;: the other multi-checkpoint open family; Laya is encoder-scale, multilingual, and routed, while kev is decoder-scale, English-focused, and drop-in compatible with the TypeSafe SDK.&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://tomrochette.com/agents/hybrid-execution/nimble/&#34; &gt;Nimble&lt;/a&gt;: the one-day recipe with a human-labeled external benchmark suite; choose kev for the maintained server, playground, and delta fine-tuning path, Nimble for the curation method.&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&#xA;&lt;h2 class=&#34;relative group&#34;&gt;Bottom line&#xA;    &lt;div id=&#34;bottom-line&#34; class=&#34;anchor&#34;&gt;&lt;/div&gt;&#xA;    &#xA;    &lt;span&#xA;        class=&#34;absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none&#34;&gt;&#xA;        &lt;a class=&#34;text-primary-300 dark:text-neutral-700 !no-underline&#34; href=&#34;#bottom-line&#34; aria-label=&#34;Anchor&#34;&gt;#&lt;/a&gt;&#xA;    &lt;/span&gt;&#xA;    &#xA;&lt;/h2&gt;&#xA;&lt;p&gt;&lt;strong&gt;Recommended for engineers who want the System One contract running on their own hardware with a real evaluation harness, and who will fit decision thresholds on their own data rather than trusting the shipped calibration.&lt;/strong&gt;&#xA;Not for low-latency Mac serving today, for long-context states, or for anyone who needs Jev-level calibration out of the box.&#xA;The disagreeable claim I will defend: the weights are the second-most valuable artifact here, and the pre-registered, locked-test research log is the first, because it is a higher evidentiary standard than the closed vendor it replicates, and the rest of this category should be judged against it.&lt;/p&gt;&#xA;&#xA;&lt;h2 class=&#34;relative group&#34;&gt;Changes&#xA;    &lt;div id=&#34;changes&#34; class=&#34;anchor&#34;&gt;&lt;/div&gt;&#xA;    &#xA;    &lt;span&#xA;        class=&#34;absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none&#34;&gt;&#xA;        &lt;a class=&#34;text-primary-300 dark:text-neutral-700 !no-underline&#34; href=&#34;#changes&#34; aria-label=&#34;Anchor&#34;&gt;#&lt;/a&gt;&#xA;    &lt;/span&gt;&#xA;    &#xA;&lt;/h2&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;2026-09-21 - Created from the owner-prompted open-alternative scan; accepted below the 100-point HN bar on author standing, star traction, and the external-eval ecosystem.&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&#xA;&lt;h2 class=&#34;relative group&#34;&gt;See also&#xA;    &lt;div id=&#34;see-also&#34; class=&#34;anchor&#34;&gt;&lt;/div&gt;&#xA;    &#xA;    &lt;span&#xA;        class=&#34;absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none&#34;&gt;&#xA;        &lt;a class=&#34;text-primary-300 dark:text-neutral-700 !no-underline&#34; href=&#34;#see-also&#34; aria-label=&#34;Anchor&#34;&gt;#&lt;/a&gt;&#xA;    &lt;/span&gt;&#xA;    &#xA;&lt;/h2&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://tomrochette.com/agents/hybrid-execution/jev/&#34; &gt;Jev&lt;/a&gt; - the closed model whose System One API kev reimplements locally&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://tomrochette.com/agents/hybrid-execution/laya/&#34; &gt;Laya&lt;/a&gt; - the other open-weights decision family, encoder-scale and multilingual&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://tomrochette.com/agents/hybrid-execution/nimble/&#34; &gt;Nimble&lt;/a&gt; - the contrastive-curation recipe trained on Qwen3.5-9B&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://tomrochette.com/agents/hybrid-execution/hybrid-execution-feature-matrix/&#34; &gt;Hybrid Execution Feature Matrix&lt;/a&gt; - the category comparison this note joins&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://tomrochette.com/agents/model-selection-for-coding-tasks/&#34; &gt;Model Selection for Coding Tasks&lt;/a&gt; - where the planner that sits above a decision layer gets chosen&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&#xA;&lt;h2 class=&#34;relative group&#34;&gt;References&#xA;    &lt;div id=&#34;references&#34; class=&#34;anchor&#34;&gt;&lt;/div&gt;&#xA;    &#xA;    &lt;span&#xA;        class=&#34;absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none&#34;&gt;&#xA;        &lt;a class=&#34;text-primary-300 dark:text-neutral-700 !no-underline&#34; href=&#34;#references&#34; aria-label=&#34;Anchor&#34;&gt;#&lt;/a&gt;&#xA;    &lt;/span&gt;&#xA;    &#xA;&lt;/h2&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://github.com/jaredpalmer/kev&#34;  target=&#34;_blank&#34; rel=&#34;noreferrer&#34;&gt;&lt;img class=&#34;external-link-favicon&#34; src=&#34;https://www.google.com/s2/favicons?domain=github.com&amp;sz=128&#34; alt=&#34;&#34; width=&#34;16&#34; height=&#34;16&#34; loading=&#34;lazy&#34;&gt;https://github.com/jaredpalmer/kev&lt;/a&gt; - repository: Apache-2.0, created 2026-09-17, 1,347 stars, 77 forks (GitHub API, as of 2026-09-21)&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://raw.githubusercontent.com/jaredpalmer/kev/main/README.md&#34;  target=&#34;_blank&#34; rel=&#34;noreferrer&#34;&gt;&lt;img class=&#34;external-link-favicon&#34; src=&#34;https://www.google.com/s2/favicons?domain=raw.githubusercontent.com&amp;sz=128&#34; alt=&#34;&#34; width=&#34;16&#34; height=&#34;16&#34; loading=&#34;lazy&#34;&gt;https://raw.githubusercontent.com/jaredpalmer/kev/main/README.md&lt;/a&gt; - the LoRA-plus-pointer-head architecture, question isolation, eval tables against Jev, serving and training limits&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://raw.githubusercontent.com/jaredpalmer/kev/main/PLAN.md&#34;  target=&#34;_blank&#34; rel=&#34;noreferrer&#34;&gt;&lt;img class=&#34;external-link-favicon&#34; src=&#34;https://www.google.com/s2/favicons?domain=raw.githubusercontent.com&amp;sz=128&#34; alt=&#34;&#34; width=&#34;16&#34; height=&#34;16&#34; loading=&#34;lazy&#34;&gt;https://raw.githubusercontent.com/jaredpalmer/kev/main/PLAN.md&lt;/a&gt; - the pre-registered research log: gap table to Jev, locked-test discipline, the $475-of-$500 budget&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://news.ycombinator.com/item?id=49783999&#34;  target=&#34;_blank&#34; rel=&#34;noreferrer&#34;&gt;&lt;img class=&#34;external-link-favicon&#34; src=&#34;https://www.google.com/s2/favicons?domain=news.ycombinator.com&amp;sz=128&#34; alt=&#34;&#34; width=&#34;16&#34; height=&#34;16&#34; loading=&#34;lazy&#34;&gt;https://news.ycombinator.com/item?id=49783999&lt;/a&gt; - the launch thread (about 30 points, 16 comments as of 2026-09-21), its use-case confusion and bandwagon skepticism the critical signals&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://huggingface.co/collections/jaredpalmer/kev-6aad9d0ea49f2589665e07cd&#34;  target=&#34;_blank&#34; rel=&#34;noreferrer&#34;&gt;&lt;img class=&#34;external-link-favicon&#34; src=&#34;https://www.google.com/s2/favicons?domain=huggingface.co&amp;sz=128&#34; alt=&#34;&#34; width=&#34;16&#34; height=&#34;16&#34; loading=&#34;lazy&#34;&gt;https://huggingface.co/collections/jaredpalmer/kev-6aad9d0ea49f2589665e07cd&lt;/a&gt; - the weight collection; kev-4b created 2026-09-19, Apache-2.0, 170 downloads (as of 2026-09-21)&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://github.com/TheoLeeCJ/SemIf&#34;  target=&#34;_blank&#34; rel=&#34;noreferrer&#34;&gt;&lt;img class=&#34;external-link-favicon&#34; src=&#34;https://www.google.com/s2/favicons?domain=github.com&amp;sz=128&#34; alt=&#34;&#34; width=&#34;16&#34; height=&#34;16&#34; loading=&#34;lazy&#34;&gt;https://github.com/TheoLeeCJ/SemIf&lt;/a&gt; - the independent 144-decision test set (2,680 stars) whose live-Jev results kev converts and scores against&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://github.com/scienthoon/jev-ood-calibration&#34;  target=&#34;_blank&#34; rel=&#34;noreferrer&#34;&gt;&lt;img class=&#34;external-link-favicon&#34; src=&#34;https://www.google.com/s2/favicons?domain=github.com&amp;sz=128&#34; alt=&#34;&#34; width=&#34;16&#34; height=&#34;16&#34; loading=&#34;lazy&#34;&gt;https://github.com/scienthoon/jev-ood-calibration&lt;/a&gt; - the independent 900-ticket Jev calibration whose test set appears in kev&amp;rsquo;s external evals&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://archerhume.com/posts/jevs-architecture-unmasked&#34;  target=&#34;_blank&#34; rel=&#34;noreferrer&#34;&gt;&lt;img class=&#34;external-link-favicon&#34; src=&#34;https://www.google.com/s2/favicons?domain=archerhume.com&amp;sz=128&#34; alt=&#34;&#34; width=&#34;16&#34; height=&#34;16&#34; loading=&#34;lazy&#34;&gt;https://archerhume.com/posts/jevs-architecture-unmasked&lt;/a&gt; - the architecture write-up kev credits for the design&lt;/li&gt;&#xA;&lt;li&gt;&lt;a href=&#34;https://github.com/jaredpalmer&#34;  target=&#34;_blank&#34; rel=&#34;noreferrer&#34;&gt;&lt;img class=&#34;external-link-favicon&#34; src=&#34;https://www.google.com/s2/favicons?domain=github.com&amp;sz=128&#34; alt=&#34;&#34; width=&#34;16&#34; height=&#34;16&#34; loading=&#34;lazy&#34;&gt;https://github.com/jaredpalmer&lt;/a&gt; - the author&amp;rsquo;s profile grounding the Turborepo and Cognition standing&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;</description>
      
    </item>
    
  </channel>
</rss>
