Metraipolis › archive › dc_93021d09754d

AKTS: Sub-Microsecond Kernel Policy Switching for Language-Model Agents — arXiv:2609.12276

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.12276
License (as archived)
CC0-1.0
Archived
2026-10-16T04:00:40.209Z
SHA-256 of the archived text
d5b28ac48c97ed6081abf5d56aaf89816f9587bd7edc3e8ea5b62bb90cad7988
Stable URL of this page
https://metraipolis.com/documento/dc_93021d09754d

How to cite

AKTS: Sub-Microsecond Kernel Policy Switching for Language-Model Agents — arXiv:2609.12276 — arXiv (en), https://arxiv.org/abs/2609.12276 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_93021d09754d (Metraipolis archive dc_93021d09754d, sha256 d5b28ac48c97ed6081abf5d56aaf89816f9587bd7edc3e8ea5b62bb90cad7988)
BibTeX
@misc{dc93021d09754d,
  title = {AKTS: Sub-Microsecond Kernel Policy Switching for Language-Model Agents — arXiv:2609.12276},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.12276},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_93021d09754d; sha256 d5b28ac48c97ed6081abf5d56aaf89816f9587bd7edc3e8ea5b62bb90cad7988},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.12276. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

GPU-backed LLM servers multiplex interactive requests with background batch work on the same CPUs; a fixed kernel policy serves one objective and loses the other, so agentic OS control needs to switch scheduler behavior as the workload changes. The hard part is applying the switch safely and fast enough for the kernel: scheduler events occur every 1-10 $\mu$s, and any code running there must satisfy the eBPF verifier. Scalar knobs are fast but limited, while generating eBPF policy code puts compilation, verification and possible rejection on the runtime path. We present AKTS, which verifies a policy library once, at load time, and reduces the agent's runtime action to writing an integer index into an in-kernel array of preverified policies, resolved by a tail call. Because the agent emits an index rather than code, verifier failure is not a runtime outcome. On Linux 6.14, AKTS applies a policy switch in 920 ns (p50); makes an invalid index inert across 60,217 invocations on an attached scheduler; and switches policies in a vLLM workload to capture 97% of a throughput policy's batch work while matching a latency policy's burst response.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-09-14 in cs.OS).
Categorie arXiv: Operating Systems (cs.OS).
Pagina del lavoro: https://arxiv.org/abs/2609.12276 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T03:53:35.361Z dalla pagina https://arxiv.org/catchup/cs.OS/2026-09-14?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).