All pull requests

Pull requests

• [TRTLLM-17151][fix] Apply the logit transform and sliding window DFlash drafters declare

  #21367·moraxu opened Oct 31, 2026Collaborator·1 task done·

  ·
  3

  

• [#20988][fix] Bound per-request video decode memory in trtllm-serve

  #21366·CrstalLi02 opened Oct 30, 2026·1 task done·

  ·
  1

  4

  

• [TRTLLM-17360][feat] Add Beam StairCase production components

  #21365·Mgluhovskoi opened Oct 30, 2026Collaborator·

  ·
  

• [None][fix] Muse modeling_v2: half-window early expert ids on Vera Rubin, and context_kv_fork under KV cache estimation

  #21364·zheyuf opened Oct 30, 2026Collaborator·1 task done·

  ·
  3

  

• [None][feat] MiniMax-M3: host drafter layers in the hybrid KV cache manager

  #21363·pranav-nvidia opened Oct 30, 2026Contributor·1 task done·

  ·
  3

  

• [#21361][perf] Notify idle MPI followers before request broadcast

  #21362·skhasawneh opened Oct 30, 2026·1 task done·

  ·
  

• [None][infra] Update getPLCRepoUrlKey

  ci: full pre-merge approved
  #21360·yuanjingx87 opened Oct 30, 2026Collaborator·1 task done·

  ·
  4

  

• [#21358][perf] Use blocking CUDA events for sampler host waits

  #21359·skhasawneh opened Oct 30, 2026·1 task done·

  ·

• [https://nvbugs/7007647][test] Relax MXFP8 refit logit-overlap threshold to 0.85

  ci: full pre-merge approved
  #21357·hchings opened Oct 30, 2026Collaborator·

  ·
  7

  

• [TRTLLM-17146][feat] Add the Muse Spark Open decoder fast paths

  #21356·moraxu opened Oct 30, 2026Collaborator·1 task done·

  ·
  7

  

• [https://nvbugs/6888945][fix] Use TRTLLM-generated FastWan LPIPS golden

  VisualGen
  #21355·yibinl-nvidia opened Oct 30, 2026Collaborator·1 task done·

  ·
  

• [None][chore] Refresh PrimTS source onto FlashInfer main (2026-10-30)

  #21354·yuxianq opened Oct 30, 2026Collaborator·2 of 8 tasks·

  ·
  5

  

• [TRTLLM-16288][feat] Integrate sparse KV offload for DeepSeek-V4 Flash and GLM5.2 on KVCM2

  api-compatible
  #21350·cascade812 opened Oct 30, 2026Collaborator·1 task done·

  ·
  9

  

• [None][test] Run session-reuse unit tests in CPU CI

  #21349·aswinvisva opened Oct 30, 2026Collaborator·1 task done·

  ·
  4

  

• [None][feat] Add LLM API example to measure startup time

  #21348·yijingl-nvidia opened Oct 30, 2026Collaborator·1 task·

  ·
  

• [https://nvbugs/6908161][fix] Bootstrap NCCL EP from the torch EP group under Ray

  #21347·nv-lschneider opened Oct 30, 2026Collaborator·1 task done·

  ·
  1

  1

  

• [None][fix] Qwen3.8-Flash-Next: mask FP8 PLE rows by bytes under attention DP

  Community want to contribute
  #21346·Muchuan-Jin opened Oct 30, 2026·3 of 4 tasks·

  ·
  6

  

• [None][fix] Isolate modeling_v2 tests and scope shared test state

  ci: full pre-merge approved
  #21345·litaotju opened Oct 30, 2026Collaborator·1 task done·

  ·
  17

  

• [None][fix] Warmup: no generation shapes on a context-only KV cache

  #21343·longlee0622 opened Oct 30, 2026Collaborator·

  ·
  1

  

• [None][fix] KDA Small-BH prefill: 64-bit state-pool row stride

  #21342·longlee0622 opened Oct 30, 2026Collaborator·

  ·
  2

  

• [#21318][fix] Drop streamed stop-word ids from the final streamed text

  Community want to contribute
  #21341·spped2000 opened Oct 30, 2026·1 task done·

  ·
  1

  4

  

• [#21317][fix] trtllm-bench: fall back to system memory when NVML memory query is not supported

  Community want to contribute
  #21340·spped2000 opened Oct 30, 2026·1 task done·

  ·
  1

  1

  

• [None][chore] Reject per-layer KV-head configs in the generic HF weight mapper

  #21339·lfr-0531 opened Oct 30, 2026Collaborator·1 task done·

  ·
  4

  

• [https://nvbugs/6226287][fix] Pick EOS handling from speculative decoding in trtllm-bench and benchmark_serving

  #21338·trtllm-agent opened Oct 30, 2026Collaborator·

  ·
  9

  

• [None][refactor] Move PrimTS attention cache updates into upstream source

  #21337·yuxianq opened Oct 30, 2026Collaborator·1 task done·

  ·
  5