Skip to content

Pull requests: alibaba/rtp-llm

New pull request New
58 Open 265 Closed
58 Open 265 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: add process-isolated logging with rank_id and server_id
#436 opened Dec 5, 2025 by sunmiaozju Loading…
Feature/refactor modules
#435 opened Dec 5, 2025 by alibaba-miji Loading…
fix: modify pre_decoder_residual under multimodalEmbedding input
#433 opened Dec 5, 2025 by junna2016 Loading…
4
[draft]feat: refactor raw endpoint
#431 opened Dec 4, 2025 by wanglining97 Loading…
[draft] master 0.0.2
#427 opened Dec 4, 2025 by jianglan89 Loading…
2
fix: wrong residual when pre decoder layernorm + mm embedding + quant
#426 opened Dec 4, 2025 by LLLLKKKK Loading…
1
feat: support pure tp + ep for cuda graph
#425 opened Dec 3, 2025 by JackTan25 Loading…
7
fix - backend server not shutdown graceful in mulit rank case
#424 opened Dec 3, 2025 by jianglan89 Loading…
support fp8 fmha for rocm pymodel
#422 opened Dec 3, 2025 by liaocz Loading…
1
feat: support return raw prompt and input ids by parameters
#421 opened Dec 2, 2025 by soaringk Loading…
3
refactor: optimize token reorder impl
#419 opened Dec 2, 2025 by MMadhatter Loading…
feature - add viztracer for inference api
#417 opened Dec 2, 2025 by jianglan89 Loading…
2
Support DeepSeek v3.2 encoding module
#415 opened Dec 2, 2025 by soaringk Loading…
5
refactor gemm
#414 opened Dec 1, 2025 by fff-2013 Loading…
feat: optimize prefill invokeAddFusedQKVBiasTranspose
#413 opened Nov 29, 2025 by Bruce-Lee-LY Loading…
41
fix: fix max context batch size
#412 opened Nov 28, 2025 by JackTan25 Loading…
Performance Optimization for Beam Search
#411 opened Nov 28, 2025 by zhangjianning-zjn Loading…
fix: hold host buffer util next forward
#410 opened Nov 28, 2025 by Vinkle-hzt Loading…
2
feat: handle cuda oom error for py model
#406 opened Nov 26, 2025 by MMadhatter Loading…
fix: fix custom_ar bug for rocm
#402 opened Nov 25, 2025 by liaocz Loading…
8
feat: update ar & fuse mla reuse cache
#399 opened Nov 25, 2025 by Nancheng-11 Loading…
fix: remove fallback and fastgen
#393 opened Nov 24, 2025 by xinfei-shi Loading…
10
fix bug: insert to cache only when stream's kv cache is computed
#391 opened Nov 24, 2025 by xinfei-shi Loading…
19
feat: raw request support logprobs
#390 opened Nov 22, 2025 by yinjuncheng Loading…
2
feat: support long seq when pdfusion
#387 opened Nov 20, 2025 by kitaharatomoyo Loading…
ProTip! Updated in the last three days: updated:>2025-12-03.