#35588 [Bugfix] Fix full prefill CUDA graph padding and EAGLE capture
实现拆解
-
核心源码路径
-python/sglang/srt/model_executor/runner/prefill_cuda_graph_runner.py(data-contract):源码主路径;包含 控制流调整、配置键调整;+15/-6
-python/sglang/srt/model_executor/cuda_graph_buffer_registry.py(data-contract):源码主路径;包含 控制流调整、配置键调整;+12/-7
-python/sglang/srt/model_executor/model_runner_components/cuda_graph_setup.py(data-contract):源码主路径;+4/-4;以 data-contract 为主 -
测试与验证
-test/registered/cuda_graph/full_prefill/test_full_cuda_graph_prefill.py(test-coverage):测试配套;涉及符号 _prefill_graph_count, TestFullCudaGraphPrefillWithEagle3, test_eagle_target_prefill_replays_full_cuda_graph;包含 测试覆盖调整、导入关系调整、配置键调整;+67/-5;关键符号:_prefill_graph_count, TestFullCudaGraphPrefillWithEagle3, test_eagle_target_prefill_replays_full_cuda_graph
-test/registered/unit/model_executor/test_prefill_cuda_graph_runner.py(test-coverage):测试配套;涉及符号 test_eagle_target_full_reaches_graph_construction;包含 测试覆盖调整、配置键调整、符号定义调整;+39/-12;关键符号:test_eagle_target_full_reaches_graph_construction
-test/registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_hybrid_bitexact.py(test-coverage):测试配套;涉及符号 _base_args, _prefill_graph_count;包含 测试覆盖调整、导入关系调整、配置键调整;+30/-3;关键符号:_base_args, _prefill_graph_count
| 文件 | 模块 | 状态 | 重要度 |
|---|---|---|---|
test/registered/cuda_graph/full_prefill/test_full_cuda_graph_prefill.py |
full/cuda/graph/prefill | modified | 6.86 |
python/sglang/srt/model_executor/runner/prefill_cuda_graph_runner.py |
sglang/srt | modified | 6.53 |
python/sglang/srt/model_executor/cuda_graph_buffer_registry.py |
sglang/srt | modified | 6.49 |
test/registered/unit/model_executor/test_prefill_cuda_graph_runner.py |
prefill/cuda/graph/runner | modified | 6.32 |
test/registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_hybrid_bitexact.py |
unified/radix/cache/kl/hybrid/bitexact | modified | 6.13 |
分析完成后,这里会展示 LLM 生成的相对完整源码片段和详细注释。
评论区精华
没有提炼出高价值讨论线程
当前评论区没有形成足够清晰的争议点或结论,后续有更多讨论时会体现在这里。
风险与影响
关联 Issue
未识别关联 Issue
当前没有检测到明确关联的 Issue 链接,后续同步到相关引用后会出现在这里。
参与讨论