Skip to content
  • Dchord's avatar
    vLLM 0.18.1 Qwen3.5-27B DCU optimization submission · 85446e51
    Dchord authored
    
    
    Optimizations:
    - xxHash128 batch hashing with struct.pack (kv_cache_utils.py)
    - LRU hash cache expanded to 16384 entries for long context
    - AITER unified attention + FP8 MFMA paged attention env vars
    - Block size 64 optimal for AITER backend
    - CUDA Graph capture sizes pruned to [1,2]
    
    Build: bash build_vllm.sh
    
    Co-Authored-By: default avatarClaude <noreply@anthropic.com>
    85446e51
This project is licensed under the Apache License 2.0. Learn more