Unverified Commit 115ac94d authored by Arthur's avatar Arthur Committed by GitHub
Browse files

[`Core generation`] Adds support for static KV cache (#27931)


Co-authored-by: default avatarfxmarty <9808326+fxmarty@users.noreply.github.com>
Co-authored-by: default avatarYounes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: default avatarJoao Gante <joaofranciscocardosogante@gmail.com>
parent 4b236aed
Showing with 473 additions and 231 deletions
+473 -231
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment