Skip to content

Speculative Decoding for VLM - #199

Merged
SearchSavior merged 1 commit into
SearchSavior:mainfrom
WizardlyBump17:vlm-spec-decode
Nov 10, 2026
Merged

SearchSavior merged 1 commit into
SearchSavior:mainfrom
WizardlyBump17:vlm-spec-decode

Conversation

@WizardlyBump17

Copy link
Copy Markdown
Contributor

This Pull Request adds support for Speculative Decoding on VLM. It copies the code from the LLM path.

Closes #187.

The code was generated by Qwen3.8 27B, with the maki harness, but I used AI just for fun. I would have written the same code

@SearchSavior
SearchSavior merged commit c170ec5 into SearchSavior:main Nov 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Speculative decoding for VLM

2 participants