Commit 851cce6
committed
Override get_input_embeddings in Eagle3 to process text-only inputs
Implement custom get_input_embeddings() in Eagle3LlamaForCausalLM that
accepts multimodal parameters but only processes text embeddings. This
ensures the Llama3-based Eagle3 drafter correctly handles text inputs
while remaining compatible with multimodal verifier interfaces.
The drafter receives multimodal context through auxiliary hidden states
from the verifier rather than processing multimodal inputs directly.1 parent 936ad29 commit 851cce6
1 file changed
+9
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
20 | 20 | | |
21 | 21 | | |
22 | 22 | | |
| 23 | + | |
23 | 24 | | |
24 | 25 | | |
25 | 26 | | |
| |||
242 | 243 | | |
243 | 244 | | |
244 | 245 | | |
245 | | - | |
246 | | - | |
| 246 | + | |
| 247 | + | |
| 248 | + | |
| 249 | + | |
| 250 | + | |
| 251 | + | |
| 252 | + | |
| 253 | + | |
247 | 254 | | |
248 | 255 | | |
249 | 256 | | |
| |||
0 commit comments