§ llama · storyline
NVIDIA Introduces X-Token: Projection-Guided Cross-Tokenizer KD
NVIDIA introduces X-Token, a projection-guided cross-tokenizer knowledge distillation method designed to improve performance on smaller models such as Llama-3.2-1B.
NVIDIA researchers introduced X-Token, a projection-guided cross-tokenizer knowledge distillation method that improves performance on smaller models like Llama-3.2-1B.
§ sources1 publication · timeline below