Public View
Suggest
Download this page (.md) Download entire wiki (.zip)
Clone entire wiki

ACL2025 Li: TokAlign Token Alignment

Method to adapt tokenization across models.
Notable Methods use pairwise cosine similarity between token embeddings to create a grid of alignment initialize new adapted embeddings for each id’s most similar tokens tune

Page updated