important tokenizers based on mothly report of huggingface models

This commit is contained in:
ajokar 2025-08-11 15:05:22 +03:30
parent 0c2d07892e
commit 20f42d5346

1
important_tokenizers.txt Normal file
View File

@ -0,0 +1 @@
facebook/xlm-v-base