important tokenizers update

This commit is contained in:
ajokar 2025-08-12 15:09:25 +03:30
parent 20f42d5346
commit 5513c211df

View File

@ -1 +1,3 @@
facebook/xlm-v-base facebook/xlm-v-base
sharif-dal/dal-bert
lifeweb-ai/shiraz