Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 10} ************************************** ##### TRAIN RESULT ##### ************************************** Detailed Results: {'test_score': 0.8995633187772925} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ##### EVALUATION RESULT ##### : F1 Score: 0.9696969696969697 ************************************** Detailed Results: Results: - F-score (micro) 0.9697 - F-score (macro) 0.9167 - Accuracy 0.9412 By class: precision recall f1-score support HALFREFERENCE 1.0000 1.0000 1.0000 8 REFERENCE 1.0000 1.0000 1.0000 4 DATE2 1.0000 1.0000 1.0000 3 ORG 1.0000 0.5000 0.6667 2 micro avg 1.0000 0.9412 0.9697 17 macro avg 1.0000 0.8750 0.9167 17 weighted avg 1.0000 0.9412 0.9608 17 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.907103825136612} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of rangeModel Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.719626168224299} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 14:20:17.700674Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9171270718232044} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 14:30:04.072977Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.962962962962963} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 14:53:45.063574Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 20} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9497206703910613} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 15:12:48.744802 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 16, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.8921568627450982} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 15:23:25.769254 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9343065693430657} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 15:32:39.657143 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 12, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.8851063829787235} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 15:43:35.519154 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 32, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9052631578947369} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 15:49:09.873440 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 6, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.98} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 15:59:25.387981 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 6, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.8837209302325582} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 16:38:10.468859 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 12} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9729729729729729} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 16:47:37.740609 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 12} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9398907103825136} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 16:55:56.403584 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: m3hrdadfi/albert-fa-base-v2-ner-arman Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 12} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.8735632183908046} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 17:43:41.083857 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: m3hrdadfi/albert-fa-base-v2-ner-arman Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 12} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9042553191489362} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 18:09:08.697285 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: m3hrdadfi/albert-fa-base-v2-ner-arman Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9028571428571429} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 18:20:23.282609 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: m3hrdadfi/albert-fa-base-v2-ner-arman Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9405405405405404} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 18:36:30.826433 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: m3hrdadfi/albert-fa-base-v2-ner-arman Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 8} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9485714285714285} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 18:39:04.991808 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-ner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9390243902439025} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-13 18:43:01.417468 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-ner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9353233830845772} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-14 16:01:43.889299 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-ner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 16, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9447852760736196} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-14 16:06:15.960762 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-ner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 16, 'max_epochs': 20} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9506172839506174} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-14 16:13:35.242133 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: SeyedAli/Persian-Text-NER-Bert-V1 Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.8844221105527638} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-14 16:17:46.734679 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: SeyedAli/Persian-Text-NER-Bert-V1 Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 20} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9437229437229437} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-14 16:22:41.367834 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: SeyedAli/Persian-Text-NER-Bert-V1 Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 16, 'max_epochs': 20} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9479166666666666} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-14 16:35:50.363859 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-peymaner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9206349206349206} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-20 14:54:21.327027 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-peymaner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9353612167300379} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-20 15:02:00.985544 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-peymaner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9583333333333333} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-20 15:07:29.680394 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-ner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9506726457399104} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-20 15:14:11.706764 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-ner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.918918918918919} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-20 15:28:23.803101 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-ner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.883720930232558} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-20 15:39:42.865403 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-armanner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9333333333333333} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-20 15:45:35.658898 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-armanner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 20} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9488372093023255} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-20 16:42:12.175475 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-armanner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 32, 'max_epochs': 20} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9556650246305419} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-20 17:25:16.876355 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-armanner-uncased Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 32, 'max_epochs': 200} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9353233830845772} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-20 17:50:49.631962 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 12} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.8785046728971964} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-23 18:08:49.480591 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-06, 'mini_batch_size': 10, 'max_epochs': 12} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.26347305389221554} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-23 18:14:41.907116 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-06, 'mini_batch_size': 10, 'max_epochs': 12} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.0} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-23 18:34:47.347759 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-06, 'mini_batch_size': 8, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.4615384615384615} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-23 18:42:27.693642 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-06, 'mini_batch_size': 16, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.0} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-23 18:53:33.558720 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-06, 'mini_batch_size': 10, 'max_epochs': 100} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9518716577540107} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-23 19:21:42.996315 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9467455621301776} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-26 17:04:17.864518 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9243697478991597} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-26 17:18:06.704607 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9437229437229439} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-26 18:12:24.663370 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4.5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9454545454545454} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-26 18:45:26.049433 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 3e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.7979797979797979} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-26 19:11:15.071737 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 3.5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9237668161434978} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-26 19:16:51.060790 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 2.5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9054726368159204} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-26 19:53:33.662038 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 200} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9405940594059405} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-27 18:38:49.481691 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9175257731958764} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-27 19:17:09.646030 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.925531914893617} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-27 19:24:12.128002 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9308755760368663} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-27 19:29:56.713375 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9775280898876404} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-27 19:59:57.584313 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9090909090909092} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-27 20:13:06.303131 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9577464788732394} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-27 20:34:49.048358 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 400} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9625000000000001} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-27 22:41:34.910956 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: HooshvareLab/bert-base-parsbert-ner-uncased Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9255319148936171} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-28 16:42:17.534797 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: SeyedAli/Persian-Text-NER-Bert-V1 Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9664429530201343} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-28 17:03:55.570389 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: SeyedAli/Persian-Text-NER-Bert-V1 Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9367088607594938} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-29 18:43:34.704819 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.949771689497717} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-29 18:51:44.884963 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 16, 'max_epochs': 15} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.8771929824561403} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-29 19:04:33.373777 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9090909090909091} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-29 19:19:18.591564 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9767441860465117} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-29 19:24:46.284129 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 5e-05, 'mini_batch_size': 10, 'max_epochs': 10} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9651162790697675} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-29 19:31:06.402094 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: orgcatorg/xlm-v-base-ner Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 200} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.963302752293578} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ do_evaluate function failed! error massage: list index out of range Fine_Tune time: 2024-05-29 21:16:34.328232 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: pourmand1376/NER_Farsi Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 50} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9090909090909091} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ##### EVALUATION RESULT ##### F1 Score: 0.9696969696969697 ************************************************ Detailed Results: Results: - F-score (micro) 0.9697 - F-score (macro) 0.9167 - Accuracy 0.9412 By class: precision recall f1-score support HALFREFERENCE 1.0000 1.0000 1.0000 8 REFERENCE 1.0000 1.0000 1.0000 4 DATE2 1.0000 1.0000 1.0000 3 ORG 1.0000 0.5000 0.6667 2 micro avg 1.0000 0.9412 0.9697 17 macro avg 1.0000 0.8750 0.9167 17 weighted avg 1.0000 0.9412 0.9608 17 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Fine_Tune time: 2024-07-20 17:36:35.398199 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------ Model Name: pourmand1376/NER_Farsi Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 200} ************************************************ ##### TRAIN RESULT ##### F1 Score: {'test_score': 0.9015544041450776} ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ##### EVALUATION RESULT ##### F1 Score: 0.9696969696969697 ************************************************ Detailed Results: Results: - F-score (micro) 0.9697 - F-score (macro) 0.9167 - Accuracy 0.9412 By class: precision recall f1-score support HALFREFERENCE 1.0000 1.0000 1.0000 8 REFERENCE 1.0000 1.0000 1.0000 4 DATE2 1.0000 1.0000 1.0000 3 ORG 1.0000 0.5000 0.6667 2 micro avg 1.0000 0.9412 0.9697 17 macro avg 1.0000 0.8750 0.9167 17 weighted avg 1.0000 0.9412 0.9608 17 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Fine_Tune time: 2024-07-20 19:35:34.746072 ------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------