Flair_NER/data/train_log.txt

1128 lines
40 KiB
Plaintext
Raw Normal View History

2024-09-18 16:35:06 +00:00
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 10}
**************************************
##### TRAIN RESULT #####
**************************************
Detailed Results: {'test_score': 0.8995633187772925}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
##### EVALUATION RESULT ##### :
F1 Score: 0.9696969696969697
**************************************
Detailed Results:
Results:
- F-score (micro) 0.9697
- F-score (macro) 0.9167
- Accuracy 0.9412
By class:
precision recall f1-score support
HALFREFERENCE 1.0000 1.0000 1.0000 8
REFERENCE 1.0000 1.0000 1.0000 4
DATE2 1.0000 1.0000 1.0000 3
ORG 1.0000 0.5000 0.6667 2
micro avg 1.0000 0.9412 0.9697 17
macro avg 1.0000 0.8750 0.9167 17
weighted avg 1.0000 0.9412 0.9608 17
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.907103825136612}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of rangeModel Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.719626168224299}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 14:20:17.700674Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9171270718232044}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 14:30:04.072977Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.962962962962963}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 14:53:45.063574Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 20}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9497206703910613}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 15:12:48.744802
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 16, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.8921568627450982}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 15:23:25.769254
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9343065693430657}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 15:32:39.657143
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 12, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.8851063829787235}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 15:43:35.519154
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 32, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9052631578947369}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 15:49:09.873440
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 6, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.98}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 15:59:25.387981
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 6, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.8837209302325582}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 16:38:10.468859
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 12}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9729729729729729}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 16:47:37.740609
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 12}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9398907103825136}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 16:55:56.403584
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: m3hrdadfi/albert-fa-base-v2-ner-arman
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 12}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.8735632183908046}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 17:43:41.083857
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: m3hrdadfi/albert-fa-base-v2-ner-arman
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 12}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9042553191489362}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 18:09:08.697285
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: m3hrdadfi/albert-fa-base-v2-ner-arman
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9028571428571429}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 18:20:23.282609
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: m3hrdadfi/albert-fa-base-v2-ner-arman
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9405405405405404}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 18:36:30.826433
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: m3hrdadfi/albert-fa-base-v2-ner-arman
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 8}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9485714285714285}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 18:39:04.991808
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-ner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9390243902439025}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-13 18:43:01.417468
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-ner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9353233830845772}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-14 16:01:43.889299
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-ner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 16, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9447852760736196}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-14 16:06:15.960762
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-ner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 16, 'max_epochs': 20}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9506172839506174}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-14 16:13:35.242133
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: SeyedAli/Persian-Text-NER-Bert-V1
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.8844221105527638}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-14 16:17:46.734679
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: SeyedAli/Persian-Text-NER-Bert-V1
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 20}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9437229437229437}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-14 16:22:41.367834
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: SeyedAli/Persian-Text-NER-Bert-V1
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 16, 'max_epochs': 20}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9479166666666666}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-14 16:35:50.363859
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-peymaner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9206349206349206}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-20 14:54:21.327027
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-peymaner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9353612167300379}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-20 15:02:00.985544
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-peymaner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9583333333333333}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-20 15:07:29.680394
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-ner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9506726457399104}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-20 15:14:11.706764
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-ner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.918918918918919}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-20 15:28:23.803101
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-ner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.883720930232558}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-20 15:39:42.865403
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-armanner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9333333333333333}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-20 15:45:35.658898
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-armanner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 8, 'max_epochs': 20}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9488372093023255}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-20 16:42:12.175475
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-armanner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 32, 'max_epochs': 20}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9556650246305419}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-20 17:25:16.876355
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-armanner-uncased
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 32, 'max_epochs': 200}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9353233830845772}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-20 17:50:49.631962
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 12}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.8785046728971964}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-23 18:08:49.480591
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-06, 'mini_batch_size': 10, 'max_epochs': 12}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.26347305389221554}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-23 18:14:41.907116
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-06, 'mini_batch_size': 10, 'max_epochs': 12}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.0}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-23 18:34:47.347759
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-06, 'mini_batch_size': 8, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.4615384615384615}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-23 18:42:27.693642
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-06, 'mini_batch_size': 16, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.0}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-23 18:53:33.558720
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-06, 'mini_batch_size': 10, 'max_epochs': 100}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9518716577540107}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-23 19:21:42.996315
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9467455621301776}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-26 17:04:17.864518
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9243697478991597}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-26 17:18:06.704607
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9437229437229439}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-26 18:12:24.663370
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4.5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9454545454545454}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-26 18:45:26.049433
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 3e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.7979797979797979}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-26 19:11:15.071737
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 3.5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9237668161434978}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-26 19:16:51.060790
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 2.5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9054726368159204}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-26 19:53:33.662038
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 200}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9405940594059405}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-27 18:38:49.481691
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9175257731958764}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-27 19:17:09.646030
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.925531914893617}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-27 19:24:12.128002
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9308755760368663}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-27 19:29:56.713375
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9775280898876404}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-27 19:59:57.584313
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9090909090909092}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-27 20:13:06.303131
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9577464788732394}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-27 20:34:49.048358
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 400}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9625000000000001}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-27 22:41:34.910956
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: HooshvareLab/bert-base-parsbert-ner-uncased
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9255319148936171}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-28 16:42:17.534797
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: SeyedAli/Persian-Text-NER-Bert-V1
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9664429530201343}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-28 17:03:55.570389
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: SeyedAli/Persian-Text-NER-Bert-V1
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9367088607594938}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-29 18:43:34.704819
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 8, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.949771689497717}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-29 18:51:44.884963
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 16, 'max_epochs': 15}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.8771929824561403}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-29 19:04:33.373777
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9090909090909091}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-29 19:19:18.591564
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 6.5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9767441860465117}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-29 19:24:46.284129
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 5e-05, 'mini_batch_size': 10, 'max_epochs': 10}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9651162790697675}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-29 19:31:06.402094
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: orgcatorg/xlm-v-base-ner
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 200}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.963302752293578}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
do_evaluate function failed!
error massage:
list index out of range
Fine_Tune time: 2024-05-29 21:16:34.328232
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: pourmand1376/NER_Farsi
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 50}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9090909090909091}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
##### EVALUATION RESULT #####
F1 Score: 0.9696969696969697
************************************************
Detailed Results:
Results:
- F-score (micro) 0.9697
- F-score (macro) 0.9167
- Accuracy 0.9412
By class:
precision recall f1-score support
HALFREFERENCE 1.0000 1.0000 1.0000 8
REFERENCE 1.0000 1.0000 1.0000 4
DATE2 1.0000 1.0000 1.0000 3
ORG 1.0000 0.5000 0.6667 2
micro avg 1.0000 0.9412 0.9697 17
macro avg 1.0000 0.8750 0.9167 17
weighted avg 1.0000 0.9412 0.9608 17
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Fine_Tune time: 2024-07-20 17:36:35.398199
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Model Name: pourmand1376/NER_Farsi
Fine-Tune Parameters: {'learning_rate': 4e-05, 'mini_batch_size': 10, 'max_epochs': 200}
************************************************
##### TRAIN RESULT #####
F1 Score: {'test_score': 0.9015544041450776}
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
##### EVALUATION RESULT #####
F1 Score: 0.9696969696969697
************************************************
Detailed Results:
Results:
- F-score (micro) 0.9697
- F-score (macro) 0.9167
- Accuracy 0.9412
By class:
precision recall f1-score support
HALFREFERENCE 1.0000 1.0000 1.0000 8
REFERENCE 1.0000 1.0000 1.0000 4
DATE2 1.0000 1.0000 1.0000 3
ORG 1.0000 0.5000 0.6667 2
micro avg 1.0000 0.9412 0.9697 17
macro avg 1.0000 0.8750 0.9167 17
weighted avg 1.0000 0.9412 0.9608 17
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Fine_Tune time: 2024-07-20 19:35:34.746072
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------