o hQ @sdZddlmZddlZddlmZmZmZmZej j ej j gZ ej ddZej ddZd d d Zd d d Zd d d ZddZddZddZddZddZdS)z< Test a couple simple confusion matrices and output formats  defaultdictN)format_confusionconfusion_to_f1confusion_to_macro_f1confusion_to_weighted_f1cCsLtdd}d|dd<d|dd<d|dd<d|dd<d|d d <|S) NcSttSNrintr r ]/var/www/html/env_mimamsha/lib/python3.10/site-packages/stanza/tests/common/test_confusion.pyz"simple_confusion..B-ORGB-PERE-ORGE-PEROr confusionr r r simple_confusion s      rcCsLtdd}d|dd<d|dd<d|dd<d|dd<d |d d <|S) zV Same thing, but with a short name. This should not be sorted by entity type cSrr r r r r r rrz!short_confusion..rArrrrrrrrr r r short_confusions      rz t\p O B-ORG E-ORG B-PER E-PER O 4 0 0 0 0 B-ORG 0 1 0 1 0 E-ORG 0 0 1 0 1 B-PER 0 0 0 0 0 E-PER 0 0 0 0 0 raC t\p O A B-ORG B-PER E-ORG E-PER O 4 0 0 0 0 0 A 0 0 1 0 0 0 B-ORG 0 0 0 1 0 0 B-PER 0 0 0 0 0 0 E-ORG 0 0 0 0 1 1 E-PER 0 0 0 0 0 0 z t\p O B-ORG E-ORG B-PER E-PER O 4 0 0 0 0 A 0 1 0 0 0 B-ORG 0 0 0 1 0 E-ORG 0 0 1 0 1 cCtt|ksJdSr )EXPECTED_SIMPLE_OUTPUTr)rr r r test_simple_output>rcCrr )EXPECTED_SHORT_OUTPUTrrr r r test_short_outputAr r#cCstt|ddks JdS)NT) hide_blank) EXPECTED_HIDE_BLANK_SHORT_OUTPUTrr"r r r test_hide_blank_short_outputDsr&cCs0t|tdks Jt|tdksJdS)Ng?gq?)rpytestapproxrrr r r test_macro_f1Gsr*cCsht|tdks Jt|tdksJt|dgdtdks$Jt|dgdtdks2JdS)Ngmਪ?gQUU?r)excludegQUU?)rr'r(r)r r r test_weighted_f1Ks r,)__doc__ collectionsrr'stanza.utils.confusionrrrrmarktravispipeline pytestmarkfixturerrrr!r%rr#r&r*r,r r r r s.