o
h; @ s d Z ddlZddlmZ ddlmZ ddlmZ ddlm Z g dZ
e Z e j
ded d
d e Zg ZejD ] ZeeZee W d n1 sPw Y q8g ZdZeeek r+ee Ze edk rqed ZqZee eee d Ze d Z ed Zee Ze d
Z e d dksJ de d dksJ ded Zee Ze!dsJ ded Zeeed Z"ee"dksJ ed Zdd e"D Z"e#dd e$e"e
D sJ de dd \Z%Z&ee%Z'ee Z(e( dd Z)dZ*e e% e&kr
d Z*e'd e)d e( f e%e*gd d e"D Z"e+e" eeek sag d Z,d!d e-ee,ee
ee, D Z.e,d"d e.D Z.e/eZe.ge Zd#d eD Z0e0D ]Ze1e q\dS )$a
Turn the ETE results into markdown
Parses blocks like this from the model eval script
2022-01-14 01:23:34 INFO: End to end results for af_afribooms models on af_afribooms test data:
Metric | Precision | Recall | F1 Score | AligndAcc
-----------+-----------+-----------+-----------+-----------
Tokens | 99.93 | 99.92 | 99.93 |
Sentences | 100.00 | 100.00 | 100.00 |
Words | 99.93 | 99.92 | 99.93 |
UPOS | 97.97 | 97.96 | 97.97 | 98.04
XPOS | 93.98 | 93.97 | 93.97 | 94.04
UFeats | 97.23 | 97.22 | 97.22 | 97.29
AllTags | 93.89 | 93.88 | 93.88 | 93.95
Lemmas | 97.40 | 97.39 | 97.39 | 97.46
UAS | 87.39 | 87.38 | 87.38 | 87.45
LAS | 83.57 | 83.56 | 83.57 | 83.63
CLAS | 76.88 | 76.45 | 76.66 | 76.52
MLAS | 72.28 | 71.87 | 72.07 | 71.94
BLEX | 73.20 | 72.79 | 73.00 | 72.86
Turns them into a markdown table.
Included is an attempt to mark the default packages with a green check.
N)pretty_langcode_to_lang)short_name_to_treebank)RESULTS_STRING)default_treebanks)
Tokens SentencesWordsUPOSXPOSUFeatsAllTagsLemmasUASLASCLASMLASBLEX filenames+zWhich file(s) to read)typenargshelp |Metriczoutput format changed? zF1 Scorez-----
c C s g | ]}| d qS )r )split.0x r! d/var/www/html/env_mimamsha/lib/python3.10/site-packages/stanza/utils/training/compose_ete_results.py
L s r# c c s$ | ]
\}}|d |kV qdS )r Nstrip)r r yr! r! r" M s " r' _- z2z[%s](%s)z+https://github.com/UniversalDependencies/%sc C s g | ]}|d qS )r r$ r r! r! r" r# W s )zMacro Avgr, r+ c s* g | ] t fd dtD tt qS )c 3 s | ] }t | V qd S )N)floatr ir! r" r' \ s z.)sumblockslen)r r! r. r" r# \ s * c C s g | ]}d | qS )z%.2fr! r r! r! r" r# ] s c C s g | ] }d d | qS )z|%s|z | )joinr r! r! r" r# a s )2__doc__argparse stanza.models.common.constantr +stanza.models.common.short_name_to_treebankr stanza.utils.training.run_eter !stanza.resources.default_packagesr EXPECTED_ORDERArgumentParserparser add_argumentstr
parse_argsargslinesr filenameopenfinextend readlinesr1 indexr2 linefindr% r
short_namepieces
startswithblockallziplcode
short_datasetlanguagetreebank long_dataset checkmarkappendPREFIXrangeavgsortedchartprintr! r! r! r" st
&
($