o hV@sdddlmZddlZddlZddlZddlmZddlZedZ GdddeZ GdddZ dS) )EnumN)UnpicklingErrorstanzac@seZdZdZdZdS) ModelTypeN)__name__ __module__ __qualname__LSTMENSEMBLEr r b/var/www/html/env_mimamsha/lib/python3.10/site-packages/stanza/models/constituency/base_trainer.pyr src@sreZdZdddZddd Zd d Zd d ZeddZeddZ eddZ ddZ ddZ e dddZdS) BaseTrainerNrFc Cs4||_||_||_||_||_||_||_||_dSNmodel optimizer schedulerepochs_trainedbatches_trainedbest_f1 best_epochfirst_optimizer) selfrrrrrrrrr r r__init__s zBaseTrainer.__init__TcCs|j}||j|j|j|j|jj|jd}| |d<|r1|j dur1|j |d<|j |d<t j||ddtd|dS)N)paramsrrrr model_typer bert_loraoptimizer_state_dictscheduler_state_dictF)_use_new_zipfile_serializationzModel saved to %s)r get_paramsrrrrrnamerget_peft_paramsr state_dictrtorchsaveloggerinfo)rfilenamesave_optimizerr checkpointr r rr(s  zBaseTrainer.savecC|jdSr)r log_normsrr r rr//zBaseTrainer.log_normscCr.r)r log_shapesr0r r rr22r1zBaseTrainer.log_shapescC|jjSr)r transitionsr0r r rr45zBaseTrainer.transitionscCr3r)r root_labelsr0r r rr69r5zBaseTrainer.root_labelscCst|jjSr)nextr parametersdevicer0r r rr9=szBaseTrainer.devicecC |jSr)rtrainr0r r rr;A zBaseTrainer.traincCr:r)revalr0r r rr=Dr<zBaseTrainer.evalc Csddlm}ddlm}tj|sG|dddur!td |tjtj |d|r8tj |d|}ntd |tj |d|z0z t j |dd d d }Wn!t yu}zt j |d d d d }tdWYd}~nd}~wwWntytd|wtd||d} d|vrtj|d<t|dtrt|d|d<|dtjkr|} n|dtjkr|} ntd|d| | |dd|||} |d} |dd} |d}|d}d|vr| ddo| | dddk}||d<|d}|r| | |||}| | |||}nd}d}|dtjkrCtd| jD] }td|| j|q)|| ||| | |||d S|dtjkrW|| ||| | |||d!Std|d)"z? Load back a model and possibly its optimizer. r)EnsembleTrainer)Trainersave_dirNz4Cannot find model in {} and args['save_dir'] is Nonez Cannot find model in {} or in {}cS|Srr storagelocr r r^z"BaseTrainer.load..T) weights_onlycSrArr rBr r rrE`rFFa-The saved constituency parser has an old format using Enum, set, unsanitized Transitions, etc. This version of Stanza can support reading both the new and the old formats. Future versions will only allow loading with weights_only=True. Please resave the constituency parser using this version ASAP.zCannot load model from %szLoaded model from %srrzUnexpected model type: %srrrrrrconfig multistageepochsrz-- MODEL CONFIG --z --%s: %sr)ensemblerrrrrrr)#stanza.models.constituency.ensembler>"stanza.models.constituency.trainerr?ospathexistsgetFileNotFoundErrorformatjoinr'loadrwarningswarn BaseExceptionr) exceptiondebugrr isinstancestrr ValueErrormodel_from_paramsload_optimizerload_schedulerargskeys)r+rar_foundation_cache peft_namer>r?r-erclazzrrrrrbuild_simple_adadeltarrrkr r rrUIsl          zBaseTrainer.load)NNrrrrF)T)NFNN)rr r rr(r/r2propertyr4r6r9r;r= staticmethodrUr r r rrs     r) enumrloggingrNr'picklerrV getLoggerr)rrr r r rs