o h @sdZddlmZddlZddlZddlZddlmmm Z ddZ ddZ dd Z d d Zdd dZdddZddZddZddZddZdddZddZdS)z Utils for seq2seq models. )CounterNcCsf|dkr tjj||dS|dkrtjj||dS|dkr"tj|S|dkr,tj|Std|)Nsgd)lradagradadamadamaxzUnsupported optimizer: {})torchoptimSGDAdagradAdamAdamax Exceptionformat)name parametersrr]/var/www/html/env_mimamsha/lib/python3.10/site-packages/stanza/models/common/seq2seq_utils.py get_optimizer s  rcCs|jD]}||d<qdS)Nr) param_groups) optimizernew_lr param_grouprrr change_lrs  rcCs:g}t|D]\}}t|D] }||||qq|SN) enumeraterangeappend)seq_lenswidthflatiljrrrflatten_indicess  r$cCs(||dks J|j|d|S)z+ Keep only the topk rows of grads. rN)sizedatazero_)gradtopkrrrkeep_partial_grad#sr*TcCsPt|d}tj||ddWdn1swY|r&td||S)Nw)indentzConfig saved to file {})openjsondumpprintr)configpathverboseoutfilerrr save_config,s r6cCsHt| }t|}Wdn1swY|r"td||S)NzConfig loaded from file {})r.r/loadr1r)r3r4fr2rrr load_config3s  r9cCsfg}t||D])\}}g}|D]}|dkr||j|q| d}|||q||g7}q|S)zQ Unmap a list of list of indices, by optionally copying from src_tokens. r)ziprid2word)indices src_tokensvocabresultindtokenswordsidxrrrunmap_with_copy:s  rEcCsFg}|D]}tj|vr|tj}||d|g7}q||g7}q|S)z2 Prune decoded sequences after EOS token. N)constantEOSindex EOS_TOKEN)seqsoutsrDrrrprune_decoded_seqsJs   rMcCs&tj|vr|tj}|d|S|S)z$ Prune a decoded hypothesis N)rFEOS_IDrH)hyprDrrr prune_hypWs   rPcCsBt|t|ks Jg}t||D] \}}||d|q|Sr)lenr;r) data_listlensnldr"rrrpruneas rVcCslt|ts t|trt|tsJ|gtt|gt|}ddttt||dD}t|ddS)zt Sort a series of packed list, according to a ref list. Also return the original index before the sort. cSg|]}t|qSrlist.0trrr ozsort..)reverser:N) isinstancetuplerYrrQr;sorted)packedrefr_ sorted_packedrrrsorths"rfcCs<t|t|ks Jdddttt||D\}}|S)z: Unsort a sorted list, based on the original idx. z9Number of list elements must match with original indices.cSrWrrXrZrrrr]wr^zunsort..)rQr;rb) sorted_listoidx_unsortedrrrunsortrs rk)T)__doc__ collectionsrrandomr/r%stanza.models.common.seq2seq_constantmodelscommonseq2seq_constantrFrrr$r*r6r9rErMrPrVrfrkrrrrs$