o h@sdddlmZmZddlZddlZddlmZddlmZm Z m Z  e dZ Gdddeej ZdS))ABCabstractmethodN)split_into_batchessort_with_indicesunsortstanzac@s*eZdZeddZddZdddZdS) BaseClassifiercCsdS)zd Extract the sentences or the relevant information in the sentences from a document N)selfdocr r d/var/www/html/env_mimamsha/lib/python3.10/site-packages/stanza/models/classifiers/base_classifier.pyextract_sentencessz BaseClassifier.extract_sentencescCs|S)z/ By default, don't do anything r )r sentencesr r r preprocess_sentencessz#BaseClassifier.preprocess_sentencesNc Cs|||}|durdt|fg}d}nt|tdd\}}t||}g}|D]'}|d|ddkr6q)|||d|d}tj|dd}||q)|r]t ||}t ||}t dt ||D] \} } t | | fqg|S)zU Given a list of sentences, return the model's results on that text. NrT)keyreverse)dimz Found labels) evalrlenrrtorchargmaxextendtolistrloggerdebugzip) r r batch_size intervalsorig_idxlabelsintervaloutput predictedlabelsentencer r r label_sentences"s*     zBaseClassifier.label_sentences)N)__name__ __module__ __qualname__rr rr&r r r r rs  r)abcrrloggingrtorch.nnnnstanza.models.common.utilsrrr getLoggerrModulerr r r r s