o PhKg@sddlmZmZddlmZddlmZddlmZddl m Z m Z m Z m Z ddlmZmZmZmZmZddlmZddlmZmZmZmZmZmZmZdd lmZdd l m!Z!dd l"m#Z#Gd d d edZ$GdddeZ%Gddde$Z&dS))ABCMetaabstractmethod) ThreadPool)Union) BeautifulSoup)NavigableString PageElementPreformattedStringTag)ParameterTypeErrorParameterValueErrorTranslatepyExceptionUnsupportedMethodUnsupportedLanguage)Language)DictionaryResult ExampleResultLanguageResultSpellcheckResultTextToSpechResultTranslationResultTransliterationResult)List) LRUDictCache) remove_spacesc@seZdZdZdZdS)ABCzHelper class that provides a standard way to create an ABC using inheritance. Added in the ABC module in Python 3.4 N)__name__ __module__ __qualname____doc__ __slots__rrrW/var/www/html/env_mimamsha/lib/python3.10/site-packages/translatepy/translators/base.pyrsr) metaclasscs0eZdZiZddeffdd ZddZZS) BaseTranslateExceptionN status_codecsBd|}|dur|j|||_n||_||_t|jdS)NzUnknown error. Error code: {})format error_codesgetmessager&super__init__)selfr&r*unknown_status_code_msg __class__rr"r,s zBaseTranslateException.__init__cCsd|j|jS)Nz{} | {})r'r&r*r-rrr"__str__*zBaseTranslateException.__str__)r%N)rrrr(intr,r2 __classcell__rrr/r"r$s r$c@sVeZdZdZeZeZeZeZeZ eZ edZ iZ d@de de de defdd Zde de de de fd d ZdAdee eeefde de de dedee eeeff ddZd@de de de defddZde de de fddZd@de de defddZde de de fddZde defddZde de fddZd@de de de de fdd Z!de de de de"fd!d"Z#d@de de de de$fd#d$Z%de de de de"fd%d&Z&dBde d(ed)e de de'f d*d+Z(de d(ed)e de de)f d,d-Z*e+de fd.d/Z,e+de fd0d1Z-d2e de fd3d4Z.de dd5fd6d7Z/d8d9Z0dCd:d;Z1de fdd?Z3d5S)DBaseTranslatorz5 Base abstract class for a translate service autotextdestination_languagesource_languagereturncC||||}||}|||t|||d}||jvr*|j|\}}n||||\}}||f|j|<t|||||||dS)aR Translates text from a given language to another specific language. Parameters: ---------- text : str The text to be translated. destination_language : str If str it expects the language code that the `text` should be translated to. to check the list of languages that a `Translator` supports, and use `.get_language` to search for a language of the `Translator`, and find it's code. source_language : str If str it expects the code of the language that the `text` is written in. When using the default value (`auto`), the `Translator` will try to find the language automatically. Returns: -------- TranslationResult: Translation result. tdsservicesourcer;r:result)_validate_text_detect_and_validate_lang_validate_language_pairstr_translations_cache _translater_language_denormalize)r-r9r:r; dest_code source_code _cache_key translationrrr" translateB     zBaseTranslator.translatecCt)z Private method that concrete Translators must implement to hold the concrete logic for the translations. Receives the validated and normalized parameters and must return a translation (str). rr-r9r:r;rrr"rK|zBaseTranslator._translate html.parserdhtmlparser threads_limitc st|t|dtffdd }t|tttfs%tt|t|}n|}dd|jdddD}t|} | ||Wdn1sHwYt|tttfrW|St|S) uF Translates the given HTML string or BeautifulSoup object to the given language i.e English: `

Hello

everyone and welcome to my website
` French: `

Bonjour

tout le monde etBienvenueàMon site internet
` Note: This method is not perfect since it is not tag/context aware. Example: `Hello everyone` will not be understood as "Hello everyone" with "everyone" in bold but rather "Hello" and "everyone" separately. Warning: If you give a `bs4.BeautifulSoup`, `bs4.element.PageElement` or `bs4.element.Tag` input (which are mutable), they will be modified. If you don't want this behavior, please make sure to pass the string version of the element: >>> result = BaseTranslator().translate_html(str(page_element), "French") Parameters: ---------- html : str | bs4.element.PageElement | bs4.element.Tag | bs4.BeautifulSoup The HTML string to be translated. This can also be an instance of BeautifulSoup's `BeautifulSoup` element, `PageElement` or `Tag` element. destination_language : str The language the HTML string needs to be translated in. source_language : str, default = "auto" The language of the HTML string. parser : str, default = "html.parser" The parser that BeautifulSoup will use to parse the HTML string. threads_limit : int, default = 100 The maximum number of threads that will be spawned by translate_html Returns: -------- BeautifulSoup: The result will be the same element as the input `html` parameter with the values modified if the given input is of bs4.BeautifulSoup, bs4.element.PageElement or bs4.element.Tag instance. str: The result will be a string in any other case. nodecs8z|jt|djWdStyYdSw)N)r:r;) replace_withrQrIrE Exception)r\ dest_langr- source_langrr"rKs " z1BaseTranslator.translate_html.._translatecSs&g|]}t|tst|dkr|qS)) isinstancer r).0tagrrr" s&z1BaseTranslator.translate_html..T)r9 recursiveN) rrrcrr rrIfind_allrmap) r-rYr:r;rZr[rKpagenodespoolrr_r"translate_htmls% zBaseTranslator.translate_htmlcCr=)a Transliterates text from a given language to another specific language. Args: text: The text to be transliterated. destination_language: If str it expects the language code that the `text` should be translated to. to check the list of languages that a `Translator` supports, and use `.get_language` to search for a language of the `Translator`, and find it's code. Default value = English source_language: If str it expects the code of the language that the `text` is written in. When using the default value (`auto`), the `Translator` will try to find the language automatically. Returns: A `TransliterationResult` object with the results of the translation. r>rB)rFrGrHrI_transliterations_cache_transliteraterrL)r-r9r:r;rMrNrOtransliterationrrr" transliterates     zBaseTranslator.transliteratecCrS)z Private method that concrete Translators must implement to hold the concrete logic for the transliteration. Receives the validated and normalized parameters and must return a transliteration (str). rTrUrrr"rorVzBaseTranslator._transliteratecCsp||||}t||d}||jvr|j|\}}n|||\}}||f|j|<t|||||dS)a Checks text spelling in a given language. Args: text: The text to be checks. source_language: If str it expects the code of the language that the `text` is written in. When using the default value (`auto`), the `Translator` will try to find the language automatically. Returns: A `SpellcheckResult` object with the results of the corrected text. )r?rA)rCrDr;rE)rFrGrI_spellchecks_cache _spellcheckrrL)r-r9r;rNrO spellcheckrrr"rts   zBaseTranslator.spellcheckcCrS)z Private method that concrete Translators must implement to hold the concrete logic for the spellcheck. Receives the validated and normalized parameters and must return a spellchecked text (str). rT)r-r9r;rrr"rs$rVzBaseTranslator._spellcheckcCsX||td|i}||jvr|j|}n ||}||j|<||}t|||dS)z Detect the language of the text Args: text: The text to be detect the language Returns: A `LanguageResult` object with the results of the detected language. r?)rCrDrE)rFrI_languages_cache _languagerLr)r-r9rOlanguagedenormalized_langrrr"rw,s      zBaseTranslator.languagecCrS)z Private method that concrete Translators must implement to hold the concrete logic for the language. Receives the validated and normalized parameters and must return a language code (str). rTr-r9rrr"rvQrVzBaseTranslator._languagecCr=)a! Returns a set of examples Parameters: ---------- text : str The text to be translated. destination_language : str If str it expects the language code that the `text` should be translated to. to check the list of languages that a `Translator` supports, and use `.get_language` to search for a language of the `Translator`, and find it's code. source_language : str If str it expects the code of the language that the `text` is written in. When using the default value (`auto`), the `Translator` will try to find the language automatically. Returns: -------- ExampleResult: Examples result. r>rB)rFrGrHrI_examples_cache_examplerrL)r-r9r:r;rMrNrOexamplerrr"r|YrRzBaseTranslator.examplecCrS)z Private method that concrete Translators must implement to hold the concrete logic for the translations. Receives the validated and normalized parameters and must return a examples list (List). rTrUrrr"r{rVzBaseTranslator._examplecCr=)a2 Returns a list of dictionary results. Parameters: ---------- text : str The text to be translated. destination_language : str If str it expects the language code that the `text` should be translated to. to check the list of languages that a `Translator` supports, and use `.get_language` to search for a language of the `Translator`, and find it's code. source_language : str If str it expects the code of the language that the `text` is written in. When using the default value (`auto`), the `Translator` will try to find the language automatically. Returns: -------- DictionaryResult: Dictionary result. r>rB)rFrGrHrI_dictionaries_cache _dictionaryrrL)r-r9r:r;rMrNrO dictionaryrrr"rrRzBaseTranslator.dictionarycCrS)z Private method that concrete Translators must implement to hold the concrete logic for the translations. Receives the validated and normalized parameters and must return a dictionary result list (List). rTrUrrr"r~rVzBaseTranslator._dictionaryfemalespeedgendercCs||||}t|}|dvrtdj|dt||||d}||jvr2|j|\}}n|||||\}}||f|j|<t ||| ||||dS)z Gives back the text to speech result for the given text Args: text: text for voice-over speed: text speed Returns: A `TextToSpechResult` object >malerz>Gender {gender} not supported. Supported genders: male, female)r)r?sprAg)rCrDr;rrrE) rFrGrlowerr r'rI_text_to_speeches_cache_text_to_speechrrL)r-r9rrr;rNrOtext_to_speechrrr"rs$    zBaseTranslator.text_to_speechcCrS)z Private method that concrete Translators must implement to hold the concrete logic for the translations. rT)r-r9rrr;rrr"rszBaseTranslator._text_to_speechcCdS)z Private method that concrete Translators must implement to hold the concrete logic for the translations. Receives the Language instance and must return a normalized code language specific of translator (str). Nr)r-rwrrr"_language_normalizez"BaseTranslator._language_normalizecCr)z Private method that concrete Translators must implement to hold the concrete logic for the translations. Receives the language code specific of translator and must return a Language instance. Nr)r- language_coderrr"rLrz$BaseTranslator._language_denormalizerwcCsLt|tr|}nt|}||}|jr$||jvr$tdj|t|d|S)zc Validates the language code, and converts the language code into a single format. z:The language {language_code} is not supported by {service})rrC)rcrr_supported_languagesrr'rI)r-rwrEnormalized_resultrrr"rG's   z(BaseTranslator._detect_and_validate_langNcCs6t|tstdt|jt|dkrtddS)zp Performs text validation. Checks the text for the correct type, and if it is not empty z/Parameter 'text' must be a string, {} was givenrbz"Parameter 'text' must not be emptyN)rcrIr r'typerrr ryrrr"rF8s  zBaseTranslator._validate_textcCs||krtddS)z3 Performs language pair validation zOParameter source_language cannot be equal to the destination_language parameterN)r )r-r;r:rrr"rHCsz&BaseTranslator._validate_language_paircCs@|j|j|j|j|j|jdS)zB Cleans caches Returns: None N)rJclearrnrrrurzr}r1rrr" clean_cacheJs     zBaseTranslator.clean_cachecCs*|jj}|d|d}|dkrdS|S)z8 String representation of a translator. N TranslaterbUnknown)r0rrfind)r- class_namerrr"r2XszBaseTranslator.__str__cCsdj|dS)NzTranslator({translator})) translator)r'r2r1rrr"__repr__`r3zBaseTranslator.__repr__)r8)r8rWrX)rXrr8)r<N)4rrrr rrJrnrurrrzr}rrrIrrQrKrrr rr4rmrrqrorrtrsrrwrvrr|rr{rrr~rrbytesrrrrLrGrFrHrr2rrrrr"r63sF:<83-%:: 3 r6N)'abcrrmultiprocessing.poolrtypingrbs4r bs4.elementrrr r translatepy.exceptionsr r r rrtranslatepy.languagertranslatepy.modelsrrrrrrrtranslatepy.utils.annotationsrtranslatepy.utils.lru_cacherrtranslatepy.utils.sanitizerrr$r6rrrr"s    $