o h&@sdZddlmZddlmZddlmZddlmZddlZddlZddl Z dddZ dd d Z dd d Z dd dZ ddZedkrGedSdS)zT Visualize named entities from different texts and Stanza documents (+ CoNLL files) )displacy)Doc)Span)is_right_to_leftNc Csttdgt|}}}|jt|d}}} |r?t|j}|r?|D]} | | vr>|| } || | || | ddd<q$|D]} ggd} }}t| j D]q\}}|r|j r|s|j dddg}|d}|t | j dkr| j |j r| | j |j ddd|d7}|t | j dkr| j |j s{t|}|D]}| |qd}qP|r|j r|rqP| |j d}qPt|j| d}| jD]G}|r|j|vrqg}|jD] }| |jd dq|st||d |dd|j}nt||d |dd| |jddd}| |q||| |qAd |i}|r*||d <|D] }tj|d |d q,dS)a; Takes a stanza doc object and language pipeline and visualizes the named entities within it. Stanza currently supports a limited amount of languages for NER, which you can view here: https://stanfordnlp.github.io/stanza/ner_models.html To view only a specific type(s) of named entities, set the optional 'select' argument to a list of the named entity types. Ex: select=["PER", "ORG", "GPE"] to only see entities tagged as Person(s), Organizations, and Geo-political entities. A full list of the available types can be found here: https://stanfordnlp.github.io/stanza/ner_models.html (ctrl + F "The following table"). The colors argument is formatted as a dictionary of NER tags with their corresponding colors, which can be represented as a string (ex: "blue"), a color hex value (ex: #aa9cfc), or as a linear gradient of color values (ex: "linear-gradient(90deg, #aa9cfc, #fc9ce7)"). Do not change the 'rtl_clr_adjusted' argument; it is used for ensuring that the visualize_strings function works properly on rtl languages. enu‮NFT)wordsrentscolorsent)styleoptions)spacyblankcopydeepcopy sentencesrreversedpop enumerater textisasciilenappendrvocabr typetokensidrset_entsrrender)doclanguageselectr model documentsvisualization_colorsrrtl RTL_OVERRIDEcolorclr_valsentencer display_ents already_foundiword to_appendnext_word_indextokendocumentr found_indexesto_addvisualization_optionsr7g/var/www/html/env_mimamsha/lib/python3.10/site-packages/stanza/utils/visualization/ner_visualization.pyvisualize_ner_docs`  ""    *   r9cCs||}t||j||dS)a Takes in a text string and visualizes the named entities within the text. Required args also include a pipeline code, the two-letter code for a language defined by Universal Dependencies (ex: "en" for English). Lastly, the user must provide an NLP pipeline - we recommend Stanza (ex: pipe = stanza.Pipeline('en')). Optionally, the 'select' argument allows for specific NER tags to be highlighted; the 'color' argument allows for specific NER tags to have certain color(s). N)r9lang)rpiper#r r!r7r7r8visualize_ner_strZs r<cCs,tj|dd}|D] }t||||dq dS)a Takes in a list of strings and a language code (Stanza defines these, ex: 'en' for English) to visualize all of the strings' named entities. The strings are processed by the Stanza pipeline and the named entities are displayed. Each text is separated by a delimiting line. Optionally, the 'select' argument may be configured to only visualize given named entities (ex: select=['ORG', 'PERSON']). The optional colors argument is formatted as a dictionary of NER tags with their corresponding colors, which can be represented as a string (ex: "blue"), a color hex value (ex: #aa9cfc), or as a linear gradient of color values (ex: "linear-gradient(90deg, #aa9cfc, #fc9ce7)"). z tokenize,ner) processorsr#r N)stanzaPipeliner<)texts language_coder#r lang_piperr7r7r8visualize_stringsis rDcCs|D] }t||||dqdS)aj Takes in a list of doc and a language code (Stanza defines these, ex: 'en' for English) to visualize all of the strings' named entities. Each text is separated by a delimiting line. Optionally, the 'select' argument may be configured to only visualize given named entities (ex: select=['ORG', 'PERSON']). The optional colors argument is formatted as a dictionary of NER tags with their corresponding colors, which can be represented as a string (ex: "blue"), a color hex value (ex: #aa9cfc), or as a linear gradient of color values (ex: "linear-gradient(90deg, #aa9cfc, #fc9ce7)"). r>N)r9)docsrBr#r r!r7r7r8visualize_docs|s rFcCsdddg}ddg}gd}t|dt|ddd d d d t|dd dgdt|dddddd dS)NaSamuel Jackson, a Christian man from Utah, went to the JFK Airport for a flight to New York. He was thinking of attending the US Open, his favorite tennis tournament besides Wimbledon. That would be a dream trip, certainly not possible since it is $5000 attendance and 5000 miles away. On the way there, he watched the Super Bowl for 2 hours and read War and Piece by Tolstoy for 1 hour. In New York, he crossed the Brooklyn Bridge and listened to the 5th symphony of Beethoven as well as "All I want for Christmas is You" by Mariah Carey.zVBarack Obama was born in Hawaii. He was elected President of the United States in 2008u来自犹他州的基督徒塞缪尔杰克逊前往肯尼迪机场搭乘航班飞往纽约。 他正在考虑参加美国公开赛，这是除了温布尔登之外他最喜欢的网球赛事。 那将是一次梦想之旅，当然不可能，因为它的出勤费为 5000 美元，距离 5000 英里。 在去的路上，他看了 2 个小时的超级碗比赛，看了 1 个小时的托尔斯泰的《战争与碎片》。 在纽约，他穿过布鲁克林大桥，聆听了贝多芬的第五交响曲以及 玛丽亚凯莉的“圣诞节我想要的就是你”。u8我觉得罗家费德勒住在加州, 在美国里面。)u.أعيش في سان فرانسيسكو ، كاليفورنيا. اسمي أليكس وأنا ألتحق بجامعة ستانفورد. أنا أدرس علوم الكمبيوتر وأستاذي هو كريس مانينغuCاسمي أليكس ، أنا من الولايات المتحدة.u\صامويل جاكسون ، رجل مسيحي من ولاية يوتا ، ذهب إلى مطار جون كنيدي في رحلة إلى نيويورك. كان يفكر في حضور بطولة الولايات المتحدة المفتوحة للتنس ، بطولة التنس المفضلة لديه إلى جانب بطولة ويمبلدون. ستكون هذه رحلة الأحلام ، وبالتأكيد ليست ممكنة لأنها تبلغ 5000 دولار للحضور و 5000 ميل. في الطريق إلى هناك ، شاهد Super Bowl لمدة ساعتين وقرأ War and Piece by Tolstoy لمدة ساعة واحدة. في نيويورك ، عبر جسر بروكلين واستمع إلى السيمفونية الخامسة لبيتهوفن وكذلك "كل ما أريده في عيد الميلاد هو أنت" لماريا كاري.rzhyellowredblue)PERSONDATEGPE)r rKrL)r#arpinkz(linear-gradient(90deg, #aa9cfc, #fc9ce7))PERLOCORG)rD) en_strings zh_strings ar_stringsr7r7r8mains   rV__main__)NN)__doc__rr spacy.tokensrrstanza.models.common.constantrr?rr9r<rDrFrV__name__r7r7r7r8s       L