)i} SrSrSSKrSSKrSSKr0r0rSrSrSr 0q Sr \ "5 Sr "SS \ 5r"S S \5r"S S \5r04Sjr"SS\5r"SS\ 5r"SS\\5r"SS\\5r\"S\"\"SS555 0SS_SS_SS_S S!_S"S#_S$S%_S&S'_S(S)_S*S+_S,S-_S.S/_S0S1_S2S3_S4S5_S6S7_S8S9_S:S;_0SS?_S@SA_SBSC_SDSE_SFSG_SHSI_SJSK_SLSM_SNSO_SPSQ_SRSS_STSU_SVSW_SXSY_SZS[_S\S]_E0S^S__S`Sa_SbSc_SdSe_SfSg_ShSi_SjSk_SlSm_SnSo_SpSq_SrSs_StSu_SvSw_SxSy_SzS{_S|S}_S~S_ESSSSSSS.Er\"SS\5 0SS_SS_SS_SS_SS_S S!_SS!_S"S#_S$S%_SS%_S&S'_S(S)_SS)_SS+_SS+_SS-_SS-_0S.S1_S2S3_S4S7_S8S9_S:S;_SS?_S@SA_SSC_SDSE_SSG_SFSE_SSG_SHSI_SJSK_SSM_SNSO_E0SPSQ_SRSS_STSU_SVSW_SXSY_SZS[_S\S]_S^S__S`Sa_SdSe_SfSg_ShSi_SjSk_SlSm_SnSo_SpSq_StSu_E0SvSw_SxSy_SSy_SS{_SS_SS_SS_SS_SS_SS_SS_SS_SS_SS_SS_SS_SS_ESSSSSSSCSSMS. ErSSSS.r\"SS\\5 0\"S5S_\"S5S_SS_\"S5S!_S"S#_\"S5S%_S&S'_\"S5S)_\"S5S+_\"S5S-_S.S1_S2S3_S4S7_S8S9_S:S;_SS?_0S@SA_\"S5SC_SFSE_SSG_SHSI_SJSK_\"S5SM_\"S5SO_\"S5S-SQ_\"S5SS_\"S5S-SU_\"S5SW_SXSY_SZS[_S\S]_S^S__S`Sa_E0SdSe_SfSg_ShSi_SjSk_SlSm_SnSo_SpSq_StSu_SvSw_S|S}_SxSy_\"S5S{_\"S5S_SS_SS_SS_S6\"S5-S_ESSSSSSSSSSSSS. Er\"SS\5 \"S\"\"SS555 0\"S5S_S S_SS_SS_SBS_SRS_S0S_\"S5S_SS_S$S_SLS_SS_SvS_SS_SVS_S6S_SS_0S*S_S~S_SNS_S(S_SS_SS_SS_\"S5S_\"S5S_\"S5S_\"S5S_SS_\"S5S_\"S5S_\"S5S_\"S5S_SS_E0ShS_SxS_S>S_S\S_S.S_\"GS5GS_SzGS_S"GS_SHGS_S:GS_StGS_SlGS_S`GS_S4GS _SdGS _SpGS _SGS _ESXGS S&GSGSGSSGSSDGS\"GS5GS\"GS5GS\"GS5GSSnGS\"GS5GS\"GS5GS\"GS5GS\"GS 5GS!0 Er\"SGS"\5 GS%GS#jr\ GS$:Xa\RB"\"55 gg(&azTransliterate texts between unicode and standard transliteration schemes. Transliterate texts between non-latin scripts and commonly-used latin transliteration schemes. Uses standard Unicode character blocks -- e.g. DEVANAGARI U+0900 ... U+097F -- and transliteration schemes -- e.g. the IAST convention for transliteration of Sanskrit to latin-with-dots. The following character blocks and transliteration schemes are included: DEVANAGARI IAST ITRANS -- http://www.aczoom.com/itrans/#itransencoding (Sanskrit only) Harvard Kyoto CYRILLIC ISO 9:1995 (Russian only) New character blocks and transliteration schemes can be added by creating new CharacterBlock and TransliterationScheme objects. COMMAND LINE USAGE ---------------------------- python transliterator.py text inputFormat outputFormat ... writes the transliterated text to stdout text -- the text to be transliterated OR the name of a file containing the text inputFormat -- the name of the character block or transliteration scheme that the text is to be transliterated FROM, e.g. 'CYRILLIC', 'IAST'. Not case-sensitive outputFormat -- the name of the character block or transliteration scheme that the text is to be transliterated TO, e.g. 'CYRILLIC', 'IAST'. Not case-sensitive USAGE -------- Transliterate a text: >>> from indic_transliteration.little import transliterator >>> transliterator.transliterate('yogazcittavRttinirodhaH', 'harvardkyoto', ... 'devanagari', {'outputASCIIEncoded' : True}) 'योगश्चित्तवृत्तिनिरोधः' Create a new CharacterBlock and TransliterationScheme: >>> from indic_transliteration.little import transliterator >>> cb = transliterator.CharacterBlock('NEWBLOCK', range(0x901, 0x9FF)) >>> scheme = transliterator.TransliterationScheme(cb.name, 'NEWSCHEME', ... {'ab': 0x901, 'cd': 0x902}) >>> transliterator.transliterate('abcd', scheme, cb, {'outputASCIIEncoded' : True}) 'ँं' COPYRIGHT AND DISCLAIMER ------------------------------------ Transliterator is: version 0.1 software - use at your own risk. The IAST, ITRANS and Harvard-Kyoto transliteration schemes have been tested for classical Sanskrit, not for any other language. The Cyrillic alphabet and ISO 9:1995 transliteration (for Russian only) are included but have been even more lightly tested than Devanagari. Copyright (c) 2005 by Alan Little By obtaining, using, and/or copying this software and/or its associated documentation, you agree that you have read, understood, and will comply with the following terms and conditions: Permission to use, copy, modify, and distribute this software and its associated documentation for any purpose and without fee is hereby granted, provided that the above copyright notice appears in all copies, and that both that copyright notice and this permission notice appear in supporting documentation, and that the name of the author not be used in advertising or publicity pertaining to distribution of the software without specific, written prior permission. THE AUTHOR DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS SOFTWARE, INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS. IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE. z0.1Nc<SSS[SS.nUR5qg)z'Reset options to their default values. zutf-8?F) inputEncodingoutputEncodingsubstituteCharhandleUnrecognisedoutputASCIIEncodedN)UNRECOGNISED_ECHOcopyoptions)defaultOptionss x/var/www/html/land-doc-ocr/venv/lib/python3.13/site-packages/indic_transliteration_unmaintained/little/transliterator.py resetOptionsr|s*""0$ N!!#Gcl[S[:XaU$[S[:Xa [S$[U4e)z Handle unrecognised characters. r r )rr UNRECOGNISED_SUBSTITUTEKeyError)chrs r _unrecognisedrs;#$(99 % &*A A'((orc$\rSrSrSrSrSrSrg) TLCharactera<Class representing a Unicode character with its equivalents. Public attributes: unicodeHexValue -- the numeric value of the Unicode code point. chr -- the character value of the Unicode code point. name -- the name of the Unicode code point. equivalents -- a dict containing the character's equivalents in various transliteration schemes, in the format: {'Scheme A': 'A', 'Scheme B': 'aah', } where keys are TransliterationScheme names, values are transliterated equivalents of the character. cUS:dUS:a[S4eXl[UR5Ul[R"UR5Ul0UlX lg)aSet up a unicode character. Arguments: unicodeHexValue -- an integer that should correspond to a Unicode code point. block -- the CharacterBlock this character belongs to. Raises: ValueError -- if unicodeHexValue is not a valid code point. riz#numeric value outside Unicode rangeN) ValueErrorunicodeHexValuer unicodedataname equivalents_block)selfrblocks r__init__TLCharacter.__init__sa Q /H"<DE E. t++,$$TXX.  rc X RU'g)zAdd an equivalent for the character. Arguments: equivName -- the name of a TransliterationScheme equivalent -- string/unicode equivalent in the named TransliterationScheme for this code point. N)r )r" equivName equivalents r addEquivalentTLCharacter.addEquivalents'1#r)r!rr rrN)__name__ __module__ __qualname____firstlineno____doc__r$r)__static_attributes__rrrrs .1rrc<\rSrSrSr\4SjrSrSrSr Sr Sr g ) CharacterBlockaDictionary-like representation of a set of unicode characters. For our purposes, a character block corresponds to an alphabet/script that we want to be able to transliterate to or from, e.g. Cyrillic, Devanagari. Keys are unicode characters. Values are TLCharacter instances. cUR5 UHnU"X@5nXPUR'M SUlXl0UlUR 5 g![a MPf=f)aSet up a character block corresponding to a range of code points. Keyword arguments: name -- a string containing the name of the character block. (should normally use a standard Unicode character block name) range -- a list of code points. Reserved code points are ignored. charClass -- the class to be used to create the characters. Should be a subclass of TLCharacter. rN)sortrr _longestEntryrtransliterationSchemes _register)r"r charRange charClassctlchars rr$CharacterBlock.__init__sm A "1+#)VZZ  &(#    sA A%$A%clU[UR'U[URR5'gN)characterBlocksr_namesupperr"s rr9CharacterBlock._registers%%) "$(tyy !rc/nUHTnUR5(aURU5 URXRUR5 MV U$![a UR[ U55 Mf=f)z>) rr3cF\rSrSrSrS SjrSrSrSrSr S r S r S r g) TransliterationSchemeia/Dictionary-like representation of a transliteration scheme. e.g. the Harvard-Kyoto, IAST or ITRANS schemes for transliterating Devanagari to or from the latin alphabet. Keys are unicode strings representing the letter-equivalents used in the transliteration scheme. Values are TLCharacter instances. Nc[UUlX lUR5H=upVUR[ U5X'XR URU5 M? [ UR5Vs/sHn[U5PM sn5Ul URS:ai0Ul [UR55Ul URR5 URS[U5S- SUR5 Ub[U[ 5(d["eX@lUR'5 gs snf)aSet up a transliteration scheme. Keyword arguments: blockName -- a string containg the name of the character block this transliteration scheme is used for, e.g. 'CYRILLIC', 'DEVANAGARI'. schemeName -- the name of the transliteration scheme. Must be unique. data -- a dict containing the data for the transliteration scheme. Keys are transliterated Unicode characters or strings. Values are integers corresponding to Unicode code points. For examples, see the data for the built-in transliteration schemes. swapTable -- a dict (default None) containing any non-standard letter combinations used in the transliteration scheme that we want to pre-process away before transliterating. See the ITRANS data for examples. Raises: KeyError: unknown block name. TypeError: swapTable is not a dict rrN)rAr#ritemsrr)maxkeyslenr7 _parseTreelist _parsedatar6_setupParseTree isinstancedict TypeError swapTabler9)r" blockName schemeNamedatardequivres rr$TransliterationScheme.__init__s0%Y/  &*jjl "E**S%9:DK K % %dii 7'3!$))+!>+Q#a&+!>?    ! DO"499;/DO OO "  CIM1doo F  i..y0A" "?s=E cXRRUR'U[URR 5'gr@)r#r8rrBrCrDs rr9TransliterationScheme._register;s-7; ))$))4$(tyy !rc<X0R:XagSnUnXb::aU[URU5:aZURUUnXu:wa&0XG'UbURXS- US-XE5 UnUnXb:XaURXUS-XE5 US-nXb::aMgg)z=Build the search tree for multi-character encodings. Nr)r7r\r_r`)r"rowFromrowTocolIndextreeprevcharrowIndexr<s rr`%TransliterationScheme._setupParseTree?s )) ) #dooh788OOH-h7= DG ,,,WlHqLRVR`a&G H$((HqL$.Y!|HrcUnXnU[U5S- :a/XS-X1U;aXPRXS-X1U5-nU$U$![a U$f=fNr)r\#_TransliterationScheme__getNextCharr)r"rIrSrqimatcheds r __getNextChar#TransliterationScheme.__getNextCharSs{ ' s4y1}  A;$Aw-/%(:(:4QRSW (VVGw  s,A AAcURS:a3XR5(dURXUR5$X$rv)r7rGrwr]rRs rrT"TransliterationScheme._getNextChar_s?    !$.*@*@*B*B%%ddooF F> !rcUR(a1URH!nURX RU5nM# U$r@)rdreplace)r"rIr<s rrO!TransliterationScheme._preprocesses3 >>^^||A~~a'89$ rc/nURU5nSnU[U5:a~XR5(aURX5 US-nO=UR X5nURXR 5 U[U5-nU[U5:aM~U$![ a UR[U55 NGf=f)z"Transliterate the text to Unicode.rr)rOr\rGrHrTrrr)r"rIrJrKrxrs rrL$TransliterationScheme._transliteratels% #d)mw   dg&aC''06MM$)--0CL#d)m  6MM-"456s'B%%$C  C )r7r]r_r#rrdr@) r+r,r-r.r/r$r9r`rwrTrOrLr0r1rrrWrWs+ &P)$( " rrWc^ Sn[RU5 [[4m U 4SjnU"U5nU"U5n[ UT 5(d[ S4eSnU"U5nU"U5nXxLa[ S4eXLaOURS:Xa?[U5V s/sHoR5(aMXPM n U[5 $URX5n [S(aU V s/sH o"U 5PM n n SRU 5R 5[5 $s sn fs sn f![5 f=f) aTransliterate a text. Keyword arguments: text -- a unicode string containing the text to be transliterated inFormat -- the "from" CharacterBlock or TransliterationScheme, or its name outFormat -- the target CharacterBlock or TransliterationScheme, or its name requestOptions -- optional dict containing option settings that override the defaults for this request. Returns a unicode object containing the text transliterated into the target character set. Raises: ValueError -- unrecognised input or output format. KeyError -- a character in text is not a member of inFormat, or has no corresponding character defined in outFormat. c2[U5nUS:aSU-$U$)Nz&#x%x;)ord)rvalues r asciiEncode"transliterate..asciiEncodes"C 3;u% % rc>[UT5(a[UR5nU$U$![a [SU-4ef=f)Nzunrecognised format )rarBrCrr)fmt basestrings r findFormat!transliterate..findFormatsU#z**E -CJ3J E%'='CDDEs /Az-The text must be a string or a unicode objectcH[U[5(aU$UR$r@)rar3r#)formats rgetBlocktransliterate..getBlocks&.11 ||#rz%incompatible input and output formatsrr r)rupdatestrbytesrarcrr7setrGrrLjoinencode) rIinFormatrJrequestOptionsrrrinBlockoutBlockr<rKrs @r transliteraters8& /~&C5\ 4 h'y) &$ ++ "QRR $ 8$I&"FG G  %%*&)$iCiyy{iC  ,((9 ' (.45fk!nfF5xx&&w/?'@AD6 s6BD=D35D3=D= $D=/D8(D=3 D== E c`\rSrSrSrSr\"SS5r\"SS5rSr S r S r S r S r S rSrg)DevanagariCharacteriz3Special processing for Devanagari characters. 8i> iM i  u्uअ= P cSUlU[R;aSUlSUlU[R;a6U[ U[R - 5nURU5 [e[RXU5 SUl URS:XaWUR R5(a7UR[R[R4;aSUl gggg)amCreate an object representing a Devanagari character. Extends TLCharacter.__init__ to distinguish Devanagari standalone vowels, dependent vowels and consonants. Raises ValueError -- for characters in the Devanagari dependent vowel range. We want these as variants of the corresponding standalone vowels, not as separate characters. FTN)isVowelr _vowelRange_dependentVowel_depVowelRanger _vowelOffset_setDependentVowelrrr$ isConsonantisalphar _AVAGRAHA_OM)r"rr#vowels rr$DevanagariCharacter.__init__s 1== =DL# 1@@ @#o0C0P0PPQRE  $ $_ 5 TE:  <<5 HH      )<)F)F;N;R;R)T T#D  T  !rcUb?UR(d[e[U5UlXR[U5'ggr@)rrrrr!)r"rs rr&DevanagariCharacter._setDependentVowels7  &<< !3#&#7D 04KKO, - 'r)rrrN)r+r,r-r.r/rrangerr_VIRAMA _LETTER_Arrr$rr0r1rrrrsQ !L5%(Nu%KGII C$@5rrc\rSrSrSrSrSrg) _Devanagarii z;Holder class for the Devanagari transliteration algorithm. cJ^^^^^^ UUUUU U4SjnU4Sjn/m TRU5nSnSmSmTRX5mU[T5-nU[U5:a=TRX5mU"5 U[T5-nTmTmSmU[U5:aM=U"5 T $)zTransliterate a devanagari text into the target format. Transliterating a character to or from Devanagari is not a simple lookup: it depends on the preceding and following characters. c:>TR5(aTRT5 gTT ;aT TnOSnTT ;aT TnOSnTRT TUUT R5nUHnTRU5 M g![a [ T5nN2f=fr@)rGrH _equivalent _implicitArr) prevnextrhricurMatch nextMatchrJ prevMatchrKr"s r getResult-_Devanagari._transliterate..getResults!! h'D ID I 0!--d8n<@<@<@OOM  a  0%h/ 0s!BBBc<>TRS:Xag[U5$rv)r7r\)r<r"s rincr(_Devanagari._transliterate..incr*s!!Q&q6MrrN)rOrTr\) r"rIrJrrrxrrrrKs ` ` @@@@rrL_Devanagari._transliterates  ! !,  %   $$T- H #d)m))$2I KC N"A I HI #d)m   rr1N)r+r,r-r.r/rLr0r1rrrr s F1rrc*\rSrSrSrSrSrSrSrg)DevanagariCharacterBlockiBzDClass representing the Devanagari Unicode character block. cH[RXU[5 SUlg)zSet up the Devanagari character block. Extends CharacterBlock.__init__ by specifiying that the characters created should be instances of DevanagariCharacter. TN)r3r$rr)r"rr:s rr$!DevanagariCharacterBlock.__init__Gs I7JKrc.[RXU5$z;Need to specify which superclass _transliterate() to call. rrLr"rIrJs rrL'DevanagariCharacterBlock._transliterateR))$i@@rc/nURS:XadURUR5 UR(a6UbUR(dUcUR[R 5 U$UbURS:XaURUR5 U$UR bURUR 5 U$)z~Transliterate a Latin character equivalent to Devanagari. Add VIRAMA for ligatures. Convert standalone to dependent vowels. F)rrHrrrrrr"charrr implicitArKs rr$DevanagariCharacterBlock._equivalentVs <<5 MM$(( #"t'7'7| 199: |t//58 dhh' ''3MM$"6"67 rrN r+r,r-r.r/r$rLrr0r1rrrrBsArrc.\rSrSrSrSSjrSrSrSrg) DevanagariTransliterationSchemeimz8Class representing a Devanagari transliteration scheme. Nc@[RXX#U5 SUlg)zUSet up a Devanagari transliteration scheme. Extends TransliterationScheme.__init__ FN)rWr$r)r"rerfrgrds rr$(DevanagariTransliterationScheme.__init__ps &&*I ?rc.[RXU5$rrrs rrL.DevanagariTransliterationScheme._transliterate{rrcSn/nUR[R:wa(URURUR 5 U(aUR (auUb/UR[R:waUR(aUc@UR[S[RRUR 5 U$)z^Transliterate a Devanagari character to Latin. Add implicit As unless overridden by VIRAMA. F DEVANAGARI) rrrrHr rrrrArrs rr+DevanagariTransliterationScheme._equivalents   88*22 2 MM$**4995 6T )) HH+33 3 < MM/,7'1133>;tyyJ K rrr@rr1rrrrmsC Arrri i Mi Hi ai Ai rxi Ii ui Ui Ri lRi rii Ei aii oi Oi aui krkhi gi ghi Gi r<i chi ji jhi Ji Ti Thi Di! Dhi" Ni# ti$ thi% di& dhi' ni( n2i) pi* phi+ bi, bhi- mi. yi/ ri0 r2i1 li2 Li3 vi5 zi6 zhi4 Si7 i8 i9 id ie rr)sh...'oM HARVARDKYOTOz.nz.maaiiuuRRizR^iLLizL^iz~NCChz~nwshShrrz.aOMAUMrr0if 1ig 2ih 3ii 4ij ik il im in io ) 56789z.hzN^shhJNzj~nkSh)GYdnyxITRANSiCi%ii+iki[i7iEchhimi iGi[icr) rrr%r&r'r(r)r*r+r,r-r.IASTCYRILLICiiiiBiViiiii}iZiiiKiiiiiPii i!i"i#Fi$i%i&i i'i`i(i\i)ii*Yi+ii,i-i.i/i0i1i2i3i4i5i~i6i7i8i9i:i;i<i=i>i?i@iAiBiCfiDiEiFi iGiaiHi]iIiKiMiNiOiQISO9RUScJ[[SSS55 Uc[RnUSSupnUR5nUR5n[U5nSnUR5HQn[U5S:a:URS5(d$[[XU5RS 55 US-nMS UR5 g![a [[ R 5 gf=f![a [[XU55 gf=f) a^Call transliterator from a command line. python transliterator.py text inputFormat outputFormat ... writes the transliterated text to stdout text -- the text to be transliterated OR the name of a file containing the text inputFormat -- the name of the character block or transliteration scheme that the text is to be transliterated FROM, e.g. 'CYRILLIC', 'IAST'. Not case-sensitive outputFormat -- the name of the character block or transliteration scheme that the text is to be transliterated TO, e.g. 'CYRILLIC', 'IAST'. Not case-sensitive zjaya gaNeza! zrIrAmajayam harvardkyoto devanagarirrr# )printrsysargvrmainr/rCopen readlinesr\ startswithstripcloseIOError)rSrIrrJrErxs rrTrTs  =4nl ST |xx$(1I! ~~H!I  J KKMD4y1}T__S%9%9}TY?EEdKLAA"  '  t||  }TY78s#C D#C=<C=D"!D"__main__r@)"r/ __version__rdoctestrRrArBUNRECOGNISED_FAILr rrrrobjectrrbr3rWrrrrrr^rrr5 _swapTablerr8_ISO9RUSrTr+exitr1rrrcsWp      $ /16/1b?T?DuDup=?HV85;85t4&4n(~{(V$&;[$NtE%,?'@A:::: :  :  :::: %::: %:::  %!:"#:$ %%:&':( %):*+:,-:. %/:01:2 %3:45:67:8 %9::;:< %=:>?:@A:B %C:DE:F %G:HI:J %K:LM:N %O:PQ:R %S:TU:VW:XY:Z %[:\]:^_:`a:bc:d %e:fg:h      s: v ^\JP P %P  %P  P   P   P  %P P P  %P P P  %P  5P  5P   5!P " 5#P $%P & %'P ()P * %+P ,-P . %/P 01P 2 %3P 4 %5P 67P 89P : %;P < %=P >?P @ %AP B %CP DEP F %GP HIP J %KP LMP NOP P %QP RSP T %UP VWP XYP Z %[P \]P ^ %_P `aP bcP deP fgP hiP jkP lmP n %oP p %qP rsP tuP v %wP x %yP z 5{P |}P ~ &P @AP BCP DEP FGP HIP J         _P d %e  h K@K@K@@J @  @ J @@J@K@K@@ %@@ %@@  %!@"#@$ %%@&K'@( %)@* 5+@,-@. %/@0Iu1@2K3@4Ke5@6K7@8K#u9@:K;@<=@> %?@@A@B %C@DE@FG@H %I@JK@L %M@NO@PQ@RS@TU@VW@X %Y@Z[@\J]@^K_@`a@bc@de@f#f+ug@h            @D fd;z4eU 345C UUC eC eC e C  e C  e C eC UUC eC eC eC eC eC eC eC  e!C "e#C $e%C &e'C (e)C *e+C ,e-C .e/C 0e1C 2UU3C 4UU5C 6UU7C 8UU9C :e;C <UU=C >UU?C @UUAC BUUCC DeEC FeGC HeIC JeKC LeMC NeOC PUUQC ReSC TeUC VeWC XeYC Ze[C \e]C ^e_C `eaC becC deeC fegC heeeeeUUUUUUeTEUUUUUUEC Jj)X6(T zHHTVr