)iO NSSKrSSKrSSKrSSKrSSKJr SSKJrJrJ r J r J r J r J r JrJr SSKJrJrJrJr SSKJr SSKJr SS KJr S rS rS rS rS SSSSSSS.r"SS5r "SS5r!"SS5r"S\S\S\4Sjr#\RH"\!RJ5RLRO5r(\RH"\"5RLRO5r)S\S\S\ 4Sjr*S\S\S\+4Sjr,\4S \S!\S\+4S"jjr-\\4S\S#\S$\S\+4S%jjr.S'S\S!\S\4S&jjr/g)(N) itemgetter) AnyDict GeneratorListMatchOptionalPatternTupleUnion)T_numT_obj T_obj_iter T_obj_list)cluster_objects)to_list)objects_to_bboxg@ ffffifflfiflst)uffuffiufflufiuflustuſtc\rSrSrSrS\\\\\ 4SS4Sjr SS\ \S\ S \ S \ S\\\44 S jjrSS \\\\4S \ S\ S \ S \ S\ S\\\\44SjjrSS\ S \ S\\\\44SjjrSrg)TextMapz A TextMap maps each unicode character in the text to an individual `char` object (or, in the case of layout-implied whitespace, `None`). tuplesreturnNcbXlSR[[S5U55Ulg)Nr)r!joinmapr as_stringselfr!s U/var/www/html/land-doc-ocr/venv/lib/python3.13/site-packages/pdfplumber/utils/text.py__init__TextMap.__init__#s" Z]F!;<m main_group return_groups return_charsc6URURU5URU5nUVVs/sH upgUcM UPM nnn[U5uppUR U5U U U U S.n U(aUR 5U S'U(aXS'U $s snnf)N)textx0topx1bottomgroupschars)r!startendrgroupr8)r)r.r/r0r1subsetr3cr9r4r5r6r7results r* match_to_dictTextMap.match_to_dict'sQWWZ01553DE$*[URT5R55$N)boolr<strip)r.r/s r* TextMap.search..`sD)<)B)B)D$Er-)r0r1r/) isinstancer ValueErrorreescapeIcompilefinditerr'filterr@) r)rBrCrDr0r1r/compiledflagsgenfilteredr.s ` r*searchTextMap.searchBs gw ' '~ Wu} VH~))G, EMBDDqEzz'1Hkk(NN3EsK    +)%      s6CrIc>U(aSnOSnURUSUSS9$)a6 `strip` is analogous to Python's `str.strip()` method, and returns `text` attributes without their surrounding whitespace. Only relevant when the relevant TextMap is created with `layout` = True Setting `return_chars` to False will exclude the individual character objects from the returned text-line dicts. z *([^\n]+?) *(\n|$)z([^\n]+)rF)r/r1r0)rX)r)rIr1pats r*extract_text_linesTextMap.extract_text_linesks0 (CC{{ AL  r-)r'r!)rTT)TTTTr)TT)__name__ __module__ __qualname____firstlineno____doc__rr strr rr+rintrHrrr@r r rXr\__static_attributes__r-r*rrs# =tE#x*>$?@=T="!  :    c3h <"!' sGCL()' '  '  '  ' '  d38n ' T8<  04 d38n   r-rc\rSrSrSrS\\\\4SS4Sjr SSSSS\ \ SS\ SSS 4 S \ S \S \S \S\S\S\S\S\S\S\ S\ S\ S\4SjjrSrg)WordMapz A WordMap maps words->chars. r!r"NcXlgrGr!r(s r*r+WordMap.__init__s r-FrTlayout layout_width layout_heightlayout_width_charslayout_height_chars x_density y_densityx_shifty_shift y_tolerance use_text_flow presortedexpand_ligaturesc v/n[UR5(d [U5$U (a[O0nU(agU(aU(a [ S5eO[ [ X&- 55nU(aU(a [ S5eO[ [ X7- 55nS/U-nO/nSnU (dU (a URO[URSS9nUSSnUSUS- n[[US U U =(d U S 95GHVunnU(aUSSSUU -- U- OSn[[ US:5[ U5U- 5n[U5H5n[U5(a US SS :XaUU- nURS 5 M7 UU- nSnU (dU (aUO [USS9nUHunnU(a USU- U- OSn[[SU5[ U5U- 5nUS/U-- nUU- nUH<nURUSUS5n U Hn!URU!U45 US- nM M> M U(dGMJUS/UU- -- nGMY U(aDUUS-- n"[U"5HnUS:aUU- nURS 5 M! US S :XaUSS n[U5$)a Given a list of (word, chars) tuples (i.e., a WordMap), return a list of (char-text, char) tuples (i.e., a TextMap) that can be used to mimic the structural layout of the text on the page(s), using the following approach: - Sort the words by (doctop, x0) if not already sorted. - Calculate the initial doctop for the starting page. - Cluster the words by doctop (taking `y_tolerance` into account), and iterate through them. - For each cluster, calculate the distance between that doctop and the initial doctop, in points, minus `y_shift`. Divide that distance by `y_density` to calculate the minimum number of newlines that should come before this cluster. Append that number of newlines *minus* the number of newlines already appended, with a minimum of one. - Then for each cluster, iterate through each word in it. Divide each word's x0, minus `x_shift`, by `x_density` to calculate the minimum number of characters that should come before this cluster. Append that number of spaces *minus* the number of characters and spaces already appended, with a minimum of one. Then append the word's text. - At the termination of each line, add more spaces if necessary to mimic `layout_width`. - Finally, add newlines to the end if necessary to mimic to `layout_height`. Note: This approach currently works best for horizontal, left-to-right text, but will display all words regardless of orientation. There is room for improvement in better supporting right-to-left text, as well as vertical text. z;`layout_width` and `layout_width_chars` cannot both be set.z=`layout_height` and `layout_height_chars` cannot both be set.) Nrc$[USS5$Nrdoctopfloatxs r*rJ$WordMap.to_textmap..s51h3Hr-keyr~r5c$[USS5$r}rrs r*rJrs%!X/r-)preserve_order )rNc$[USS5$)Nrr4rrs r*rJrseAaDJ.?r-r4rr3N)lenr!r LIGATURESrMrdroundsorted enumeratermaxrangeappendminget)#r)rmrnrorprqrrrsrtrurvrwrxry_textmap expansions blank_line num_newlineswords_sorted_doctop first_word doctop_startiwsy_distnum_newlines_prependline_lenline_words_sorted_x0wordr9x_distnum_spaces_prependr>lettersletternum_newlines_appends# r* to_textmapWordMap.to_textmapsf794;;8$ $"2Y !$U &)|/G)H%I"" $W! '*% 0I*J&K#%);;JJ M KK )HI  )+A. !(+j.??  #/(9M   EArAq(#|g'=>)K  $'AE f , $ /08}} Q4(? *H -1 0 0LH B$?@ ! 4 e?E$t*w.);1%(Q)95=8;S%T"[M,>>>..A(nnQvY& BG")  4 A #* 4v[M-?(-JKKc h "59I"J ./q5 *H -0 ||+#CR=x  r-rk)r^r_r`rarbrr rrr+DEFAULT_X_DENSITYDEFAULT_Y_DENSITYDEFAULT_Y_TOLERANCErHrrdrrrerfr-r*rhrhstE%*;$<=$  "##$,,0#!%Y!Y!Y! Y!  Y! ! Y!Y!Y!Y!Y!Y!Y!Y!Y! Y!Y!r-rhc\rSrSr\\SSSSSSS4 S\S\S\S\S \S \S \\ \ S \ \\ 4S \4Sjjr S\ S\4SjrS\S\S\4SjrS\S\\ SS44SjrS\S\\SS44SjrS\S\\\\ 4SS44SjrS\S\4SjrS\ S\ 4SjrSrg) WordExtractori$FTN x_tolerancervkeep_blank_charsrwhorizontal_ltr vertical_ttb extra_attrssplit_at_punctuationryc XlX lX0lX@lXPlX`lUc/OUUlUSLa[RO U=(d SUl U (a [Ul g0Ul g)NTr$) rrvrrwrrrstring punctuationrrr) r)rrvrrwrrrrrys r*r+WordExtractor.__init__%sm'& 0*,(!,!42+ $t+   &," ! (8)Rr- ordered_charsr"c 8^[U5up#pEUSSUSS- nUSSnU(aTR(aOTR(aSOSnSRU4SjU55UUUX6-UUUS .n TRH n USU X'M U $) Nrr~r5uprightrrr$c3h># UH'nTRRUSUS5v M) g7fr3N)rr).0r>r)s r* ,WordExtractor.merge_chars..Js0CPa##AfIqy99=s/2)r3r4r6r5r~r7r direction)rrrr%r) r)rr4r5r6r7 doctop_adjrrrrs ` r* merge_charsWordExtractor.merge_charsBs-m<"1%h/-2B52II "9-18$---d>O>OAVX GGCP&"  ##C%a(-DI$ r- prev_char curr_charcUS(aVURnURnUSnUSnUR(aUSnUSnUSn OhUS*nUS*nUS*n OUURnURnUSnUSnUR(aUSnUSnUSn OUS*nUS*nUS*n [ X:=(d XU-:=(d XeU-:5$)aThis method takes several factors into account to determine if `curr_char` represents the beginning of a new word: - Whether the text is "upright" (i.e., non-rotated) - Whether the user has specified that horizontal text runs left-to-right (default) or right-to-left, as represented by self.horizontal_ltr - Whether the user has specified that vertical text the text runs top-to-bottom (default) or bottom-to-top, as represented by self.vertical_ttb - The x0, top, x1, and bottom attributes of prev_char and curr_char - The self.x_tolerance and self.y_tolerance settings. Note: In this case, x/y refer to those directions for non-rotated text. For vertical text, they are flipped. A more accurate terminology might be "*intra*line character distance tolerance" and "*inter*line character distance tolerance" An important note: The *intra*line distance is measured from the *end* of the previous character to the *beginning* of the current character, while the *inter*line distance is measured from the *top* of the previous character to the *top* of the next character. The reasons for this are partly repository-historical, and partly logical, as successive text lines' bounding boxes often overlap slightly (and we don't want that overlap to be interpreted as the two lines being the same line). The upright-ness of the character determines the attributes to compare, while horizontal_ltr/vertical_ttb determine the direction of the comparison. rr5r4r6r7)rrvrrrH) r)rrryaycyaxbxcxs r*char_begins_new_word"WordExtractor.char_begins_new_word[s'N Y   A  A5!B5!B""t_t_t_o%o%o%  A  A4B4B  u%x(u%))&&)) W !V  !V   r-c#^# /mS[[S[[SS44U4SjjnUHnUSnUR(d'UR 5(aU"S5ShvN M@X@R ;a"U"U5ShvN U"S5ShvN MqT(a,URTSU5(aU"U5ShvN MTRU5 M T(aTv ggNNmN_N.7f)Nnew_charr"c36># T(aTv Uc/mgU/mg7frGrf)r current_words r*start_next_word:WordExtractor.iter_chars_to_words..start_next_words! ""!)!12LzLsr3r) r rrrrisspacerrr)r)rrcharr3rs @r*iter_chars_to_words!WordExtractor.iter_chars_to_wordss$&  Buo B z4- . B"D.upright_keys) %% %r-rrr~r4r) rrdrlistrrvrrrreversed) r)r9rupright_clusterr cluster_key subclustersscsort_keyto_yields r*iter_sort_charsWordExtractor.iter_sort_charss &5 &S & /tE{KKO%a(3G&-(4K*K!8$:J:JK"#*4!"*X*>?07+++D.>? !))-F #0 G"66zB '' 3Z@@C$1sB B cH[[URU555$rG)rhrrr)r9s r*extract_wordmapWordExtractor.extract_wordmapstD44U;<==r-cD[SURU555$)Nc3*# UH upUv M g7frGrf)rrrs r*r.WordExtractor.extract_words..sQ1P-TD1P)rrrs r* extract_wordsWordExtractor.extract_wordssQ1I1I%1PQQQr-) rrrrrrwrrrv)r^r_r`raDEFAULT_X_TOLERANCErrrHr rrcr r+rrrrrrrrr rrhrrrerfr-r*rr$si10!&##!+/16!%@@@ @  @  @@d3i(@$D#I.@@:2I I I   I V!'! :tT) *!F(Z(IeT4>O4P(0 A A 5 *+T47 8 A>Z>G>R:R*Rr-rr9kwargsr"c 6[S0UD6RU5$)Nrf)rr)r9rs r*rrs  "6 " 0 0 77r-c URSS05 [S0[Vs0sHo"U;dM X!U_M snD6nURU5nUR"S0[ Vs0sHo"U;dM X!U_M snD6nU$s snfs snf)NrxTrf)updaterWORD_EXTRACTOR_KWARGSrrTEXTMAP_KWARGS)r9rk extractorwordmaptextmaps r*chars_to_textmaprs MM;%&!6 F!6Av+<1Qi..s!@44v,4rN)r%)rlines r*rextract_text..s"SUT!@4!@@@Us%'rf) rrrrr'rrrrrrr%)r9rrvrrwordsliness r* extract_textr s ENE 5zQ zz(00:::jj0CD ! %:J%:6k|q)|%:J ''.z(';[IyySUSSS Ks - C : C line_chars tolerancecSnSn[U[S5S9H"nUbUSX1-:aUS- nUSnX$S- nM$ U$)Nr$r4rr{r6r3)rr)rrcolllast_x1rs r* collate_liners] DGzz$'78  d4jG4G&H CKDt* V  9 Kr-rrvcf^[U[S5U5nSRU4SjU55$)Nr~rc3<># UHn[UT5v M g7frG)r)rr>rs r*r&extract_text_simple..2sE9a\![119s)rrr%)r9rrv clustereds ` r*extract_text_simpler,s-  z(';[II 99E9E EEr-c^^^[SSSS5m[SS5mS[S[[S S 44UUU4S jjnU"U5n[ X0R S 9$) u Removes duplicate chars — those sharing the same text, fontname, size, and positioning (within `tolerance`) as other characters in the set. fontnamesizerr3r~r4r9r"Nc3># [UTS9n[R"UTS9HWup#[[ U5[ S5T5H/n[U[ S5T5Hn[UTS9Sv M M1 MY g7f)Nrr~r4r)rrrrrr) r9 sorted_charsgrp grp_chars y_cluster x_clusterrpos_keyrs r*yield_unique_chars(dedupe_chars..yield_unique_chars=s|e- '// #FNC,YH!5y "1z$/"I!8;;"GsAr6s UUU::'%         ` ` Fa!a!HMRMR`88s8z8""7#5#56AAFFH))-8CCHHJ J # ' T TT T,+      -,F FFF F, ,u,Z,r-