|jEUdZddlmZmZmZddlmZmZee ddZ ee d<dede d e d e fd Zd Zee d <eeZee e d<edZee e d<deeDZee e fe d<dZe e d<ded e fdZdede d e fdZded e fdZde d e fdZdede d e d e fdZded eeefdzfdZded edzfd ZdS)!aEarly detection of escape-sequence-based encodings (ISO-2022, HZ-GB-2312, UTF-7). These encodings use ESC (0x1B), tilde (~), or plus (+) sequences to switch character sets. They must be detected before binary detection (ESC is a control byte) and before ASCII detection (HZ-GB-2312 and UTF-7 use only printable ASCII bytes plus their respective shift markers). Note: ``from __future__ import annotations`` is intentionally omitted because this module is compiled with mypyc, which does not support PEP 563 string annotations. )EVIDENCE_CAP_BYTES count_deleteddecodes_without_error)DETERMINISTIC_CONFIDENCEDetectionResult! _HZ_GB_BYTESdata max_startmax_endreturnc\d} |d|}|dks||krdS|d|dz|}|dkrdS||dz|}t|dkr>t|dzdkr(t|tt|krdS|dz})aFCheck that at least one ~{...~} region contains valid GB2312 byte pairs. In HZ-GB-2312 GB mode, characters are encoded as pairs of bytes in the 0x21-0x7E range. We require at least one region with a non-empty, even- length run of such bytes. *max_start* bounds where a region may open and *max_end* where it may close. Keeping them separate is what lets a region that opens inside the evidence window close beyond it: bounding both at the same offset would cut a straddling region and hide the only escape evidence a document has (ADR-0006). rT~{F~})findlenrr )r r r startbeginendregions /Users/tedpeters/Documents/Projects/Claude Projects/Misc Tools/notename-sheets/.venv/lib/python3.11/site-packages/chardet/pipeline/escape.py_has_valid_hz_regionsrs E %'' B;;%9,,5iiuqy'22 "995eai#o& KK1  F a1$$fl33s6{{BB4a's@ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789+/ _B64_CHARS _UTF7_BASE64sABCDEFGHIJKLMNOPQRSTUVWXYZ_B64_UPPERCASEci|]\}}|| Sr!).0ics r r%@sFFF1q!FFFr _B64_DECODE_EMBEDDED_B64_RUN b64_bytesct|}|dz}|dz}|dkr"t|d}d|zdz }||zrdS|dz}t|}d}d} d} |D]5} |dzt| z}| dz } | dkr| dz} || z dz|| <| dz } 6d} td|dz d D]P} || dz|| dzz}d |cxkrd kr nn| rdSd } 1d |cxkrdkr nn| sdSd} I| rdSd} Q| S)uCheck if base64 bytes decode to valid UTF-16BE with correct padding. A valid UTF-7 shifted sequence must: 1. Contain at least 3 Base64 characters (18 bits, enough for one 16-bit UTF-16 code unit). 2. Have zero-valued trailing padding bits (the unused low bits of the last Base64 sextet after the last complete 16-bit code unit). 3. Decode to valid UTF-16BE — no lone surrogates. This rejects accidental ``+-`` patterns found in URLs, MIME boundaries, hex-encoded hashes (e.g. SHA-1 git refs), and other ASCII data. The caller (``_has_valid_utf7_sequences``) already checks ``b64_len >= 3`` before calling this function, so *b64_bytes* is always at least 3 bytes. rrFriiTii)rr& bytearrayrange)r)n total_bits padding_bitslast_valmask num_bytesrawbit_buf bit_countout_idxr$ prev_highr# code_units r_is_valid_utf7_b64r>Gs IAQJ?Lay}-\!Q& d? 5 aI I  CGIG a<;q>1Q >> NI#y0D8CL qLGI 1i!mQ ' '  Vq[CAJ. Y ( ( ( (& ( ( ( ( ( uuII y * * * *F * * * * * uuII uuII=rposcttdz}d}|dz }|dkr5||}|dvr|dz}||vr|dz }|tkrdS|dz}nn|dk5dS)uReturn True if the ``+`` at *pos* is embedded in a base64 stream. Walks backward from *pos*, skipping CR/LF, and counts consecutive base64 characters (including ``=`` for padding). If 4 or more are found, the ``+`` is likely part of a PEM certificate, email attachment, or similar base64 blob rather than a real UTF-7 shift character. The walk stops at the fourth character rather than running to the start of the run. Only the ``>= 4`` verdict is used, and newlines are skipped rather than ending the walk, so without the early exit a line-wrapped base64 blob — a PEM file, a MIME attachment, exactly what this guard exists to recognize — makes each ``+`` rescan everything before it, and the caller quadratic in the size of the blob. =rr-> TF)r frozensetr()r r? b64_with_padcountr#bs r_is_embedded_in_base64rHs$0)D//#AL E aA q&& G   FA    QJE)))t FAA  q&& 5rb64_datact|ddzt|ddzzt|dzdz S)z@Decode the first (only) UTF-16 code unit of a single-unit block.r r-r+r)r&)rIs r _single_unitrLsK Xa[ !R ' x{ #q ( * hqk " #   runitcd|cxkodkncp_d|cxkodkncpOd|cxkodkncp?d|cxkodkncp/d |cxkod kncpd |cxkod kncpd |cxkodkncS)z>Script ranges where a lone shifted character plausibly occurs.iiii i+i0i0iNiiiiir!)rMs r_plausible_lone_unitrPs $    &     $ T # # # #V # # # # $ T # # # #V # # # # $ T # # # #V # # # # $ T # # # #V # # # #  $ T # # # #V # # # #  $ T # # # #V # # # #rcd}tt||} |td|}|dks||krdS|dz}|t|kr||tdkr|dz}i|t|kry||tdkr`|t|krJ||tdkr1|dz }|t|kr||tdk1|}t ||r|} |}||kr)||t vr|dz }||kr||t v||kr&|t|kr||t vr|}f||z }|||} |dkrt d | Ds|}|dkr?t| r0|d zd zdkr"t| } t| s|}dSt||}) a&Check that *data* contains at least one valid UTF-7 shifted sequence. A valid shifted sequence is ``+`` terminated by either an explicit ``-`` or any non-Base64 character (per RFC 2152). The base64 portion must decode to valid UTF-16BE with correct zero-padding bits. The sequence ``+-`` is a literal plus sign and is **not** counted. *max_start* bounds where a shift may occur and *max_end* how far its base64 run may reach, so a run that begins inside the evidence window can finish beyond it (ADR-0006). A run that outruns *max_end* is skipped rather than judged on the part that fits: the padding and surrogate checks read a cut run as a different run, and accepting on evidence we did not see is the one direction this must never fail in. rT+rFr--c3(K|] }|tvVdS)N)r)r"rGs r z,_has_valid_utf7_sequences..s'#J#JAA$7#J#J#J#J#J#Jrr+r,) minrrordrHranyr>rLrPmax) r r r rlimit shift_posr?r#b64_lenrIrMs r_has_valid_utf7_sequencesr^sD E D 7 # #EGIIc#hh.. ??i9445!m T??tCyCHH44!GE  T??tCyCHH44D //d3i3s88&;&;qD //d3i3s88&;&;E  "$ 2 2 E  %iiDG|33 FA%iiDG|33 ::%#d))++Q<0G0GE c'A; a<<#J#J#J#J#J J J<E  a<<.x88<! "a''#H--+D11E4C OGrNcrd|vsd|vsd|vrdSd|vrdSd|vs d|vsd |vsd |vr d |vrd |vrdSd Sd|vrdSdS)zName the ISO-2022 variant whose designations appear in *data*. :returns: ``(encoding, language)`` or ``None`` when no designation is present. s$(Os$(Ps$(Q)iso2022_jp_2004jas(I)iso2022_jp_extras$Bs$@s(Js$(D) iso2022_jp_2ras$)C) iso2022_krkoNr!)r s r_iso2022_variantrhsTZ4//:3E3E&&D%% T          d??w$))$#T!! 4rctd|v}d|v}d|v}|s|s|sdS|rJt|}|9t||dr#t|dt|dSt t |t }t t |dt z}|r@d |vrrHrLrPr^tuplestrrhrwr!rrrsq   TSSSSSSSSSFFFFFFFFeEE$--.. e...!!#!!!!!!JX EWWW(y44 in444"++H!I!I #IIIGF *0E0EFFF T#s(^FFF3:%:D::::zSTB 5 S     s t    XEXcXCXDXXXXv$5$U38_t%;$$$$N[[?T+A[[[[[[r