|j'UdZddlmZddlZddlZddlmZdZded<dZ ded <d Z ded <d Z d ed<dZ ded<iZ ded<dddZddZdd Zdd"Zdd#Zdd$Zdd&Z ddd)Zid*d+d,d-d.d/d0d1d2d3d4d5d6d7d8d9d:d;dd?d@dAdBdCdDdEdFdGdHdIdJdKidLdMdNdOdPdQdRdSdTdUdVdWdXdYdZd[d\d]d^d_d`dadbdcdddedfdgdhdidjdkdldmidndodpdqdrdsdtdudvdwdxdydzd{d|d}d~dddddddddddddddZded<dS)z&Internal shared utilities for chardet.) annotationsN)Callablei@ intDEFAULT_MAX_BYTESiEVIDENCE_CAP_BYTESi_DECODE_CHUNK_SIZEg?floatMINIMUM_THRESHOLDi_DEFAULT_CHUNK_SIZEz3dict[str, Callable[..., codecs.IncrementalDecoder]]_INCREMENTAL_DECODERS chunk_size stacklevelreturnNonecX|tkrtjdt|dSdS)zDEmit a deprecation warning if *chunk_size* differs from the default.zEchunk_size is not used in this version of chardet and will be ignoredrN)r warningswarnDeprecationWarning)rrs /Users/tedpeters/Documents/Projects/Claude Projects/Misc Tools/notename-sheets/.venv/lib/python3.11/site-packages/chardet/_utils.py_warn_deprecated_chunk_sizer.sB((( S !      )(encodingstr codecs.IncrementalDecoder | Nonect|}|1 tj|}n#t$rYdSwxYw|t|<|S)aaReturn a fresh incremental decoder for *encoding*, or ``None``. The class lookup is cached; ``None`` means the codec does not exist. Every decode below catches ``UnicodeError`` rather than ``UnicodeDecodeError`` because the utf-16/utf-32 incremental decoders raise a bare ``UnicodeError`` when the stream does not start with a BOM. N)r getcodecsgetincrementaldecoder LookupError)r decoder_classs r_incremental_decoderr#8sm*--h77M "8BBMM   44 *7h' =??s3 AAdatabytestablec |t|tkr3t|t|d|z Sd}tdt|tD]J}|||tz}|t|t|d|z z }K|S)aACount how many bytes of *data* a deletion *table* would remove. ``bytes.translate`` with a deletion table allocates an output buffer proportional to the input, so counting a whole large window through one call spikes memory by roughly the input size. Chunking keeps the transient bounded at one C call per chunk, and the count is identical: deletion is per-byte and carries no state across the split. :param data: The raw byte data to scan. :param table: Byte values to delete. :returns: The number of bytes of *data* present in *table*. Nr)lenr translaterange)r$r&countposchunks r count_deletedr.Ls 4yy&&&4yy3t~~dE::;;;; EQD #566@@S3!3334 Uc%//$">">???? LrboolcLt|}|dS t|tkr||dnMt dt|tD])}||||tzd*n#t $rYdSwxYwdS)a8Return ``True`` if *data* decodes cleanly under *encoding*. Equivalent to ``data.decode(encoding, errors="strict")`` except that an incomplete multi-byte sequence at the *end* of *data* is accepted instead of raising. Detection input is nearly always a prefix of a larger whole. Callers pass the first N bytes of a file, and chardet slices further on its own. For a two-byte encoding any of those cuts lands mid-character roughly half the time. A one-shot strict decode cannot tell a truncated tail from corrupt data: it raises either way, so the candidate is discarded and every CJK encoding can disappear from the candidate set over a single dangling lead byte. An incremental decoder with ``final=False`` defers the partial tail instead, while still raising on genuine corruption anywhere before it. Large inputs are fed in chunks and the decoded text is discarded, so a whole-window check never allocates a matching ``str``. Chunking is transparent: the decoder carries its state across calls, so a sequence straddling a chunk edge decodes exactly as it would in one call. :param data: The raw byte data to test. :param encoding: Name of the codec to test *data* against. :returns: ``True`` if *data* decodes without error, ``False`` otherwise. NFfinalrT)r#r(rdecoder* UnicodeError)r$rdecoderr,s rdecodes_without_errorr6bs6#8,,Gu t99* * * NN4uN - - - -QD +=>> R RtC#0B*B$BC5QQQQ uu 4sA=B B! B!ct|}|dS ||dn#t$rYdSwxYwdS)aKReturn ``True`` if *data* decodes under *encoding* with nothing deferred. The strict sibling of :func:`decodes_without_error`: ``final=True`` makes an incomplete multi-byte sequence at the end of *data* an error rather than a deferred tail. This is the question that matters when *data* is the caller's entire input --- ``data.decode(encoding)`` will make exactly this judgment. :param data: The raw byte data to test. :param encoding: Name of the codec to test *data* against. :returns: ``True`` if *data* decodes completely, ``False`` otherwise. NFTr1)r#r3r4)r$rr5s rdecodes_completelyr8s`#8,,Gut4(((( uu 4s - ;;ct|}|dS ||d}n#t$rYdSwxYw|r|sdS |ddn#t$rYdSwxYwdS)aReturn ``True`` if *data* is ASCII text plus an incomplete tail. One decode pass answers both halves of the decode-safety question: the tolerant (``final=False``) decode yields the text before any deferred tail, and flushing the decoder afterwards raises exactly when a deferred tail existed. True means the candidate decoded real ASCII characters and then hit an incomplete multi-byte sequence at the end --- its only *non-ASCII* evidence is the undecodable tail itself. Deliberately False when the tolerant decode yields nothing at all (the entire input is one dangling sequence): that candidate has zero decoded evidence, not ASCII evidence, and a clipped multi-byte fragment is better served by the ranking's own judgment. :param data: The raw byte data to test. :param encoding: Name of the codec to decode *data* with. :returns: ``True`` if *data* decodes to non-empty pure ASCII with an incomplete sequence deferred at the end. NFr1rT)r#r3r4isascii)r$rr5texts rdangling_tail_with_ascii_prefixr<s(#8,,Gu~~d%~00 uu t||~~us$'''' tt 5s- ;;A// A=<A= max_bytesct|tst|tr|dkrd}t|dS)z:Raise ValueError if *max_bytes* is not a positive integer.z$max_bytes must be a positive integerN) isinstancer/r ValueError)r=msgs r_validate_max_bytesrCsH)T""*Y*D*D TU 4ooIV rshould_rename_legacyprefer_supersetcF|rtjdt|dS|S)zEResolve the deprecated *should_rename_legacy* into *prefer_superset*.z?should_rename_legacy is deprecated, use prefer_superset insteadrT)rrr)rDrErs r_resolve_prefer_supersetrGs; M !    t rararabicbe belarusianbg bulgarianbrbretoncsczechcywelshdadanishdegermanelgreekenenglisheo esperantoesspanishetestonianfafarsififinnishfrfrenchgairishgdgaelichehebrewhrcroatianhu hungarianid indonesianis icelandicititalianjajapanesekkkazakhkokoreanlt lithuanianlvlatvianmk macedonianmsmalaymtmaltesenldutchno norwegianplpolishpt portugueseroromanianrurussianskslovakslslovenesrserbiansvswedishtgtajikththaitrturkishuk ukrainianund undeterminedururduvi vietnamesezhchinesezdict[str, str]ISO_TO_LANGUAGE)r )rrrrrr)rrrr)r$r%r&r%rr)r$r%rrrr/)r=rrr)rDr/rEr/rrrr/)__doc__ __future__rrrcollections.abcrr__annotations__rrr r r rr#r.r6r8r<rCrGrrrrs$,,,"""""" $$$$$$! %$$$$ "!!!! "!!!!NPOOOO     (,&&&&R.!!!!HJK      3#(3#,3# +3# ( 3#  ' 3#  ' 3# (3# (3# '3# )3# +3# )3# *3# '3# )3#  (!3#" '#3#3#$ (%3#& ('3#( *)3#* ++3#, ,-3#. +/3#0 )13#2 *33#4 (53#6 (73#8 ,93#: );3#< ,=3#> '?3#@ )A3#B 'C3#D +E3#3#3#F (G3#H ,I3#J *K3#L )M3#N (O3#P )Q3#R )S3#T )U3#V 'W3#X &Y3#Z )[3#\ +]3#^ >_3#` &a3#b ,c3#d )e3#3#333333r