|j5"dZddlmZddlZddlmZddlmZddlm Z ddl m Z ddl m Z mZmZdd lmZmZdd lmZmZmZmZdd lmZmZmZdd lmZdd lmZm Z GddZ!dS)u3UniversalDetector — streaming encoding detection.) annotationsN)Iterable)MappingProxyType)ClassVar)_utils)DEFAULT_MAX_BYTES_resolve_prefer_superset_validate_max_bytes) EncodingEraLanguageFilter)NARROWER_DISPLAY_NAMESPREFERRED_SUPERSETapply_compat_namesapply_preferred_superset) _NONE_RESULT DetectionDictDetectionResult) run_pipeline)_validate_encodingnormalize_encodingsceZdZUdZejZeeZde d<e j de j e fddddddd d%dZd&dZd'd!Zd(d"Zed)d#Zed'd$ZdS)*UniversalDetectoraStreaming character encoding detector. Implements a feed/close pattern for incremental detection of character encoding from byte streams. Compatible with the chardet 6.x API. All detection is performed by the same pipeline used by :func:`chardet.detect` and :func:`chardet.detect_all`, ensuring consistent results regardless of which API is used. .. note:: This class is **not** thread-safe. Each thread should create its own :class:`UniversalDetector` instance. z$ClassVar[MappingProxyType[str, str]] LEGACY_MAPFTNcp1252zutf-8)prefer_superset compat_namesinclude_encodingsexclude_encodingsno_match_encodingempty_input_encoding lang_filterr should_rename_legacybool encoding_erar max_bytesintrrrIterable[str] | Nonerrstrr returnNonec|tjkrtjdtdt ||}||_||_t|||_ ||_ t|d|_ t|d|_ t| d|_t| d|_t#|_d|_d|_d|_d |_d S) a*Initialize the detector. :param lang_filter: Deprecated -- accepted for backward compatibility but has no effect. A warning is emitted when set to anything other than :attr:`LanguageFilter.ALL`. :param should_rename_legacy: Deprecated alias for *prefer_superset*. :param encoding_era: Restrict candidate encodings to the given era. :param max_bytes: Maximum number of bytes to buffer from :meth:`feed` calls before stopping accumulation. :param prefer_superset: If ``True``, remap subset encodings in the result to their decode-safe Windows/CP superset equivalents (e.g., ISO-8859-1 -> Windows-1252). If ``False`` (default), skip the renaming --- not a promise of the smallest matching encoding. The default will change to ``True`` in chardet 8.0. See :func:`chardet.detect` for details. :param compat_names: If ``True`` (default), return encoding names compatible with chardet 5.x/6.x. If ``False``, return raw Python codec names. :param include_encodings: If given, restrict detection to only these encodings (names or aliases). :param exclude_encodings: If given, remove these encodings from the candidate set. :param no_match_encoding: Encoding to return when no candidate survives the pipeline. Defaults to ``"cp1252"``. :param empty_input_encoding: Encoding to return for empty input. Defaults to ``"utf-8"``. zMlang_filter is not implemented in this version of chardet and will be ignored) stacklevelrrrr FN)r ALLwarningswarnDeprecationWarningr _prefer_superset _compat_namesr _encoding_era _max_bytesr_include_encodings_exclude_encodingsr_no_match_encoding_empty_input_encoding bytearray_buffer_input_truncated_done_closed_result) selfr!r"r$r%rrrrrr s /Users/tedpeters/Documents/Projects/Claude Projects/Misc Tools/notename-sheets/.venv/lib/python3.11/site-packages/chardet/detector.py__init__zUniversalDetector.__init__3sR ., , , M&"      3 /  !0)I&&&)#"5 2# # #6 2# # #5 2# # &8 "8& & "!{{ %  /3 byte_strbytes | bytearrayc~|jrd}t||jr |rd|_dS|jt |jz }|dkr"|j|d|t |t|dkrd|_t |j|jkr d|_dSdS)aFeed a chunk of bytes to the detector. Data is accumulated in an internal buffer. Once *max_bytes* have been buffered, :attr:`done` is set to ``True`` and further data is ignored until :meth:`reset` is called. :param byte_str: The next chunk of bytes to examine. :raises ValueError: If called after :meth:`close` without a :meth:`reset`. z+feed() called after close() without reset()TNr) r> ValueErrorr=r<r5lenr;extendmax)r@rDmsg remainings rAfeedzUniversalDetector.feed}s < "?CS// ! :  -(,% FOc$,&7&77 q== L  ) 4 5 5 5 x==3y!,, , ,%)D ! t|   / /DJJJ 0 /rCrc |jsid|_t|j}t||j|j|j|j|j|j |j }|d|_ d|_ |j S)zFinalize detection and return the best result. Runs the full detection pipeline on the buffered data. :returns: A dictionary with keys ``"encoding"``, ``"confidence"``, ``"language"``, and ``"mime_type"``. T)r%input_truncatedrrrr r)r>bytesr;rr4r5r<r6r7r8r9r?r=result)r@dataresultss rAclosezUniversalDetector.closes| DL&&D""/ $ 5"&"9"&"9"&"9%)%?   G#1:DLDJ{rCcdt|_d|_d|_d|_d|_dS)z2Reset the detector to its initial state for reuse.FN)r:r;r<r=r>r?r@s rAresetzUniversalDetector.resets. {{ %   rCc|jS)z9Whether detection is complete and no more data is needed.)r=rVs rAdonezUniversalDetector.dones zrCcH|j|j}d}|js|jr#|dtvrt |j}|jrt|||j|j |jrt|||StjS)z"The current best detection result.NrCencoding)rr) r?to_dictr2r3r rPr;rr6r7rr)r@dwindows rArQzUniversalDetector.results < # $$&&AF$ -" -'(}8N'N'Nt|,,$ (&*&=&*&=  ! ."1f---H#%%%rC)r!r r"r#r$r r%r&rr#rr#rr'rr'rr(r r(r)r*)rDrEr)r*)r)r)r)r*)r)r#)__name__ __module__ __qualname____doc__rMINIMUM_THRESHOLDrrr__annotations__r r.r rrBrMrTrWpropertyrYrQrCrArrs&  08H7G88J '5&8%*$/O* H4!&!2626!)$+H4H4H4H4H4H4T@2X&&&X&&&rCr)"rb __future__rr/collections.abcrtypesrtypingrchardetrchardet._utilsrr r chardet.enumsr r chardet.output_namesr rrrchardet.pipelinerrrchardet.pipeline.orchestratorrchardet.registryrrrrfrCrArrs}99""""""$$$$$$"""""" 65555555 JIIIIIIIII666666DDDDDDDD~&~&~&~&~&~&~&~&~&~&rC