Wj2)ddlZddlZddlZddlmZddlZddlZddlmZm Z ddl m Z ddl m Z ddlmZmZejeZ dd eezejzdzd eezdzd ededededededededededzdeddfdZdS)N)Path)extract_raw_data_from_modelhas_external_data)ReplaceUpsampleWithResize) ONNXModel)add_pre_process_metadata&save_and_reload_model_with_shape_inferF input_modeloutput_model_pathskip_optimizationskip_onnx_shapeskip_symbolic_shape auto_mergeint_maxguess_output_rankverbosesave_as_external_dataall_tensors_to_one_fileexternal_data_locationexternal_data_size_thresholdreturnc T || dd}|J| Jdtjd5}t|}t |t jr|nt j|}d}d|jD}t|dkrs|d j }|d kr`tt|| t j|d }t!|}d }|s_ d d lm}n"#t&$r}t'd|d}~wwxYwt(d||||||}d }|s|}|rDt/|dz }| rt j||d | | dnt j||t/|dz } t5j}||_t4jj|_t |t jrutA|rtCdtE|\}}|#tI|tI||%}n|r| r|&ddt5j'||dg}~|rt j|}nd}|}nU#tP$rHt()dt()tUj+YnwxYw|s|Ft/|dz }| rt j||d | | dnt j||d}t |t jr9t/t|dz }t j||d | | dt/|dz }t j,-||t j|}|0t |t jr|nt j|}dddn #1swxYwYt]|| rt j||d | | | ddSt j||dS)aShape inference and model optimization, in preparation for quantization. Args: input_model: Path to the input model file or ModelProto output_model_path: Path to the output model file skip_optimization: Skip model optimization step if true. This may result in ONNX shape inference failure for some models. skip_onnx_shape: Skip ONNX shape inference. Symbolic shape inference is most effective with transformer based models. Skipping all shape inferences may reduce the effectiveness of quantization, as a tensor with unknown shape can not be quantized. skip_symbolic_shape: Skip symbolic shape inference. Symbolic shape inference is most effective with transformer based models. Skipping all shape inferences may reduce the effectiveness of quantization, as a tensor with unknown shape can not be quantized. auto_merge: For symbolic shape inference, automatically merge symbolic dims when conflict happens. int_max: For symbolic shape inference, specify the maximum value for integer to be treated as boundless for ops like slice guess_output_rank: Guess output rank to be the same as input 0 for unknown ops verbose: Logs detailed info of inference, 0: turn off, 1: warnings, 3: detailed save_as_external_data: Saving an ONNX model to external data all_tensors_to_one_file: Saving all the external data to one file external_data_location: The file location to save the external file external_data_size_threshold: The size threshold for external data Ninput_model_pathzoutput_model_path is required.z pre.quant.)prefixFc6g|]}|jr |jdk|S)zai.onnx)domain).0opsets /Users/tedpeters/Documents/Projects/Claude Projects/TPC Houses/house-viewer/.venv/lib/python3.11/site-packages/onnxruntime/quantization/shape_inference.py z%quant_pre_process..Rs.qqqEu|qW\WcgpWpWp%WpWpWprr T)SymbolicShapeInferencezsympy is required for symbolic shape inference in quantization preprocessing. Install with: 'pip install sympy' or pass skip_symbolic_shape=True to quant_pre_process().z&Performing symbolic shape inference...zpreprocessed.onnx)rrsize_thresholdconvert_attributezoptimized.onnxzModelProto has external data not loaded into memory, ORT cannot create session. Please load external data before calling this function. See https://onnx.ai/onnx/repo-docs/ExternalData.html for more information.z7session.optimized_model_external_initializers_file_namezoptimized.onnx.dataCPUExecutionProvider) providerszYONNX Runtime Model Optimization Failed! Consider rerun with option `--skip_optimization'.zsymbolic_shape_inferred.onnxzmodel_input.onnxzonnx_shape_inferred.onnx)rrlocationr(r))/poptempfileTemporaryDirectoryr isinstanceonnx ModelProtoload opset_importlenversionrrapplyversion_converterconvert_versionr &onnxruntime.tools.symbolic_shape_inferr' ImportErrorloggerinfo infer_shapesstr save_modelsave onnxruntimeSessionOptionsoptimized_model_filepathGraphOptimizationLevelORT_ENABLE_BASICgraph_optimization_levelr ValueErrorradd_external_initializerslistSerializeToStringadd_session_config_entryInferenceSession Exceptionerror traceback format_excshape_inferenceinfer_shapes_pathr )r rrrrrrrrrrrrdeprecated_kwargs quant_tmp_dir temp_pathmodel model_updatedai_onnx_domain opset_versionr'eoptimization_input_modelopt_model_path sess_optionexternal_namesexternal_valuessessinferred_model_paths r"quant_pre_processrcsV'++,>EE  " " "  ( (*J ( ( (  $L 9 9 9Bh]'' )+tGGc TYWbMcMc rqU-?qqq ~  ! # #*1-5M""))E*:*:MJJPPRRR.>>ubII>uEE $ " ! YYYYYYY   !q  KK@ A A A*77! E!M 9 5'2 $ ?+.y;N/N+O+O(( ?O0.20G'C*/ Ie%=>>> -=!=>>N& 5)8:: 7E 47B7Y7j 46HH()ABB(i 7RRj6k6k3NO99$~:N:NPTUdPePefff/G/Y/Y/[/[,,)-B88QSh#3,kF\E] "1 In55EE E"0K 5 5 5 o Y13344444  5 ! 3  !).L"LMM ( 2O#.20G'C*/ Ie[111+t77 !$}"5"58J"JKK *.,C#?&+ #&i2L&L"M"M   2 2;@S T T TI122E =#-k4?#K#KgKKQUQZ[fQgQgEEBhBhBhBhBhBhBhBhBhBhBhBhBhBhBhHU### ,   "&$;+7#       %*+++++s^CQD! Q! E+D;;EBQD K$#Q$AL63Q5L66DQQ!Q) NNFFFFr FrFFNr )loggingr.rPpathlibrr1rB#onnxruntime.transformers.onnx_utilsrrfusionsr onnx_modelr quant_utilsr r getLogger__name__r<r?r2boolintrcr$r"ros ^^^^^^^^......!!!!!!YYYYYYYY  8 $ $8<+/#! %#"'$))-(,B,B,tdo-4B,TzD(B,B, B,  B,  B,B,B,B, B,"B, $JB,#&B, B,B,B,B,B,B,r$