AHjhddlmZmZmZmZmZddlmZddlZddl m Z GddZ GddZ y) )DictListMappingOptionalUnion)parse_qsN)PASS_THROUGH_HEADER_PREFIXceZdZe d dej deeeee ffde e eeee ffde eeee efffdZ e d deded e efd Zy) BasePassthroughUtilsN existing_urlrequest_query_paramsdefault_query_paramsreturnc8|jjd}t|}|jDcic]\}}|t |dk(r|dn|}}}i}|r|j ||j ||j ||Scc}}w)Nzutf-8r)querydecoderitemslenupdate) r r rexisting_query_stringexisting_query_paramskvupdated_existing_query_params merged_paramss Q/root/tools/cai/cai_env/lib/python3.12/site-packages/litellm/passthrough/utils.pyget_merged_query_parametersz0BasePassthroughUtils.get_merged_query_parameters s!- 2 2 9 9' B ()> ?7L6Q6Q6S) .2aAs1v{qt )) %)    !5 6 :; 12) s Brequest_headersheadersforward_headersc|dur*|jdd|jddi||}|jD]@\}}|jjts*|t td}|||<B|S)a$ Helper to forward headers from original request. Also handles 'x-pass-' prefixed headers which are always forwarded with the prefix stripped, regardless of forward_headers setting. e.g., 'x-pass-anthropic-beta: value' becomes 'anthropic-beta: value' Tzcontent-lengthNhost)poprlower startswithr r)rr r! header_name header_valueactual_header_names rforward_headers_from_requestz1BasePassthroughUtils.forward_headers_from_request&s d "    0$ 7    -54G4G*9)>)>)@ ; %K  "--.HI%05O1P1R%S".:*+  ; )N)F)__name__ __module__ __qualname__ staticmethodhttpxURLrstrrlistrrrrdictboolr*r+rr r sGKii%c5d+;&;<'tCsDy1A,A'BC c5d3i(( ) 6+0"$r+r c&eZdZededefdZy) CommonUtilsendpointrcddl}d|vr|Sgd}|D]-\}}|j||s|j|||}|S|S)aV Encodes any "/" found in the modelId of an AWS Bedrock Runtime Endpoint when arns are passed in. - modelID value can be an ARN which contains slashes that SHOULD NOT be treated as path separators. e.g endpoint: /model//invoke containing arns with slashes need to be encoded from arn:aws:bedrock:ap-southeast-1:123456789012:application-inference-profile/abdefg12334 => arn:aws:bedrock:ap-southeast-1:123456789012:application-inference-profile%2Fabdefg12334 so that it is treated as one part of the path. Otherwise, the encoded endpoint will return 500 error when passed to Bedrock endpoint. See the apis in https://docs.aws.amazon.com/bedrock/latest/APIReference/API_Operations_Amazon_Bedrock_Runtime.html for more details on the regex patterns of modelId which we use in the regex logic below. Args: endpoint (str): The original endpoint string which may contain ARNs that contain slashes. Returns: str: The endpoint with properly encoded ARN slashes rNzarn:aws:) )z((custom-model)/([a-z0-9.-]+)/([a-z0-9]+)z \1%2F\2%2F\3)z!(:application-inference-profile)/\1%2F)z(:inference-profile)/r;)z(:foundation-model)/r;)z(:imported-model)/r;)z(:provisioned-model)/r;)z (:prompt)/r;)z (:endpoint)/r;)z(:prompt-router)/r;)z(:default-prompt-router)/r;)researchsub)r9r<patternspattern replacements r"encode_bedrock_runtime_modelid_arnz.CommonUtils.encode_bedrock_runtime_modelid_arnFsb*  X %O  %-  G[yy(+66';A   r+N)r,r-r.r/r2rBr6r+rr8r8Es"0S0S00r+r8) typingrrrrr urllib.parserr0litellm.constantsr r r8r6r+rrFs)77! 899x22r+