AHj62ddlmZddlmZGddeZy))Optional)OpenAIGPTConfigc(eZdZUdZdZeeed<dZee ed<dZ eeed<dZ ee ed<dZ eeed<dZeeed<dZeeed <dZeeed <dZeeed <dZeeed <dZee ed < ddeedee deedeedee deedeedeed eed eed eed eed ee ddfdZefdZdedefdZde de dede de f dZdededefdZedede fdZededefdZ xZ!S) BasetenConfigzS Reference: https://inference.baseten.co/v1 Below are the parameters: N max_tokensresponse_formatseedstreamtop_p tool_choicetoolsuserpresence_penaltyfrequency_penaltystream_optionsstop temperaturereturnctj}|jD]%\}}|dk7s |t|j||'y)Nself)localscopyitemssetattr __class__)rrrr rr rr r r rrrrlocals_keyvalues Q/root/tools/cai/cai_env/lib/python3.12/site-packages/litellm/llms/baseten/chat.py__init__zBasetenConfig.__init__sF (--/!--/ 4JCf}!2U3 4c t|S)N)super get_config)clsrs rr$zBasetenConfig.get_config-sw!##r!modelc gdS)zE Get the supported OpenAI params for the given model )rmax_completion_tokensrr rr rr r r rrrr)rr&s rget_supported_openai_paramsz)BasetenConfig.get_supported_openai_params1s   r!non_default_paramsoptional_params drop_paramsc|j|}|jD]\}}|dk(r||d<||vs|||<|S)N)r&r(r)r*r)rr+r,r&r-supported_openai_paramsparamrs rmap_openai_paramszBasetenConfig.map_openai_paramsFsb#'"B"B"B"O.446 /LE5//05 -11).&  / r!api_baseapi_keycd}|xsd}||fS)zE Get the OpenAI compatible provider info for Baseten https://inference.baseten.co/v1BASETEN_API_KEYr))rr2r3default_api_basedefault_api_keys r$_get_openai_compatible_provider_infoz2BasetenConfig._get_openai_compatible_provider_infoUs =!6%600r!cd|jdd}ddl}t|jd|S)zZ Check if the model is a dedicated deployment (8-digit alphanumeric code) baseten/rNz^[a-zA-Z0-9]{8}$)replacereboolmatch)r&model_idr>s ris_dedicated_deploymentz%BasetenConfig.is_dedicated_deploymentas0 ==R0 BHH0(;< D(3-&*hsm*'+x}+%)NHTN)%)*."#!%'+#%) $"*.+/)-4SM4"$4sm 4 tn 4  4e_4}4c]4~4sm4#3-4$C=4!4 4*$$   *          1 1&) 1  1 =s =t = = 5c 5c 5 5r!rN)typingr+litellm.llms.openai.chat.gpt_transformationrrr)r!rrUsGt5Ot5r!