P1i dZddlZddlZddlmZmZmZmZmZddl m Z ddl m Z m Z ddlmZej eZGdd eZy) z2 Groq API service for accessing LLM capabilities. N)DictListOptionalAnyUnion)settings)Groq AsyncGroq) LLMServicec eZdZdZddeedeeffd Z ddedeededed ed ef d Z d ed e fd Z d e eeffdZ xZS) GroqServicez4 Service for interacting with the Groq API. api_keymodelc|xstj}|xstj}t|||t |j |_y)z Initialize the Groq service with API key and model. Args: api_key: Groq API key, defaults to settings.GROQ_API_KEY model: Groq model to use, defaults to settings.GROQ_MODEL )rN)r GROQ_API_KEY GROQ_MODELsuper__init__r rclient)selfrr __class__s 2/home/cursorai/projects/iching/ai/services/groq.pyrzGroqService.__init__sD2X22,,, %(4<<0 prompt system_prompt temperature max_tokenstop_preturncg}|r|jd|d|jd|d |jjjj |j ||||}|j djjS#t$r'}tjdt|d}~wwxYw)a Get a text completion from the Groq API. Args: prompt: The user prompt to send to the model system_prompt: Optional system prompt to set context temperature: Controls randomness (0-1), lower is more deterministic max_tokens: Maximum number of tokens to generate top_p: Nucleus sampling parameter Returns: The text response from the model system)rolecontentuser)rmessagesrrrrzError calling Groq API: N) appendrchat completionscreaterchoicesmessager$ Exceptionloggererrorstr) rrrrrrr&responsees rget_completionzGroqService.get_completions&  OOX-H I F;< {{''33::jj!'% ;H##A&..66 6  LL3CF8< =  sA B B?"B::B? model_keycvttdi}||vr |||_ytj d|dy)z Change the model being used by the service. Args: model_key: Key from the GROQ_MODELS dictionary in settings Returns: True if successful, False otherwise GROQ_MODELSTz Model key 'z#' not found in settings.GROQ_MODELSF)getattrrrr.warning)rr4modelss r change_modelzGroqService.change_modelIsB="5   *DJ NN[ 3VW Xrc$ttdiS)z Get a dictionary of available models. Returns: Dictionary with model keys and their corresponding model IDs r6)r7r)rs rget_available_modelsz GroqService.get_available_models[sx33r)NN)Ngffffff?ig?)__name__ __module__ __qualname____doc__rr0rfloatintr3boolr:rr< __classcell__)rs@rrr s 1 1Xc] 17;,/)-&) )")&.sm)%*)$' ) $ ) /2 )Vcd$4d38n4rr)r@osloggingtypingrrrrr django.confrgroqr r llm_servicer getLoggerr=r.rrrrMsA 33 #   8 $U4*U4r