Spaces:

DrishtiSharma
/

sql-rag

Sleeping

DrishtiSharma commited on Dec 14, 2024

Commit

134bb5d

verified ·

1 Parent(s): adb1393

Update interim_radio.py

Files changed (1) hide show

interim_radio.py CHANGED Viewed

@@ -40,7 +40,7 @@ class LLMCallbackHandler(BaseCallbackHandler):
 llm = ChatGroq(
     temperature=0,
     model_name="groq/llama-3.3-70b-versatile",
-    max_tokens=180,
     callbacks=[LLMCallbackHandler(Path("prompts.jsonl"))],
 )

 llm = ChatGroq(
     temperature=0,
     model_name="groq/llama-3.3-70b-versatile",
+    max_tokens=1024,
     callbacks=[LLMCallbackHandler(Path("prompts.jsonl"))],
 )