Spaces:

DrishtiSharma
/

sql-rag

Running

DrishtiSharma commited on Dec 14, 2024

Commit

564add3

verified ·

1 Parent(s): 470bcda

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -40,7 +40,7 @@ class LLMCallbackHandler(BaseCallbackHandler):
 llm = ChatGroq(
     temperature=0,
     model_name="groq/llama-3.3-70b-versatile",
-    max_tokens=1024,
     callbacks=[LLMCallbackHandler(Path("prompts.jsonl"))],
 )

 llm = ChatGroq(
     temperature=0,
     model_name="groq/llama-3.3-70b-versatile",
+    max_tokens=500,
     callbacks=[LLMCallbackHandler(Path("prompts.jsonl"))],
 )