Spaces:

Ankitajadhav
/

Whats_Cooking

Runtime error

Ankitajadhav commited on Jul 8, 2024

Commit

fa72820

verified ·

1 Parent(s): bda7944

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -13,7 +13,8 @@ logging.basicConfig(level=logging.INFO)
 # Initialize the Llama model
 try:
     llm = Llama(
-        model_path="./models/Phi-3-mini-4k-instruct-gguf",
         n_ctx=2048,
         n_gpu_layers=50,  # Adjust based on your VRAM
     )

 # Initialize the Llama model
 try:
     llm = Llama(
+        # model_path="./models/Phi-3-mini-4k-instruct-gguf",
+        model_path = "Ankitajadhav/Phi-3-mini-4k-instruct-q4.gguf"
         n_ctx=2048,
         n_gpu_layers=50,  # Adjust based on your VRAM
     )