Hugging Face's logo

Spaces:
Aneeshmishra
/
Tridev
Sleeping

App Files Community
Aneeshmishra commited on
Commit
87abaf7
·
verified ·
1 Parent(s): a2f4562

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -1,5 +1,5 @@
1
  from transformers import BitsAndBytesConfig
2
-
3
  MODEL_ID = "mistralai/Mixtral-8x7B-Instruct-v0.1" # FP16 weights
4
  bnb_cfg = BitsAndBytesConfig(
5
  load_in_4bit=True,
 
1
  from transformers import BitsAndBytesConfig
2
+ import torch
3
  MODEL_ID = "mistralai/Mixtral-8x7B-Instruct-v0.1" # FP16 weights
4
  bnb_cfg = BitsAndBytesConfig(
5
  load_in_4bit=True,