davidberenstein1957 commited on
Commit
093b100
·
verified ·
1 Parent(s): c84cbd5

Add files using upload-large-folder tool

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -16,19 +16,21 @@ First things first, you need to install the pruna library:
16
  pip install pruna
17
  ```
18
 
19
- You can then load this model using the following code:
20
 
21
  ```python
22
  from pruna import PrunaModel
23
 
24
- loaded_model = PrunaModel.from_hub("PrunaAI/test-tiny-random-llama4-smashed")
 
 
25
  ```
26
 
27
- After loading the model, you can use the inference methods of the original model.
28
 
29
  ## Smash Configuration
30
 
31
- The compression configuration of the model is stored in the `smash_config.json` file.
32
 
33
  ```bash
34
  {
 
16
  pip install pruna
17
  ```
18
 
19
+ You can use the [transformers](https://huggingface.co/PrunaAI/test-tiny-random-llama4-smashed?library=transformers) library to load the model or use the pruna library to load the model using the following code:
20
 
21
  ```python
22
  from pruna import PrunaModel
23
 
24
+ loaded_model = PrunaModel.from_hub(
25
+ "PrunaAI/test-tiny-random-llama4-smashed"
26
+ )
27
  ```
28
 
29
+ After loading the model, you can use the inference methods of the original model. Take a look at the [documentation](https://pruna.readthedocs.io/en/latest/index.html) for more usage information.
30
 
31
  ## Smash Configuration
32
 
33
+ The compression configuration of the model is stored in the `smash_config.json` file, which describes the optimization methods that were applied to the model.
34
 
35
  ```bash
36
  {