Hugging Face's logo

amd
/
Meta-Llama-3.1-8B-Instruct-fp8-quark-vllm

Model card Files
xet
Community
seungrok81 commited on
Commit
a436e7a
·
verified ·
1 Parent(s): 200d56d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -81,6 +81,8 @@ sampling_params = SamplingParams(
81
  result = model.generate(prompt, sampling_params=sampling_params)
82
  print(result)
83
  ```
 
 
84
 
85
  #### License
86
  Copyright (c) 2018-2024 Advanced Micro Devices, Inc. All Rights Reserved.
 
81
  result = model.generate(prompt, sampling_params=sampling_params)
82
  print(result)
83
  ```
84
+ ## fp8 gemm_tuning
85
+ Will update soon.
86
 
87
  #### License
88
  Copyright (c) 2018-2024 Advanced Micro Devices, Inc. All Rights Reserved.