Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

manueldeprada
/
sampling_with_kvcache_hf_helpers

Text Generation
Transformers
Safetensors
llama
custom_generate
sampling
kvcache
text-generation-inference
Model card Files Files and versions
xet
Community
sampling_with_kvcache_hf_helpers / custom_generate
Ctrl+K
Ctrl+K
  • 1 contributor
History: 1 commit
manueldeprada's picture
manueldeprada HF Staff
update
47784f5 1 day ago
  • generate.py
    8.42 kB
    update 1 day ago