syntez
/

parva-tokenizer

Model card Files Files and versions

parva-tokenizer / README.md

jstephencorey's picture

Update Readme

d3b3ad5 over 2 years ago

|

history blame contribute delete

153 Bytes

metadata

license: apache-2.0
datasets:
  - EleutherAI/the_pile
language:
  - en

This is a tokenizer for the Parva models, based off of the GPT-Neox tokenizers