syntez
/

parva-tokenizer

Model card Files Files and versions

parva-tokenizer / README.md

jstephencorey's picture

Update Readme

d3b3ad5 over 2 years ago

|

history blame contribute delete

153 Bytes

	---
	license: apache-2.0
	datasets:
	- EleutherAI/the_pile
	language:
	- en
	---
	This is a tokenizer for the Parva models, based off of the GPT-Neox tokenizers