allenai
/

superbpe-experimental_v0.1.0

Model card Files Files and versions

undfined commited on Apr 17

Commit

f647f1b

·

verified ·

1 Parent(s): 04c129d

More vocab fixes

Files changed (1) hide show

tokenizer.json +2 -2

tokenizer.json CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:19f403d793a7ba69e4f49a40e7d592a5d4d1ac4f4e7224f18bc608ef268db68b
-size 13491334

 version https://git-lfs.github.com/spec/v1
+oid sha256:f84f0573f232b4e4f845122c92ea2ba376c221f9ab42b03a1e7a301a7e253eb3
+size 7017786