google
/

t5-efficient-xl

Text Generation

text2text-generation

text-generation-inference

Model card Files Files and versions

patrickvonplaten commited on Feb 15, 2022

Commit

5b8b83b

·

1 Parent(s): 9df3444

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -38,14 +38,14 @@ A sequence of word embeddings is therefore processed sequentially by each transf
 The *conventional* T5 architectures are summarized in the following table.
-| Model | NL | dff | dmodel | dkv | NH | #Params|
 | ----| ---- | ---- | ---- | ---- | ---- | ----|
 | Tiny | 4/4 | 1024 | 256 | 32 | 4 | 16M|
 | Mini | 4/4 | 1536 | 384 | 32 | 8 | 31M|
 | Small | 6/6 | 2048 | 512 | 32 | 8 | 60M|
 | Base | 12/12 | 3072 | 768 | 64 | 12 | 220M|
 | Large | 24/24 | 4096 | 1024 | 64 | 16 | 738M|
-**| XL | 24/24 | 16384 | 1024 | 128 | 32 | 3B|**
 | XXL | 24/24 | 65536 | 1024 | 128 | 128 | 11B|
 This

 The *conventional* T5 architectures are summarized in the following table.
+| Model | nl | ff | dm | kv | nh | #Params|
 | ----| ---- | ---- | ---- | ---- | ---- | ----|
 | Tiny | 4/4 | 1024 | 256 | 32 | 4 | 16M|
 | Mini | 4/4 | 1536 | 384 | 32 | 8 | 31M|
 | Small | 6/6 | 2048 | 512 | 32 | 8 | 60M|
 | Base | 12/12 | 3072 | 768 | 64 | 12 | 220M|
 | Large | 24/24 | 4096 | 1024 | 64 | 16 | 738M|
+| **XL** | **24/24** | **16384** | **1024** | **128** | **32** | **3B**|
 | XXL | 24/24 | 65536 | 1024 | 128 | 128 | 11B|
 This