Johannes Hagemann
		
	commited on
		
		
					Commit 
							
							·
						
						da9a8e6
	
1
								Parent(s):
							
							b962fcc
								
Upload special_tokens_map.json
Browse files- special_tokens_map.json +1 -0
 
    	
        special_tokens_map.json
    ADDED
    
    | 
         @@ -0,0 +1 @@ 
     | 
|
| 
         | 
| 
         | 
|
| 1 | 
         
            +
            {"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>", "pad_token": "<|endoftext|>"}
         
     |