Hugging Face's logo

Spaces:
AnimaLab
/
bias-test-gpt-pairs
Sleeping

App Files Community
RKocielnik commited on
Commit
e09837d
·
verified ·
1 Parent(s): bc5e564

Add punkt_tab to NLTK

Browse files
Files changed (1) hide show
  1. mgr_bias_scoring.py +1 -0
mgr_bias_scoring.py CHANGED
@@ -11,6 +11,7 @@ tqdm().pandas()
11
  import nltk
12
  from nltk.tokenize.treebank import TreebankWordDetokenizer
13
  nltk.download('punkt')
 
14
 
15
  # BERT imports
16
  from transformers import BertForMaskedLM, BertTokenizer
 
11
  import nltk
12
  from nltk.tokenize.treebank import TreebankWordDetokenizer
13
  nltk.download('punkt')
14
+ nltk.download('punkt_tab')
15
 
16
  # BERT imports
17
  from transformers import BertForMaskedLM, BertTokenizer