raymondEDS commited on
Commit
1748447
·
1 Parent(s): a2ec2d3

trying to test nltk

Browse files
app/__pycache__/main.cpython-311.pyc CHANGED
Binary files a/app/__pycache__/main.cpython-311.pyc and b/app/__pycache__/main.cpython-311.pyc differ
 
app/components/__pycache__/login.cpython-311.pyc CHANGED
Binary files a/app/components/__pycache__/login.cpython-311.pyc and b/app/components/__pycache__/login.cpython-311.pyc differ
 
app/pages/__pycache__/week_1.cpython-311.pyc CHANGED
Binary files a/app/pages/__pycache__/week_1.cpython-311.pyc and b/app/pages/__pycache__/week_1.cpython-311.pyc differ
 
app/pages/__pycache__/week_4.cpython-311.pyc CHANGED
Binary files a/app/pages/__pycache__/week_4.cpython-311.pyc and b/app/pages/__pycache__/week_4.cpython-311.pyc differ
 
app/pages/week_4.py CHANGED
@@ -79,6 +79,8 @@ def show():
79
  )
80
 
81
  if st.button("Tokenize Text"):
 
 
82
  tokens = word_tokenize(example_text)
83
  st.write("Tokens:", tokens)
84
  st.write("Number of tokens:", len(tokens))
 
79
  )
80
 
81
  if st.button("Tokenize Text"):
82
+ nltk.download('punkt_tab')
83
+ nltk.download('stopwords')
84
  tokens = word_tokenize(example_text)
85
  st.write("Tokens:", tokens)
86
  st.write("Number of tokens:", len(tokens))