Spaces:
Sleeping
Sleeping
raymondEDS
commited on
Commit
·
1748447
1
Parent(s):
a2ec2d3
trying to test nltk
Browse files
app/__pycache__/main.cpython-311.pyc
CHANGED
Binary files a/app/__pycache__/main.cpython-311.pyc and b/app/__pycache__/main.cpython-311.pyc differ
|
|
app/components/__pycache__/login.cpython-311.pyc
CHANGED
Binary files a/app/components/__pycache__/login.cpython-311.pyc and b/app/components/__pycache__/login.cpython-311.pyc differ
|
|
app/pages/__pycache__/week_1.cpython-311.pyc
CHANGED
Binary files a/app/pages/__pycache__/week_1.cpython-311.pyc and b/app/pages/__pycache__/week_1.cpython-311.pyc differ
|
|
app/pages/__pycache__/week_4.cpython-311.pyc
CHANGED
Binary files a/app/pages/__pycache__/week_4.cpython-311.pyc and b/app/pages/__pycache__/week_4.cpython-311.pyc differ
|
|
app/pages/week_4.py
CHANGED
@@ -79,6 +79,8 @@ def show():
|
|
79 |
)
|
80 |
|
81 |
if st.button("Tokenize Text"):
|
|
|
|
|
82 |
tokens = word_tokenize(example_text)
|
83 |
st.write("Tokens:", tokens)
|
84 |
st.write("Number of tokens:", len(tokens))
|
|
|
79 |
)
|
80 |
|
81 |
if st.button("Tokenize Text"):
|
82 |
+
nltk.download('punkt_tab')
|
83 |
+
nltk.download('stopwords')
|
84 |
tokens = word_tokenize(example_text)
|
85 |
st.write("Tokens:", tokens)
|
86 |
st.write("Number of tokens:", len(tokens))
|