Update README.md
Browse files
README.md
CHANGED
@@ -1 +1,26 @@
|
|
1 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language: ko
|
3 |
+
license: mit
|
4 |
+
tags:
|
5 |
+
- summarization
|
6 |
+
- bart
|
7 |
+
- longformer
|
8 |
+
---
|
9 |
+
- This model is a [kobart-news](https://huggingface.co/ainize/kobart-news) finetuned on the [๋ฌธ์์์ฝ ํ
์คํธ/์ ๋ฌธ๊ธฐ์ฌ](https://aihub.or.kr/aidata/8054)
|
10 |
+
|
11 |
+
<<20220904 Commit>>
|
12 |
+
๊ฐ์ธ ์คํฐ๋์ฉ์ผ๋ก ๊ธด ๋ฌธ์ฅ์ ์์ฝ ๋ชจ๋ธ ํนํ๋ ๋ชจ๋ธ์ ๋ง๋ค๊ธฐ ์ํด KoBART์ Input Size๋ฅผ 4096์ผ๋ก ๋ณ๊ฒฝํ์ฌ Customizing ์งํํ์ต๋๋ค.
|
13 |
+
KoBART ๋ชจ๋ธ์ Longformer Encoder Decoder๋ก ๋ณํํ ๋ชจ๋ธ์
๋๋ค.
|
14 |
+
๊ธฐ์กด์ transformers์ Model Load๋ก๋ ๋ชจ๋ธ์ ์ฐ๊ธฐ๊ฐ ์ด๋ ต์ต๋๋ค.
|
15 |
+
๊ฐ์ด ์ฌ๋ ค๋์ load_model.py๋ฅผ ๋ผ์ด๋ธ๋ฌ๋ฆฌํํ์ฌ ๋ชจ๋ธ์ ๋ก๋ํ์๋ฉด ์ฌ์ฉ ๊ฐ๋ฅํฉ๋๋ค.
|
16 |
+
|
17 |
+
KoBART ๋ชจ๋ธ์
|
18 |
+
|
19 |
+
์ถํ ์ง์์ ์ธ ์
๋ฐ์ดํธ๋ก ๋ณ๋์ ๋ถํธํจ ์์ด ์ฌ์ฉํ ์ ์๋๋ก ๋ฐ๊พธ๊ฒ ์ต๋๋ค.
|
20 |
+
|
21 |
+
# Python Code
|
22 |
+
```python
|
23 |
+
from transformers import PreTrainedTokenizerFast
|
24 |
+
from load_model import LongformerBartForConditionalGeneration
|
25 |
+
tokenizer = PreTrainedTokenizerFast.from_pretrained("hohovisual/KoBART_with_LED")
|
26 |
+
model = LongformerBartForConditionalGeneration.from_pretrained("hohovisual/KoBART_with_LED")
|