๐ŸŽŠ PyTorch Developer Day 2020

November 17, 2020

์–ผ๋งˆ์ „ PyTorch Team์—์„œ ์ฒ˜์Œ์œผ๋กœ ๊ฐœ์ตœํ•˜๋Š” PyTorch Developer Day์— ์ดˆ๋Œ€ํ•œ๋‹ค๋Š” ๋ฉ”์ผ์ด ์™€์„œ ํ™•์ธํ•ด๋ณด์•˜๋‹ค.

Tags: conference pytorch
Read More

ํ•œ๊ตญ์–ด ๋„์–ด์“ฐ๊ธฐ ๋ชจ๋ธ ์ž‘์„ฑํ•˜๊ธฐ

September 23, 2020

์ตœ๊ทผ lovit/namuwikitext๋ฅผ ๋ณด๋ฉด์„œ ๋ฐ์ดํ„ฐ๋ฅผ ํฌ๊ฒŒ ๋งŒ์ง€์ง€ ์•Š๊ณ  ํ•  ์ˆ˜ ์žˆ๋Š” ๊ฒƒ์ด ๋ฌด์—‡์ด ์žˆ์„๊นŒ ์‹ถ์—ˆ๋‹ค. ๊ณ ๋ฏผํ•ด๋ณด๋‹ค kakao/khaiii์˜ ์œ„ํ‚ค ํŽ˜์ด์ง€ ์ค‘ ๋„์–ด์“ฐ๊ธฐ ์˜ค๋ฅ˜์— ๊ฐ•๊ฑดํ•œ ๋ชจ๋ธ์„ ์œ„ํ•œ ์‹คํ—˜์„ ๋ณด๋ฉด์„œ ๋„์–ด์“ฐ๊ธฐ...

Tags: nlp
Read More

Compound File Binary File Format ์˜ค๋ฒ„๋ทฐ..?

August 22, 2020

์‚ฌ์ด๋“œ ํ”„๋กœ์ ํŠธ๋กœ HWP ํŒŒ์ผ ํฌ๋งท ํŒŒ์‹ฑ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋ฅผ ์งœ๋ฉด ์–ด๋–จ๊นŒ ์‹ถ์–ด์„œ ํฌ๋งท์„ ์‚ดํŽด๋ณด๋‹ˆ, CompoundFileBinary File Format์„ ๋”ฐ๋ฅด๋Š” ๊ฒƒ ๊ฐ™๋‹ค. ๊ทธ๋ฆฌ๊ณ  ์ด๋ฅผ ์ค„์—ฌ์„œ MS์—์„œ๋Š” CFB๋ผ ๋ถ€๋ฅด๋Š” ๊ฒƒ ๊ฐ™๊ณ , ํ•ด๋‹น ํฌ๋งท์ด [MS-CFB]๋ผ๋Š”...

Tags: note
Read More

๐Ÿ“ƒ On Layer Normalization in the Transformer Architecture ๋ฆฌ๋ทฐ

July 16, 2020

ICML 2020์— ๋‚˜์˜จ ๋…ผ๋ฌธ์ด๊ณ , ZeRO ํ•™์Šต ํŠœํ† ๋ฆฌ์–ผ์— ์“ฐ์ธ PreLN ๊ตฌ์กฐ๋ฅผ ์†Œ๊ฐœํ•œ ๋…ผ๋ฌธ์ด๋‹ค. Microsoft Research์—์„œ ๋‚˜์˜จ ๋…ผ๋ฌธ์ธ๋“ฏโ€ฆ? ๊ทธ๋ž˜์„œ ZeRO ํŠœํ† ๋ฆฌ์–ผ์—์„œ ์“ด ๊ฒƒ ๊ฐ™๋‹ค. BERT ํ•™์Šต ๋„์ค‘ ์ฝ์–ด๋ณธ ๋…ผ๋ฌธ์ด๋ผ ๊ฐ„๋‹จํ•˜๊ฒŒ๋งŒ ์ •๋ฆฌ

Tags: paper
Read More

๐Ÿ“ƒ Fast and Accurate Deep Bidirectional Language Representation for Unsupervised Learning ๋ฆฌ๋ทฐ

July 12, 2020

์–ผ๋งˆ ์ „ TensorFlow Korea์— ์ €์ž ๋ถ„์ด ์ง์ ‘ ์„ค๋ช…์„ ๊ฐ„๋žตํ•˜๊ฒŒ ๋‹ฌ์•„์ฃผ์…”์„œ ์ฝ์–ด๋ณธ ๋…ผ๋ฌธ์ด๋‹ค. ACL 2020 ๋ฐœํ‘œ๋œ ๋…ผ๋ฌธ์ด๊ณ , Abstract์— Similarity task์—๋Š” BERT-based ๋ชจ๋ธ์— ๋น„ํ•ด 12๋ฐฐ์ •๋„ ๋น ๋ฅธ ์†๋„๋ฅผ ๊ฐ€์ง€๋ฉด์„œ๋„ ๊ดœ์ฐฎ์€ ์„ฑ๋Šฅ์„ ๊ฐ€์ง„๋‹ค๊ณ ...

Tags: paper
Read More