๐Ÿ“— Deep Learning Chapter 2 Linear Algebra

April 18, 2019

Ian Goodfellow์˜ Deep Learning ์ฑ…์„ ๋ณด๊ธฐ ์‹œ์ž‘ํ–ˆ๋‹ค. ํ•ด๋‹น ์ฑ…์— ๋Œ€ํ•ด ์ถ”์ฒœ์„ ๋งŽ์ด ๋ฐ›์•˜๊ณ , ๋งˆ์นจ ์ถœํŒ์‚ฌ ์ด๋ฒคํŠธ๋กœ ์ฐธ๊ฐ€ํ•ด์„œ ๋ฒˆ์—ญ๋ณธ๋„ ์šด ์ข‹๊ฒŒ ์ง‘์— ์žˆ์—ˆ๊ธฐ ๋•Œ๋ฌธ์— ์ค‘์š”ํ•œ ๋ถ€๋ถ„๋งŒ ๊ณจ๋ผ์„œ ์ •๋ฆฌํ•ด๋ณธ๋‹ค!

Tags: note
Read More

๐Ÿ“• CS224n Lecture 4 Backpropagation

April 13, 2019

CS224n ๋„ค๋ฒˆ์งธ ๊ฐ•์˜๋ฅผ ๋“ฃ๊ณ  ์ •๋ฆฌํ•œ ํฌ์ŠคํŠธ!! ์ด๋ฒˆ ๊ฐ•์˜๋Š” ๋‹ค๋ฅธ ๊ฐ•์˜๋ฅผ ๋“ค์œผ๋ฉด์„œ ๋งŽ์ด ๋ณด์•˜๋˜ ๋‚ด์šฉ์ด๊ณ  ๋งŽ์ด ๋‹ค๋ฅผ ๊ฒƒ์ด ์—†๋‹ค ์ƒ๊ฐํ•˜๊ณ  ๋ณ„ ๊ธฐ๋Œ€์—†์ด ๋“ค์—ˆ๋‹ค.

Tags: cs224n
Read More

๐Ÿ“ƒ GloVe ๋…ผ๋ฌธ ์ •๋ฆฌํ•ด๋ณด๊ธฐ

April 8, 2019

์ด ๋…ผ๋ฌธ์€ cs224n ๊ฐ•์˜ 2๊ฐ•์—์„œ suggested readings๋กœ ์ถ”์ฒœ๋œ ๋…ผ๋ฌธ์ด๋‹ค. ์Šคํƒ ํฌ๋“œ์—์„œ ์ž‘์„ฑํ•œ ๋…ผ๋ฌธ์ด๊ณ , ์˜๋ฏธ๊ถŒ์—์„œ ๋ฒ ์ด์Šค๋กœ ํ™œ์šฉ์ด ๋งŽ์ด ๋œ๋‹ค๊ณ  ํ•ด์„œ ๋”ฐ๋กœ ์ •๋ฆฌ๋ฅผ ํ•ด๋ณด๊ธฐ๋กœ ํ—€๋‹ค! ์‚ฌ์‹ค ์ด๋ฒˆ ํฌ์ŠคํŠธ๋Š” ๋‚ด๊ฐ€ ๋‹ค์‹œ ๋ณด๊ธฐ ์œ„ํ•ด ๊ฐ„๋‹จํ•˜๊ฒŒ...

Tags: paper
Read More

๐Ÿ“ƒ Negative Sampling ๋…ผ๋ฌธ ์ •๋ฆฌํ•ด๋ณด๊ธฐ

April 7, 2019

cs224n์„ ๊ณต๋ถ€ํ•˜๋ฉด์„œ ๊ด€๋ จ๋œ ๋…ผ๋ฌธ์ด suggested readings์— ์žˆ์–ด์„œ ์ฒœ์ฒœํžˆ ์ฝ์–ด๋ณด๋Š” ์ค‘์ธ๋ฐ ์ด๋ฒˆ์— ์ฝ์€ ๋…ผ๋ฌธ์€ negative sampling์œผ๋กœ ์œ ๋ช…ํ•œ Distributed Representations of Words and Phrases and their Compositionality์ด๋‹ค.

Tags: paper
Read More

๐Ÿš€ jekyll ์†๋„ ์˜ฌ๋ฆฌ๊ธฐ

April 7, 2019

๊ฐœ์ธ ๋ธ”๋กœ๊ทธ๋กœ github pages์™€ jekyll์„ ์‚ฌ์šฉํ•˜๊ณ  ๋‚˜์„œ๋ถ€ํ„ฐ ๋กœ์ปฌ์—์„œ jekyll์„ ๋Œ๋ฆฌ๋ฉด์„œ ํฌ์ŠคํŠธ๊ฐ€ ์ œ๋Œ€๋กœ ์ž‘์„ฑ๋˜์—ˆ๋Š”์ง€ ํ‘ธ์‰ฌํ•˜๊ธฐ ์ „ ๋งค๋ฒˆ ํ™•์ธํ•˜๊ณ  ์žˆ๋‹ค. ๋ณดํ†ต ๋‚˜๋Š” ํฌ์ŠคํŠธ๋ฅผ _drafts ํด๋”์— ์šฐ์„  ๋„ฃ์–ด๋†“๊ณ  ์ž‘์„ฑํ•˜๋Š” ํŽธ์ด๋ผ, ๋“œ๋ž˜ํ”„ํŠธ๊นŒ์ง€...

Read More

๐Ÿ“• CS224n Lecture 1 Introduction and Word Vectors

April 6, 2019

์ €๋ฒˆ์ฃผ๋ถ€ํ„ฐ CS224n ์Šคํ„ฐ๋””๋ฅผ ์‹œ์ž‘ํ–ˆ๋‹ค! CS231n ๋“ค์„ ๋•Œ๋ž‘ ๋‹ค๋ฅด๊ฒŒ ๋‹ค๋ฅธ ์‚ฌ๋žŒ์ด๋ž‘ ๊ฐ™์ด ํ•˜๋ฉด ๊ทธ๋ž˜๋„ ๋๊นŒ์ง€ ๋“ฃ์ง€ ์•Š์„๊นŒ ์‹ถ์–ด์„œ ํ•œ๋ฒˆ ํ•ด๋ณด์ž๊ณ  ์ฃผ์œ„์‚ฌ๋žŒ๋“ค์„ ๋Œ์–ด๋ชจ์•„๋ดค๋‹ค. ์ด ํฌ์ŠคํŠธ๋Š” 1๊ฐ• ๊ฐ•์˜ ๋…ธํŠธ๋ฅผ ์ •๋ฆฌํ•œ ํฌ์ŠคํŠธ์ด๋‹ค.

Tags: cs224n
Read More

๐Ÿ“ƒ Word2Vec ๋…ผ๋ฌธ ์ •๋ฆฌํ•ด๋ณด๊ธฐ

April 6, 2019

CS224n์„ ๋“ฃ๊ธฐ ์‹œ์ž‘ํ•˜๊ณ  ๋‚˜์„œ ๊ฐ™์ด ๋‚˜์˜ค๋Š” suggested readings๋ฅผ ๊ฐ€๋” ์ฝ๋Š”๋ฐ, word2vec์˜ ๋…ผ๋ฌธ์œผ๋กœ ์œ ๋ช…ํ•œ Efficient Estimation of Word Representation in Vector Space๋„ ๊ทธ ์ค‘ ํ•˜๋‚˜์ด๋‹ค. ๊ณต๋ถ€๋ฅผ ํ•˜๋ฉด์„œ ๋‹ค์‹œ ๋ณผ๋งŒํ•œ ๋‚ด์šฉ,...

Tags: paper
Read More

python assignment operator (PEP 572)

April 5, 2019

python 3.8.0 a1, a2 ๋ฒ„์ „์ด 2์›”๋‹ฌ์— ๋ฆด๋ฆฌ์ฆˆ๋˜์—ˆ๋‹ค. 4๊ฐœ์˜ ์•ŒํŒŒ๋ฒ„์ „ ์ค‘ ๋‘๋ฒˆ์งธ์ธ a2๋ฒ„์ „์€ 2์›” 25์ผ์— ์ถœ์‹œ๋˜์—ˆ๋‹ค. ๋ฒ ํƒ€๊ฐ€ ๋‚˜์˜ค๊ธฐ ์ „ (alpha phase, ~2019-05-26)์— ์ƒˆ๋กœ์šด ๊ธฐ๋Šฅ๋“ค์ด ์ถ”๊ฐ€๋œ๋‹ค๊ณ  ํ•œ๋‹ค.

Tags: python
Read More