#conference

• 🎊 PyTorch Ecosystem Day 2021 at Apr 22, 2021
• 편리한 NLP를 위한 TensorFlow-Text와 RaggedTensor at Feb 27, 2021
• 🎊 if(kakao)2020 세션 정리 at Nov 30, 2020
• 🎊 PyTorch Developer Day 2020 at Nov 17, 2020
• 🎊 Pycon KR 2019 at Sep 03, 2019
• 🎊 F8 2019 Hackathon at May 15, 2019

6 posts

#cs224n

• 📕 CS224n Lecture 18 Constituency Parsing and Tree Recursive Neural Networks at Jul 14, 2019
• 📕 CS224n Lecture 17 The Natural Language Decathlon: Multitask Learning as Question Answering at Jul 07, 2019
• 📕 CS224n Lecture 15 Natural Language Generation at Jun 29, 2019
• 📕 CS224n Lecture 14 Transformers and Self-Attention For Generative Models at Jun 09, 2019
• 📕 CS224n Lecture 13 Modeling contexts of use: Contextual Representations and Pretraining at Jun 09, 2019
• 📕 CS224n Lecture 12 Information from parts of words: Subword Models at Jun 09, 2019
• 📕 CS224n Lecture 11 ConvNets for NLP at Jun 08, 2019
• 📕 CS224n Lecture 10 (Textual) Question Answering at Jun 08, 2019
• 📕 CS224n Lecture 9 Practical Tips for Final Projects at May 26, 2019
• 📕 CS224n Lecture 8 Machine translation, Seq2seq, Attention at May 26, 2019
• 📕 CS224n Lecture 7 Vanishing Gradients, Fancy RNNs at May 19, 2019
• 📕 CS224n Lecture 6 Language Models and RNNs at Apr 21, 2019
• 📕 CS224n Lecture 5 Dependency Parsing at Apr 20, 2019
• 👨‍💻 CS224n assignments 1 & 2 at Apr 18, 2019
• 📕 CS224n Lecture 4 Backpropagation at Apr 13, 2019
• 📕 CS224n Lecture 3 Neural Network at Apr 09, 2019
• 📕 CS224n Lecture 2 Word Vectors and Word Senses at Apr 07, 2019
• 📕 CS224n Lecture 1 Introduction and Word Vectors at Apr 06, 2019

18 posts

#cs231n

• KNN 방식의 Image Classifier at Sep 08, 2018
• CS231n Lecture 5. Convolutional Neural Networks at Sep 06, 2018
• CS231n Lecture 4. Introduction to Neural Networks at Sep 04, 2018
• CS231n Lecture 3. Loss Function and Optimization at Jul 22, 2018
• CS231n Python Numpy Tutorial at Aug 21, 2017
• CS231n Nearest Neighbor 방식의 Image Classifier at Aug 21, 2017
• CS231n Linear Classification 방식의 Image Classifier at Aug 21, 2017
• CS231n KNN 방식의 Image Classifier at Aug 21, 2017
• CS231n Lecture 2. Image Classification Pipeline at Aug 20, 2017
• CS231n Lecture 1. Introduction to Convolutional Neural Networks for Visual Recognition at Aug 20, 2017

10 posts

#cs330

• 📕 CS330 Lecture 2 Multi-Task & Meta-Learning Basics at Apr 06, 2021
• 📕 CS330 Lecture 1 Introduction & Overview at Mar 24, 2021

2 posts

#nlp

• SimCSE 리뷰 & KR-BERT 이용해서 구현해보기 at Jul 23, 2021
• 편리한 NLP를 위한 TensorFlow-Text와 RaggedTensor at Feb 27, 2021
• 한국어 띄어쓰기 모델 작성하기 at Sep 23, 2020
• 🤗 The Future of Natural Language Processing - Model Size and Computational Efficiency at May 11, 2020

4 posts

#non-tech

• 🎊 F8 2019 Hackathon at May 15, 2019
• Jpub 베타리더를 되돌아보며 at Apr 01, 2019
• 슬랙 개인용으로 사용하기 at Nov 28, 2018

3 posts

#note

• CLIP Self Attention Visualization at May 04, 2021
• C++ std::unique 동작 at Jan 02, 2021
• "Clean Architecture: A Craftsman's Guide to Software Structure and Design" 1 - Introduction and Programming Paradigms at Aug 24, 2020
• Compound File Binary File Format 오버뷰..? at Aug 22, 2020
• 🍃 Mongo DB Sharding at Apr 22, 2019
• 📗 Deep Learning Chapter 2 Linear Algebra at Apr 18, 2019
• GitHub + CircleCI + AWS CodeDeploy 설정하기 at Oct 10, 2017

7 posts

#paper

• SimCSE 리뷰 & KR-BERT 이용해서 구현해보기 at Jul 23, 2021
• Pretrained Transformers As Universal Computation Engines 리뷰 at Apr 19, 2021
• TextSETTR: Label-Free Text Style Extraction and Tunable Targeted Restyling 리뷰 at Mar 21, 2021
• Hidden Technical Debt in Machine Learning Systems at Dec 28, 2020
• 최근 읽은 논문/아티클 정리 (Triplet Loss for Knowledge Distillation, Weight Distillation, Understanding and Improving Knowledge Distillation) at Oct 21, 2020
• 최근 읽은 논문/아티클 정리 (PRADO, Quasi-RNN, Advancing NLP with Efficient Projection-Based Model Architectures, Small and Practical BERT Models for Sequence Labeling) at Oct 13, 2020
• 최근 읽은 논문 정리 (AIN, Repulsive Attention, Improving Transformer Optimization Through Better Initialization, ReZero) at Sep 25, 2020
• MIXOUT: Effective Regularization to Finetune Large-scale Pretrained Language Model at Sep 08, 2020
• 📃 On Layer Normalization in the Transformer Architecture 리뷰 at Jul 16, 2020
• 📃 Fast and Accurate Deep Bidirectional Language Representation for Unsupervised Learning 리뷰 at Jul 12, 2020
• 📃 Revealing the Dark Secrets of BERT 리뷰 at Jul 06, 2020
• 📃 Are Sixteen Heads Really Better than One? 리뷰 at May 18, 2020
• 📃 Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned 리뷰 at May 18, 2020
• 📃 DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation 리뷰 at May 02, 2020
• 📃 ZeRO: Memory Optimization Towards Training A Trillion Parameter Models 리뷰 at May 01, 2020
• 📃 TinyBERT: Distilling BERT For Natual Language Understanding 리뷰 at May 01, 2020
• 📃 Layer Normalization 리뷰 at May 01, 2020
• 📃 Efficient 8-Bit Quantization of Transformer Neural Machine Language Translation Model 리뷰 at Apr 27, 2020
• 📃 Patient Knowledge Distillation for BERT Model Compression 리뷰 at Apr 16, 2020
• 📃 Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding 리뷰 at Apr 16, 2020
• 📃 Distilling the Knowledge in a Neural Network 리뷰 at Apr 16, 2020
• 📃 Q8BERT: Quantized 8Bit BERT 리뷰 at Apr 14, 2020
• 📃 FastBERT: a Self-distilling BERT with Adaptive Inference Time 리뷰 at Apr 14, 2020
• 📃 DynaBERT: Dynamic BERT with Adaptive Width and Depth 리뷰 at Apr 13, 2020
• 📃 transformers.zip 리뷰 at Oct 27, 2019
• 📃 ALBERT 리뷰 at Oct 27, 2019
• 📃 RoBERTa 리뷰 at Oct 27, 2019
• 📃 DistilBert 리뷰 at Oct 27, 2019
• 📃 GPT2 리뷰 at Oct 27, 2019
• 📃 GPT 리뷰 at Oct 20, 2019
• 📃 BERT 리뷰 at Oct 14, 2019
• 🔪 Mecab을 살펴보자 at Oct 09, 2019
• 📃 Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data at Oct 07, 2019
• 📃 Review of "Attention Is All You Need" at Jul 21, 2019
• 📃 GloVe 논문 정리해보기 at Apr 08, 2019
• 📃 Negative Sampling 논문 정리해보기 at Apr 07, 2019
• 📃 Word2Vec 논문 정리해보기 at Apr 06, 2019
• Efficient BackProp 정리 at Jul 24, 2018

38 posts

#python

• TensorFlow Model.compile Customization 시 Mixed Precision Training 실패 at Jul 25, 2021
• SimCSE 리뷰 & KR-BERT 이용해서 구현해보기 at Jul 23, 2021
• CLIP Self Attention Visualization at May 04, 2021
• 🐍 List Comprehension이 빠른 이유를 찾아보자 at Jun 21, 2020
• 🐍 PEP(Python Enhancement Proposal)란 무엇일까 at Mar 27, 2020
• 핑퐁팀의 Python 문화 구축기 at Feb 12, 2020
• python assignment operator (PEP 572) at Apr 05, 2019
• flask에서 profiling 하기 at Apr 04, 2019
• python의 profiler at Mar 01, 2019
• Python GIL at Feb 20, 2019
• Python Iterator at Feb 16, 2019
• Python에서 시간측정하기 at Feb 15, 2019
• Flask로 CI 구성해보기 at Aug 30, 2017
• CS231n Python Numpy Tutorial at Aug 21, 2017
• CS231n Nearest Neighbor 방식의 Image Classifier at Aug 21, 2017
• CS231n Linear Classification 방식의 Image Classifier at Aug 21, 2017
• CS231n KNN 방식의 Image Classifier at Aug 21, 2017

17 posts

#pytorch

• 🎊 PyTorch Ecosystem Day 2021 at Apr 22, 2021
• 하나의 조직에서 TensorFlow와 PyTorch 동시 활용하기 at Dec 04, 2020
• 딥러닝 모델 서비스 A-Z 2편 - Knowledge Distillation at Nov 18, 2020
• 🎊 PyTorch Developer Day 2020 at Nov 17, 2020
• 🚀 Apex's FusedLayerNorm vs Torch's LayerNorm at Jun 17, 2020
• 딥러닝 모델 서비스 A-Z 1편 - 연산 최적화 및 모델 경량화 at Mar 11, 2020
• 🔥 PyTorch C++ FrontEnd 개발환경 맥에서 세팅 at Oct 21, 2019

7 posts

#scatterlab

• TensorFlow Custom Op으로 데이터 변환 최적화하기; 4.697ms → 17.147μs at Jan 07, 2021
• 하나의 조직에서 TensorFlow와 PyTorch 동시 활용하기 at Dec 04, 2020
• 딥러닝 모델 서비스 A-Z 2편 - Knowledge Distillation at Nov 18, 2020
• 딥러닝 모델 서비스 A-Z 1편 - 연산 최적화 및 모델 경량화 at Mar 11, 2020
• 핑퐁팀의 Python 문화 구축기 at Feb 12, 2020

5 posts

#studyjam

• 🤖 2019 머신러닝 스터디잼 중급반 at May 19, 2019
• 2019 Cloud Studyjam 중급반(k8s) 1 at Apr 02, 2019
• 2019 머신러닝 스터디잼 입문반 at Feb 11, 2019
• Kubernetes 패키지 매니저 Helm at Feb 06, 2019
• 2019 클라우드 스터디잼 4~6 - kubernetes at Feb 04, 2019
• 2019 클라우드 스터디잼 1~3 - kubernetes at Feb 03, 2019

6 posts

#tensorflow

• TensorFlow Model.compile Customization 시 Mixed Precision Training 실패 at Jul 25, 2021
• SimCSE 리뷰 & KR-BERT 이용해서 구현해보기 at Jul 23, 2021
• TensorFlow Datasets로 tfds-korean 작성하기 at Apr 25, 2021
• TensorFlow의 softmax_cross_entropy_with_logits의 Non-determinism 이슈 at Mar 23, 2021
• TensorFlow의 SparseCategoricalCrossentropy의 from_logits 옵션 at Mar 08, 2021
• 편리한 NLP를 위한 TensorFlow-Text와 RaggedTensor at Feb 27, 2021
• TensorFlow Custom Op으로 데이터 변환 최적화하기; 4.697ms → 17.147μs at Jan 07, 2021
• 하나의 조직에서 TensorFlow와 PyTorch 동시 활용하기 at Dec 04, 2020
• 딥러닝 모델 서비스 A-Z 2편 - Knowledge Distillation at Nov 18, 2020
• 딥러닝 모델 서비스 A-Z 1편 - 연산 최적화 및 모델 경량화 at Mar 11, 2020
• 성능을 위한 TensorFlow Serving 커스텀 빌드 at Feb 26, 2020

11 posts

#web

• Vue에서 v-html warning 없이 줄바꿈하기 at Dec 21, 2018
• VSCode에서 Aliasing된 경로들 intellisense 지원하기 at Nov 22, 2018
• CircleCI에서 jest 사용할 때 ENOMEM이 뜨는 오류 at Nov 22, 2018
• Channel IO 커스텀화 at Oct 28, 2018

4 posts