admin

Concern: https://arxiv.org/abs/1906.02243

Good examples:

• $40 to train imagenet: https://www.fast.ai/2018/08/10/fastai-diu-imagenet
• Fastest end2end ASR: https://github.com/facebookresearch/wav2letter
• Neural architecture search in 1.5 days on a single GPU: https://arxiv.org/abs/1806.09055

Attention for interpretability:

• Learning to Explain: https://arxiv.org/abs/1802.07814  
• Attention is not Explanation: https://arxiv.org/abs/1902.10186  
• Is Attention Interpretable?: https://arxiv.org/abs/1906.03731

Reviews:

• https://lilianweng.github.io/lil-log/2018/06/24/attention-attention.html 
• https://arxiv.org/abs/1902.02181 
• https://arxiv.org/abs/1904.02874 
• https://arxiv.org/abs/1811.05544