Skip to content

Bag of Tricks in Machine Learning

Public Personal Notebook

Search
  • Home
  • random
  • paper
  • list
  • nlp
  • reinforcementlearning
  • gan
  • cv
  • Search

A Hitchhiker’s Guide On Distributed Training of Deep Neural Networks

January 14, 2019January 14, 2019 by admin

https://arxiv.org/abs/1810.11787

Categories random Tags distributedtraining
Post navigation
Understanding binary cross-entropy (Daniel Godoy)
Do CIFAR-10 Classifiers Generalize to CIFAR-10?

Best practice to follow this website

  1. In Feedly, click “add content”
  2. Input the url “bagoftricks.ml” and follow

ShujianFollow

Shujian
Retweet on TwitterShujian Retweeted
arxiv_in_reviewarXiv in review@arxiv_in_review·
7 Jan

#NeurIPS2020 Parameterized Explainer for Graph Neural Network. (arXiv:2011.04573v1 [cs\.LG] CROSS LISTED) http://arxiv.org/abs/2011.04573

Reply on Twitter 1346988622566850563Retweet on Twitter 13469886225668505631Like on Twitter 13469886225668505632Twitter 1346988622566850563
Retweet on TwitterShujian Retweeted
facebookaiFacebook AI@facebookai·
24 Dec

We’re open-sourcing a new system to train computer vision models using Transformers. Data-efficient image Transformers (DeiT) is a high-performance image classification model requiring less data & computing resources to train than previous AI models. https://ai.facebook.com/blog/data-efficient-image-transformers-a-promising-new-technique-for-image-classification/

Reply on Twitter 1341957881059373056Retweet on Twitter 1341957881059373056545Like on Twitter 13419578810593730562038Twitter 1341957881059373056
Retweet on TwitterShujian Retweeted
slashML/MachineLearning@slashML·
11 Nov

Long Range Arena: A Benchmark for Efficient Transformers https://www.reddit.com/r/MachineLearning/comments/jrxe8b/r_long_range_arena_a_benchmark_for_efficient/

Reply on Twitter 1326386125229989895Retweet on Twitter 13263861252299898951Like on Twitter 132638612522998989511Twitter 1326386125229989895
Retweet on TwitterShujian Retweeted
JoeBidenJoe Biden@JoeBiden·
7 Nov

America, I’m honored that you have chosen me to lead our great country.

The work ahead of us will be hard, but I promise you this: I will be a President for all Americans — whether you voted for me or not.

I will keep the faith that you have placed in me.

Reply on Twitter 1325118992785223682Retweet on Twitter 1325118992785223682618174Like on Twitter 13251189927852236823324962Twitter 1325118992785223682
Retweet on TwitterShujian Retweeted
BrentToderianBrent Toderian@BrentToderian·
5 Nov

How to mislead with maps.
(Land doesn’t vote — people do.)

Reply on Twitter 1324365392551161856Retweet on Twitter 13243653925511618563742Like on Twitter 132436539255116185611436Twitter 1324365392551161856
Load More...

Categories

  • ml (2)
  • nlp (9)
  • papers (1)
  • random (8)
  • reinforcementlearning (1)
  • Uncategorized (57)

Tags

anomaly (1) automl (1) ctr (1) cv (2) data (1) distributedtraining (1) gan (1) kaggle (1) list (2) ml (2) nlp (9) nn (1) paper (1) random (3) reinforcementlearning (1) sql (1)

Recent Posts

  • Data Augmentation in NLP
  • PyTorch nn.DistributedDataParallel
  • Unsupervised Pre-Training of Image Features on Non-Curated Data (by FAIR)
  • Image Classification Papers
  • PyTorch fast

Archives

  • May 2020 (1)
  • October 2019 (1)
  • August 2019 (11)
  • July 2019 (8)
  • June 2019 (6)
  • May 2019 (1)
  • April 2019 (11)
  • March 2019 (4)
  • February 2019 (2)
  • January 2019 (32)

Recent Comments

    January 2019
    M T W T F S S
     123456
    78910111213
    14151617181920
    21222324252627
    28293031  
        Feb »

    • 0
    • 35
    • 27,174
    • 14,516
    • 77
    • 0

    Recent Posts

    • Data Augmentation in NLP
    • PyTorch nn.DistributedDataParallel
    • Unsupervised Pre-Training of Image Features on Non-Curated Data (by FAIR)
    • Image Classification Papers
    • PyTorch fast

    Categories

    • ml (2)
    • nlp (9)
    • papers (1)
    • random (8)
    • reinforcementlearning (1)
    • Uncategorized (57)

    Meta

    • Log in
    • Entries feed
    • Comments feed
    • WordPress.org
    © 2021 Bag of Tricks in Machine Learning • Powered by GeneratePress
    Scroll back to top