Skip to content

Bag of Tricks in Machine Learning

Public Personal Notebook

  • Home
  • random
  • paper
  • list
  • nlp
  • reinforcementlearning
  • gan
  • cv

PyTorch nn.DistributedDataParallel

October 12, 2019 by admin

https://yangkky.github.io/2019/07/08/distributed-pytorch-tutorial.html

Categories Uncategorized
Post navigation
Unsupervised Pre-Training of Image Features on Non-Curated Data (by FAIR)
Data Augmentation in NLP

Best practice to follow this website

  1. In Feedly, click “add content”
  2. Input the url “bagoftricks.ml” and follow

ShujianFollow

Shujian
Retweet on TwitterShujian Retweeted
achowdheryAakanksha Chowdhery@achowdhery·
11 May

#GoogleIO2022 showcases reasoning and multilingual capabilities of PaLM model.
https://youtu.be/nP-nMZpLM1A?t=7240
Blog: https://ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html
arXiv: https://arxiv.org/abs/2204.02311

2
Reply on Twitter 1524473852704681984Retweet on Twitter 1524473852704681984131Like on Twitter 1524473852704681984726Twitter 1524473852704681984
Retweet on TwitterShujian Retweeted
christopherChristopher Akiki@christopher·
5 May

A rather hidden @huggingface tokenizers feature: the Visualizer.

Reply on Twitter 1522226910171914241Retweet on Twitter 152222691017191424115Like on Twitter 1522226910171914241104Twitter 1522226910171914241
Retweet on TwitterShujian Retweeted
MetaAIMeta AI@MetaAI·
3 May

Today Meta AI is sharing OPT-175B, the first 175-billion-parameter language model to be made available to the broader AI research community. OPT-175B can generate creative text on a vast range of topics. Learn more & request access: https://ai.facebook.com/blog/democratizing-access-to-large-scale-language-models-with-opt-175b

Reply on Twitter 1521489996145958914Retweet on Twitter 1521489996145958914659Like on Twitter 15214899961459589142339Twitter 1521489996145958914
Retweet on TwitterShujian Retweeted
StackOverflowStack Overflow@StackOverflow·
2 May

I think I can, I think I can, I think I can. #stackoverflowmemes #mememay

Reply on Twitter 1521236849003540483Retweet on Twitter 15212368490035404833123Like on Twitter 152123684900354048323115Twitter 1521236849003540483
Retweet on TwitterShujian Retweeted
jobergumJo Kristian Bergum@jobergum·
21 Apr

Super excited about these new features we are adding to Vespa, the leading vector database:

- Chose between post filtering or pre filtering at query time when combining vector search with filters
- Up to 2x speed up of hybrid retrieval combining sparse WAND and vector search

Reply on Twitter 1517210650388402178Retweet on Twitter 15172106503884021783Like on Twitter 151721065038840217837Twitter 1517210650388402178
Load More...

Categories

  • ml (2)
  • nlp (12)
  • papers (1)
  • random (8)
  • reinforcementlearning (1)
  • Uncategorized (57)

Tags

anomaly (1) automl (1) ctr (1) cv (2) data (1) distributedtraining (1) gan (1) kaggle (1) list (2) ml (2) NER (1) nlp (10) nn (1) paper (1) random (3) reinforcementlearning (1) sql (1)

Recent Posts

  • Version mismatch in embedding-based retrieval
  • NER with small strongly labeled and large weakly labeled data
  • A Survey of Data Augmentation Approaches for NLP
  • Data Augmentation in NLP
  • PyTorch nn.DistributedDataParallel

Archives

  • July 2021 (2)
  • June 2021 (1)
  • May 2020 (1)
  • October 2019 (1)
  • August 2019 (11)
  • July 2019 (8)
  • June 2019 (6)
  • May 2019 (1)
  • April 2019 (11)
  • March 2019 (4)
  • February 2019 (2)
  • January 2019 (32)

Recent Comments

    October 2019
    M T W T F S S
     123456
    78910111213
    14151617181920
    21222324252627
    28293031  
    « Aug   May »

    • 0
    • 3
    • 86,605
    • 42,922
    • 80
    • 0

    Recent Posts

    • Version mismatch in embedding-based retrieval
    • NER with small strongly labeled and large weakly labeled data
    • A Survey of Data Augmentation Approaches for NLP
    • Data Augmentation in NLP
    • PyTorch nn.DistributedDataParallel

    Categories

    • ml (2)
    • nlp (12)
    • papers (1)
    • random (8)
    • reinforcementlearning (1)
    • Uncategorized (57)

    Meta

    • Log in
    • Entries feed
    • Comments feed
    • WordPress.org
    © 2022 Bag of Tricks in Machine Learning • Built with GeneratePress