random Archives - Bag of Tricks in Machine Learning

A Hitchhiker’s Guide On Distributed Training of Deep Neural Networks

January 14, 2019January 14, 2019 by admin

https://arxiv.org/abs/1810.11787

Sleepwalk – walk through embedding (S. Anders)

January 12, 2019January 12, 2019 by admin

https://anders-biostat.github.io/sleepwalk/

DNN in SQL

January 11, 2019January 11, 2019 by admin

https://towardsdatascience.com/deep-neural-network-implemented-in-pure-sql-over-bigquery-f3ed245814d3

Random seed optimization in GAN research?

January 10, 2019January 10, 2019 by admin

Two quotes from this paper: Are GANs Created Equal? A Large-Scale Study

Even with everything else being fixed, varying the random seed may influence on the results
authors often report the best FID which opens the door for random seed optimization

37 Reasons why your Neural Network is not working (Slav Ivanov)

January 9, 2019January 9, 2019 by admin

https://blog.slavv.com/37-reasons-why-your-neural-network-is-not-working-4020854bd607

Why should we install TensorFlow with conda?

January 9, 2019January 9, 2019 by admin

https://towardsdatascience.com/stop-installing-tensorflow-using-pip-for-performance-sake-5854f9d9eb0c

Tensorflow with Python 3.7?

January 9, 2019January 9, 2019 by admin

Now Anaconda’s default Python is 3.7 however, it is tricky to install Tensorflow on top of it:

https://github.com/tensorflow/tensorflow/issues/23478#issue-377079541

Better to downgrade Python now: https://stackoverflow.com/questions/52584907/how-to-downgrade-python-from-3-7-to-3-6

Trick = Experience + Magic

August 25, 2019January 8, 2019 by admin

(how large is the size of the decoder)