Google’s Deep Learning Tuning Playbook

This guide has tons of tricks that are usually not covered in textbooks: https://github.com/google-research/tuning_playbook