Glad to appear in my friend Rand Xie’s talk! See: 22:29
Thanks for mentioning me. See 17:10
The choice of random seed across different runs has a larger impact on disentanglement scores than the model choice and the strength of regularization (while naively one might expect that more regularization should always lead to more disentanglement). A good run with a bad hyperparameter can easily beat a bad run with a good hyperparameter.