Specifically fixes a bug in smoke-test where it would just move on after failing to install latest js dependencies with yarn.
This will be used by migration scripts.