Mine was working back when I posted earlier but this morning I noticed it not working properly.
Spent awhile uninstalling and reinstalling Google app, every time some parts would work and not others, then rejoined Google Play Services beta and updated and now Google Assistant works properly again.