Google Cast is a wonderful Cast service, but it needs a great Wi-Fi to functional well. And a lot of costumers is provided with standard routers from the ISP, what can never be recommend.
Can't change song
If you are using Tidal or Spotify with longer listening sessions. The connection may timeout at some point, or kind of disconnect from your phone. This is done to save battery. Just play the next song to wake up the device once more. (Yes it is annoying when your phone rings)
Others can interfere with the playlist and volume level?
In the Google Home setting you have the option to allow others on local network to control or see what you are playing. Turn the feature off if you don't like kids' interrupting.
Slow to connect
If you don't like the slow start when playing a song. We would suggest to buy a performance router to lower the network latency. Processor and ram is key.