Sure, if this is a big part of your workflow then that makes sense. Personally, I end up running 1-2 workstation machines with GUIs that I sometimes remote out from, but ~never into (apart from sometimes retrieving files from the desktop when I'm away).