I split up the bootdeb script into 3 parts. One that mounts and sets up the image. One that lets you connect to it. And one that shuts it all down again. This way you can start it up, connect, start X, disconnect, ssh into the box, connect to deb, etc... I did not want it unmounting and shutting everything down when the shell exits.
I need to add a bunch of error checking to the scripts to make it robust though. That'd be a real improvement.