Are you using Xephyr to render it in an X11 window or are you doing it some other way? Alternatively, you could forget about starting it in an X11 window and start it on another VT and remap some keys to make it easy to switch back and forth between X11 and SurfaceFlinger.