Just why? At that point just get a plain old framebuffer and plot individual pixels to it in serial code. How is it better to hack a use-case terminals were not meant to handle? They will have all the other complexities of GUIs still to solve, you just now has a hacky render path to worry about as well.
That's really impressive, but does it run on Windows, Mac, and Linux including image support? Do you have a link to any examples of more traditional application UI as opposed to demo flavored?