GPU's as CPU's

Would'nt it be great if we could throw our CPU processors out and use only our video card GPU's ...

I am proposing just that idea , but with a twist instead of just NVIDIA CUDA and other GPGPU interfaces , we could design a whole new OS with microkernel architecture and distributed processing in the desktop box itself.

This i beleive could get a more usage of the GPU hardware and make processing cheaper and efficient.