Interactive building model builder

It may not be exactly what you are looking for, but it may give you some ideas. It is open source.

Showrooms easy to generate from data of a construction drawing or dimensional sketch - now on Github