Check out this amazing WPF 3D app that interactively places 3D elements on the screen given a video/visual input.
This opens a few doors :) In fact, here is an example of a real world application of the technology in use by an auto mechanic: