A Novel Approach to Automatic Layout for User Interface Elements in Augmented Reality

While most virtual objects in Augmented Reality systems are expected to be placed at fixed, stable positions within the real world, certain classes of objects, such as user interface elements, can be placed more flexibly in the 3D world. Such objects only need to stay within the vicinity of specified 3D positions. At the same time, these objects typically need to satisfy other sets of requirements, e.g., they should not occlude one another or important real objects in the user's current view. Bell et. al. have developed a label placement system which creates a relationship between the used and unused space, by representing it by rectangles. Due to the complexity of computing the inter-dependencies between all objects at every rendering step, the system is currently limited to a small number of labels. In addition, they can only be shown frontally. Particle systems provide a concept for the dynamic placement of a large number of inter-related objects into a three-dimensional world. We are exploring options towards using a particle system for presenting virtual objects in AR applications. To this end, new AR-related constraints have to be added to the energy functions that determine the placement of particles relative to 3D surfaces and other particles.     «

While most virtual objects in Augmented Reality systems are expected to be placed at fixed, stable positions within the real world, certain classes of objects, such as user interface elements, can be placed more flexibly in the 3D world. Such objects only need to stay within the vicinity of specified 3D positions. At the same time, these objects typically need to satisfy other sets of requirements, e.g., they should not occlude one another or important real objects in the user's current v...     »