Abstract: Embodiments herein generally relate to methods, systems and devices for automated assembly of building structures. In at least one embodiment, there is provided a method for automated assembly of building structures, the method comprises analyzing assembly data associated with a building structure; based on the analyzing, determining an assembly sequence for assembling building parts to construct the building structure, wherein the assembly sequence comprises a plurality of assembly tasks; generating robot-specific control instructions, for each of one or more assembly robots in a robotic assembly cell, to execute the assembly sequence; and transmitting the robot-specific control instructions to the one or more assembly robots in the robotic assembly cell.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating presentations of views of building entities according to an interaction graph. One of the methods includes processing building information model data to identify a plurality of building entities, wherein each building entity represents a respective feature of a building modeled by the data. Relationships between different respective pairs of the building entities are determined. The relationships are traversed according to simulated user interactions with respective presentations of a plurality of the building entities.

Abstract: A photo localization application is configured to determine the location that an image depicts relative to a 3D representation of a structure. The 3D representation may be a 3D model, color range scan, or gray scale range scan of the structure. The image depicts a particular section of the structure. The photo localization application extracts and stores features from the 3D representation in a database. The photo localization application then extracts features from the image and compares those features against the database to identify matching features. The matching features form a location fingerprint, from which the photo localization application determines the location that the image depicts, relative to the 3D representation. The location allows the user to better understand and communicate information captured by the image.

Abstract: One embodiment of the present invention sets forth a technique for providing an end user with a digital pen embedded with a spatially-aware miniature projector for use in a design environment. Paper documents are augmented to allow a user to access additional information and computational tools through projected interfaces. Virtual ink may be managed in single and multi-user environments to enhance collaboration and data management. The spatially-aware projector pen provides end-users with dynamic visual feedback and improved interaction capabilities.

Abstract: A photo localization application is configured to determine the location that an image depicts relative to a 3D representation of a structure. The 3D representation may be a 3D model, color range scan, or gray scale range scan of the structure. The image depicts a particular section of the structure. The photo localization application extracts and stores features from the 3D representation in a database. The photo localization application then extracts features from the image and compares those features against the database to identify matching features. The matching features form a location fingerprint, from which the photo localization application determines the location that the image depicts, relative to the 3D representation. The location allows the user to better understand and communicate information captured by the image.

Abstract: A system and method for augmenting panoramic images with performance related data for a building are disclosed. The system includes a memory coupled to a processor configured to receive panoramic image data, generate a digital image based on the panoramic image data, and modify the digital image to include a graphical representation of the performance related data. The processor maps performance related data to the coordinate system of the panoramic images such that the graphical representation may be generated without converting the panoramic image data into a high-quality, three-dimensional model in a CAD program. In this way, computer-generated graphical representations of building performance data, such as temperature fields or virtual structures, may be overlaid directly onto a two-dimensional projection of the panoramic image data. In one embodiment, the panoramic image data is a spherical, 360 degree panoramic image captured by a laser scanning device.

Abstract: One embodiment of the present invention sets forth a technique for providing an end user with a digital pen embedded with a spatially-aware miniature projector for use in a design environment. Paper documents are augmented to allow a user to access additional information and computational tools through projected interfaces. Virtual ink may be managed in single and multi-user environments to enhance collaboration and data management. The spatially-aware projector pen provides end-users with dynamic visual feedback and improved interaction capabilities.

Abstract: A photo localization application is configured to determine the location that an image depicts relative to a 3D representation of a structure. The 3D representation may be a 3D model, color range scan, or gray scale range scan of the structure. The image depicts a particular section of the structure. The photo localization application extracts and stores features from the 3D representation in a database. The photo localization application then extracts features from the image and compares those features against the database to identify matching features. The matching features form a location fingerprint, from which the photo localization application determines the location that the image depicts, relative to the 3D representation. The location allows the user to better understand and communicate information captured by the image.

Abstract: A computer implemented method for 3-D visualization of a building module and building related data includes receiving attributes of a plurality of building modules from a building information model and receiving data inputs from a plurality of sensors located in at least a subset of the plurality of building modules. The building related data is calculated for each of the plurality of building modules based on the data inputs. A 3-D visualization data of a selected building module in the plurality of building modules is generated for display on a computer screen.

Abstract: A photo localization application is configured to determine the location that an image depicts relative to a 3D representation of a structure. The 3D representation may be a 3D model, color range scan, or gray scale range scan of the structure. The image depicts a particular section of the structure. The photo localization application extracts and stores features from the 3D representation in a database. The photo localization application then extracts features from the image and compares those features against the database to identify matching features. The matching features form a location fingerprint, from which the photo localization application determines the location that the image depicts, relative to the 3D representation. The location allows the user to better understand and communicate information captured by the image.

Abstract: A system and method for displaying a unified representation of performance related data for a building are disclosed. The system includes a sensor network for collecting data in the building and a computing device for generating and displaying a unified representation of performance related data on a display. The performance related data may include the raw data collected by the sensor network or data generated by simulation programs based on the raw data collected by the sensor network. The computing device displays the performance related data in the context of a graphical representation of a three-dimensional model of the building as defined in a building information model (BIM). The computing device generates the graphical representation using an ambient occlusion rendering technique and then incorporates the performance related data either using a direct rendering technique or a transient geometry technique.

Abstract: A system and method for augmenting panoramic images with performance related data for a building are disclosed. The system includes a memory coupled to a processor configured to receive panoramic image data, generate a digital image based on the panoramic image data, and modify the digital image to include a graphical representation of the performance related data. The processor maps performance related data to the coordinate system of the panoramic images such that the graphical representation may be generated without converting the panoramic image data into a high-quality, three-dimensional model in a CAD program. In this way, computer-generated graphical representations of building performance data, such as temperature fields or virtual structures, may be overlaid directly onto a two-dimensional projection of the panoramic image data. In one embodiment, the panoramic image data is a spherical, 360 degree panoramic image captured by a laser scanning device.

Abstract: A computer implemented method for 3-D visualization of a building module and building related data includes receiving attributes of a plurality of building modules from a building information model and receiving data inputs from a plurality of sensors located in at least a subset of the plurality of building modules. The building related data is calculated for each of the plurality of building modules based on the data inputs. A 3-D visualization data of a selected building module in the plurality of building modules is generated for display on a computer screen.

Abstract: A system and method for displaying a unified representation of performance related data for a building are disclosed. The system includes a sensor network for collecting data in the building and a computing device for generating and displaying a unified representation of performance related data on a display. The performance related data may include the raw data collected by the sensor network or data generated by simulation programs based on the raw data collected by the sensor network. The computing device displays the performance related data in the context of a graphical representation of a three-dimensional model of the building as defined in a building information model (BIM). The computing device generates the graphical representation using an ambient occlusion rendering technique and then incorporates the performance related data either using a direct rendering technique or a transient geometry technique.

Abstract: A system and a computer implemented method of 3-D visualization of a building module is disclosed. The method includes receiving attributes of the building module from a building information model and receiving data inputs from a plurality of sensors located in the building module. Locations of at least a subset of the plurality of sensors in the building module and types and locations of physical objects in the building module are determined. Then, a 3-D visualization of the building module on a computer screen is generated based on the attributes of the building module, the locations of the physical objects, the locations of at least the subset of the plurality of sensors and the data inputs from the plurality of sensors.

Abstract: One embodiment of the present invention sets forth a technique for providing an end user with a digital pen embedded with a spatially-aware miniature projector for use in a design environment. Paper documents are augmented to allow a user to access additional information and computational tools through projected interfaces. Virtual ink may be managed in single and multi-user environments to enhance collaboration and data management. The spatially-aware projector pen provides end-users with dynamic visual feedback and improved interaction capabilities.

Abstract: One embodiment of the present invention sets forth a technique for providing an end user with a digital pen embedded with a spatially-aware miniature projector for use in a design environment. Paper documents are augmented to allow a user to access additional information and computational tools through projected interfaces. Virtual ink may be managed in single and multi-user environments to enhance collaboration and data management. The spatially-aware projector pen provides end-users with dynamic visual feedback and improved interaction capabilities.