Abstract: Disclosed herein is an object detection system, including apparatuses and methods for object detection. An implementation may include receiving a first class of a first object depicted in an image frame from a classification model and subsequently receiving a second image frame. The implementation further includes predicting, using a classification tracking model, that the classification model will output the first class for the second image frame and then detecting whether the first class is in fact outputted. The implementation includes determining that the second image frame should be added to a training dataset for the classification model when detecting that the classification model did not generate the first class for the second image frame as predicted and re-training the classification model using the training dataset.

Abstract: A building system including one or more memory devices having instructions stored thereon, that, when executed by one or more processors, cause the one or more processors to receive an event from an event source, the event comprising data and a timestamp. The building system operates to identify first contextual data describing the event in a digital twin, the digital twin comprising a virtual representation of a building, enrich the event with the first contextual data, and provide the enriched event to a consuming system, the consuming system generating an output event based on the enriched event. The building system operates to identify second contextual data describing the output event in the digital twin, enrich the output event with the second contextual data, and provide the enriched output event to the consuming system or another consuming system.

Abstract: Disclosed herein is an object detection system, including apparatuses and methods for object detection. An implementation may include receiving a first image frame from an ROI detection model that generated a first ROI boundary around a first object detected in the first image frame and subsequently receiving a second image frame. The implementation further includes predicting, using an ROI tracking model, that the first ROI boundary will be present in the second image frame and then detecting whether the first ROI boundary is in fact present in the second image frame. The implementation includes determining that the second image frame should be added to a training dataset for the ROI detection model when detecting that the ROI detection model did not generate the first ROI boundary in the second image frame as predicted and re-training the ROI detection model using the training dataset.

Abstract: A building system including one or more storage devices storing instructions thereon that, when executed by one or more processors, cause the one or more processors to receive an indication to execute an artificial intelligence (AI) agent of a digital twin, the digital twin including the AI agent and a graph data structure, the graph data structure including nodes representing entities of a building and edges between the nodes representing relationships between the entities of the building. The instructions cause the one or more processors to execute the AI agent based on data of the building to generate an inference that is a prediction of a future data value of a data point of the building for a future time and store at least one of the inference, or a link to the inference, in the graph data structure.

Abstract: A building system including one or more storage devices storing instructions thereon that, when executed cause the one or more processors to store a data structure of a digital twin of an entity of a building, execute a learning algorithm to construct a trigger rule and an action rule as an input to the learning algorithm, store the trigger rule and the action rule in the digital twin, determine that the trigger rule of the digital twin is triggered by comparing at least some of the information of the data structure against one or more conditions of the trigger rule by querying the data structure for data values and comparing the data values against the one or more conditions of the trigger rule, determine an action of the action rule of the digital twin responsive to determining that the trigger rule is triggered by executing the action rule, and cause one or more devices to operate based on the action determined by the action rule.

Abstract: Disclosed herein is an object detection system, including apparatuses and methods for object detection. An implementation may include receiving a first image frame from an ROI detection model that generated a first ROI boundary around a first object detected in the first image frame and subsequently receiving a second image frame. The implementation further includes predicting, using an ROI tracking model, that the first ROI boundary will be present in the second image frame and then detecting whether the first ROI boundary is in fact present in the second image frame. The implementation includes determining that the second image frame should be added to a training dataset for the ROI detection model when detecting that the ROI detection model did not generate the first ROI boundary in the second image frame as predicted and re-training the ROI detection model using the training dataset.

Abstract: A building system including one or more memory devices having instructions stored thereon, that, when executed by one or more processors, cause the one or more processors to receive an event from an event source, the event comprising data and a timestamp. The building system operates to identify first contextual data describing the event in a digital twin, the digital twin comprising a virtual representation of a building, enrich the event with the first contextual data, and provide the enriched event to a consuming system, the consuming system generating an output event based on the enriched event. The building system operates to identify second contextual data describing the output event in the digital twin, enrich the output event with the second contextual data, and provide the enriched output event to the consuming system or another consuming system.

Abstract: The present disclosure relates to configuring and operating Internet of things (IoT) elements connected by a network. A computing device receives an interface component corresponding to an IoT element. The computing device retrieves a description of the interface component at least describing a set of restrictions of an operation of the IoT element. The computing device deploys the interface component in the computing device to at least translate events and commands specific to the IoT element to common events and commands for processing in the computing device. The computing device sends at least a subset of the description of the interface component to a user device to cause the user device to generate a user interface for configuring the operation of the IoT element.

Abstract: A building system operates to store a digital twin comprising a building graph, the building graph comprising a plurality of nodes representing a plurality of entities of a building and a plurality of edges between the plurality of nodes representing relationships between the plurality of entities. The instructions cause the one or more processors to determine a value for a functionality indicator for a piece of building equipment based on data received from the piece of building equipment, identify a first node of the plurality of nodes representing the functionality indicator by identifying an edge of the plurality of edges relating a second node of the plurality of nodes representing the piece of building equipment to the first node, and cause the first node to store the value for the functionality indicator, or a link to the value for the functionality indicator.

Abstract: A building system including one or more memory devices storing instructions that, when executed by one or more processors, cause the one or more processors to store a plurality of digital twins, the plurality of digital twins comprising a virtual representation of a building, determine, based on the virtual representation of the building, that an operation of the first piece of building equipment is detectable by the second piece of building equipment. The instructions cause the one or more processors to execute a diagnostics routine comprising causing, by the first digital twin, the first piece of building equipment to perform the operation and receiving, by the second digital twin, one or more detections of the operation by the second piece of building equipment and generate a diagnostics report for the first piece of building equipment and the second piece of building equipment based on a result of the diagnostics routine.

Abstract: A building system including one or more memory devices storing instructions that, when executed by one or more processors cause the one or more processors to store a digital twin for a piece of building equipment, the digital twin comprising a virtual representation of the piece of building equipment, wherein the digital twin communicates with the piece of building equipment to operate the piece of building equipment and determine one or more diagnostic messages based on the virtual representation of the piece of building equipment and communicate the one or more diagnostic messages, by the digital twin, to the piece of building equipment causing the piece of building equipment to perform one or more operations. The instructions cause the one or more processors to receive one or more diagnostic message and generate a diagnostics report for the piece of building equipment based on the one or more diagnostic message responses.

Abstract: A building system operates to execute the service based on data of a building to generate an inference or a prediction of a condition of a building, store the inference or the prediction, or a link to the inference or the prediction, in the one or more data storage elements of a knowledge graph, the knowledge graph including representations of entities of the building, relationships between the entities of the building, and one or more storage elements storing or linking the operational data, query the knowledge graph to retrieve the inference or the prediction from the knowledge graph, update, responsive to the query, a graphical model of the building including graphical representations of the entities to include the inference or the prediction, and cause a display device of a user device to display the updated graphical model.

Abstract: A method for controlling building equipment. The method includes obtaining a device model for a physical device of building equipment installed at a building site, the device model indicating an expected performance of the physical device under design operating conditions. The method further includes obtaining operating conditions under which the physical device is operating at the building site, and generating a virtual device representing the physical device by adapting the device model to the operating conditions. The method also includes using a rating engine to generate a device rating for the virtual device, the device rating indicating an expected performance of the physical device under the operating conditions. The method also includes obtaining actual operating data indicating an actual performance of the physical device under the operating conditions, and initiating an automated action based on a comparison of the actual operating data with the device rating for the virtual device.

Abstract: A building system including one or more storage devices storing instructions thereon that, when executed by one or more processors, cause the one or more processors to store a data structure of a digital twin of an entity of a building, the data structure storing information associated with at least one of the entity or entities of the building and determine that a trigger rule of the digital twin is triggered by comparing at least some of the information of the data structure against one or more conditions of the trigger rule. The instructions cause the one or more processors to determine an action of an action rule of the digital twin responsive to determining that the trigger rule is triggered by executing the action rule and cause one or more devices to operate based on the action determined by the action rule.

Abstract: A method including receiving, by one or more processing circuits, building data, generating, by the one or more processing circuits, a first digital twin based on the building data, wherein a first system stores the first digital twin and a second system stores a second digital twin generated based on the building data, where the first digital twin includes a relationship that forms a connection between the first digital twin and the second digital twin by linking a first entity of the first entities of the first digital twin and a second entity of the second entities of the second digital twin, and performing, by the one or more processing circuits, one or more operations based on at least one of the first digital twin, the second digital twin, or the relationship that forms the connection between the first digital twin and the second digital twin.

Abstract: The present disclosure relates to configuring and operating Internet of things (IoT) elements connected by a network. A computing device receives an interface component corresponding to an IoT element. The computing device retrieves a description of the interface component at least describing a set of restrictions of an operation of the IoT element. The computing device deploys the interface component in the computing device to at least translate events and commands specific to the IoT element to common events and commands for processing in the computing device. The computing device sends at least a subset of the description of the interface component to a user device to cause the user device to generate a user interface for configuring the operation of the IoT element.

Abstract: A building system including one or more storage devices storing instructions thereon that, when executed by one or more processors, cause the one or more processors to receive an indication to execute an artificial intelligence (AI) agent, execute the AI agent based on the digital twin to generate an inference or a prediction, cause a graphical model of the building including graphical representations of the entities to include information based on the inference or the prediction, and cause a display device of a user device to display the graphical model.

Abstract: A method includes providing a net consumption trajectory comprising net consumption targets for one or more subperiods of a time period. Each net consumption target indicates a target difference from a beginning of a time period to an end of the subperiod between total consumption and total production or offset. The method also includes generating, for a subperiod of the plurality of subperiods, a set of curtailment actions predicted to achieve the net consumption target for the subperiod and implementing the set of curtailment actions.

Abstract: A method including receiving, by one or more processing circuits, building data, generating, by the one or more processing circuits, a first digital twin based on the building data, wherein a first system stores the first digital twin and a second system stores a second digital twin generated based on the building data, where the first digital twin includes a relationship that forms a connection between the first digital twin and the second digital twin by linking a first entity of the first entities of the first digital twin and a second entity of the second entities of the second digital twin, and performing, by the one or more processing circuits, one or more operations based on at least one of the first digital twin, the second digital twin, or the relationship that forms the connection between the first digital twin and the second digital twin.

Abstract: A building system can operate to receive an indication from a user device of a user to query a digital twin of one or more buildings, the digital twin including entities including buildings, equipment, spaces, or data of the one or more buildings, the equipment, or the spaces, the digital twin including relationships between the entities. The building system can operate to receive building data from the digital twin by querying the digital twin based on the indication received from the user device. The building system can operate to generate an analytics model based on the building data, wherein the analytics model is trained based on the building data and deploy the analytics model to operate based on data of the one or more buildings and generate one or more analytic results based on the data of the one or more buildings.