Abstract: A method of operating a selected electronic device of a plurality of electronic devices includes generating image data of at least the selected electronic device with an imaging device, displaying a virtual representation of at least the selected electronic device on a display device based on the generated image data, and receiving a user input with an input device. The method further includes associating the user input with the selected electronic device using a controller, transmitting device data to the selected electronic device with a transceiver, and performing an operation with the selected electronic device based on the transmitted device data.

Abstract: Occupant thermal comfort may be inferred and improved using body shape information. Height, weight, and shoulder circumference of an occupant of a room may be obtained using a depth sensor. A model may be utilized that is trained on a dataset including information reflecting of occupant comfort within the room versus temperature, the model receiving, as inputs, the height, the weight, and the shoulder circumference of the occupant and environmental information and outputting a comfort class. A temperature set-point for is identified which the room occupant is identified by the model as having the comfort class being indicative of user comfort. Heating, ventilation, and air conditioning (HVAC) controls are adjusted for the room to the identified temperature set-point.

Abstract: An apparatus comprising a wireless transceiver configured to communicate packet data with a mobile device associated with one or more persons in a vicinity of the wireless transceiver, and a controller in communication with the wireless transceiver and a camera, the controller configured to receive a plurality of packet data from one or more person, wherein the packet data includes at least amplitude information associated with the wireless channel communicating with the wireless transceiver and receive images from the camera containing trajectory of motion of individuals, performs detection, tracking, and pseudo-identification of individuals by fusing motion trajectories from wireless signals and camera images.

Abstract: A depth-based object-detection convolutional neural network is disclosed. The depth-based object-detection convolutional neural network described herein incorporates a base network and additional structure. The base network is configured to receive a depth image formatted as RGB image data as input, and compute output data indicative of at least one feature of an object in the RGB image data. The additional structure is configured to receive the output data of the base network as input, and compute predictions of the location of a region in the received depth image that includes the object and of a class of the object as output. An object detection device incorporating the depth-based object-detection convolutional neural network is operable in real time using an embedded GPU.

Abstract: A method of measuring people flow through a doorway using a low-resolution, low-cost infrared array is disclosed. The method includes reading a sequence of sensor data frames from the infrared array; determining a background temperature frame; determining whether sensor data frames include at least one person using noise filtering techniques; identifying at least one group of adjacent pixels corresponding to the at least one person; determining at least one location corresponding to the at least one person; and determining whether the at least one person is a same person as a person in a previous sensor data frame. Based on the matching of a same person through multiple sensor data frames, direction of movement and entry/exit events can be determined. The entry/exit events can advantageously be used to operate and HVAC system, security system, or other such system more efficiently and effectively.

Abstract: An apparatus comprising a wireless transceiver configured to communicate packet data with a mobile device associated with one or more persons in a vicinity of the wireless transceiver, and a controller in communication with the wireless transceiver and a camera, the controller configured to receive a plurality of packet data from one or more person, wherein the packet data includes at least amplitude information associated with the wireless channel communicating with the wireless transceiver and receive images from the camera containing trajectory of motion of individuals, performs detection, tracking, and pseudo-identification of individuals by fusing motion trajectories from wireless signals and camera images.

Abstract: An apparatus comprising a wireless transceiver configured to communicate packet data with a mobile device associated with one or more persons in a vicinity of the wireless transceiver, and a controller in communication with the wireless transceiver and the camera, the controller configured to receive a plurality of packet data from one or more person, wherein the packet data includes at least amplitude information associated with the wireless channel communicating with the wireless transceiver, identify the one or more persons as a customer or employee in response to the packet data, and determine a motion projection of the one or more persons in response to the packet data and identification indicating the customer.

Abstract: A method of operating a selected electronic device of a plurality of electronic devices includes generating image data of at least the selected electronic device with an imaging device, displaying a virtual representation of at least the selected electronic device on a display device based on the generated image data, and receiving a user input with an input device. The method further includes associating the user input with the selected electronic device using a controller, transmitting device data to the selected electronic device with a transceiver, and performing an operation with the selected electronic device based on the transmitted device data.

Abstract: An access control system includes an entrance threshold, a privilege access management module, a depth sensor, and an occupancy estimation module. The privilege access management module may be configured to, responsive to an authorization input from a reader, output an access grant to traverse the threshold and generate an approved number of individuals allowed admittance across the threshold during a predetermined period of time. The depth sensor may be located above the threshold and configured to generate and output 3-dimensional depth data. The occupancy estimation module may be in communication with the privilege access management module and configured to output a count of individuals crossing the threshold during the predetermined period of time, that is based on a hemi-ellipsoid model of the depth data. The access control system may, responsive to a difference between the approved number allowed admittance and count of individuals crossing the threshold, inhibit the access grant.

Abstract: An RGBD sensing based system for detecting, tracking, classifying, and reporting objects in real-time includes a processor, a computer readable media, and a communication interface communicatively coupled to each other via a system bus is illustrated. An object detection module is integrated into the system that detects and tracks any objects that are moved under its field of view.

Abstract: An occupancy sensing based system for custodial service management is disclosed that allows schedule custodial services based on actual usage of a site, such as a restroom, instead of following a static schedule and hence can potentially save a significant amount of labor cost. The system is very accurate, privacy aware, and easy to use. In addition to allowing custodial management to optimize their workforce, the system is capable of detecting theft of supplies and performing inventory management. It can be useful in airports, hospitals, stadiums, theaters, academic buildings, convention centers, and many other dynamic places.

Abstract: An occupancy sensing based system for personalized desk reservation is disclosed that enables a user to choose and book a desk that meets his or her preferences in terms of temperature, humidity, noise level, and light intensity using a smart phone app, a web browser, or the like. The system uses sensors deployed underneath or above desks to monitor the occupancy and environmental status of all the desks in a site. The system uses LPWAN (Low Power Wide Area Network) for collecting and aggregating sensor data. It can be useful in offices, academic buildings and libraries, restaurants, lounge areas, phone booths, nap rooms, fitness centers, and many other places, where occupancy pattern is dynamic.

Abstract: A method of measuring people flow through a doorway using a low-resolution, low-cost infrared array is disclosed. The method includes reading a sequence of sensor data frames from the infrared array; determining a background temperature frame; determining whether sensor data frames include at least one person using noise filtering techniques; identifying at least one group of adjacent pixels corresponding to the at least one person; determining at least one location corresponding to the at least one person; and determining whether the at least one person is a same person as a person in a previous sensor data frame. Based on the matching of a same person through multiple sensor data frames, direction of movement and entry/exit events can be determined. The entry/exit events can advantageously be used to operate and HVAC system, security system, or other such system more efficiently and effectively.