Abstract: A system and controller are provided. In one example, the system includes a controller for playing a video game. The controller includes input buttons for controlling interaction during play of the video game. The controller includes an inertial sensor for detecting translational or rotational movement of the controller and a vibrational device. A voice input device is associated with the controller. A wireless communication circuit of the controller is provided for communicating data between the controller and a local computing device. The local computing device is connectable to a network. The data includes control responsive to presses of said input buttons or control received from said voice input device.

Abstract: A mini-game may be generated by recording game data during play of a video game on a computer game system, suspending play of the video game in response to a first input to the computer game system, rewinding the recorded game data to a start point in response to a second input to the computer game system, and uploading recorded game data representing a state of the video game at the start point to a remote mini-game distribution system. The mini-game data may be distributed to other game playing systems. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure. This abstract is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims.

Abstract: A device is provided that includes a persistent memory, a microcontroller and a power source configured to generate power in response to energy harvesting. The power is transferred to a power storage of the device such that when the power storage has an amount of power the microcontroller performs processing of a part of a task resulting in state data related to the task stored to the persistent memory in response to a first cycle of energy harvesting. In response to one or more additional cycles of energy harvesting, the device continues performance of the task by retrieving the state data for the part of the task from the persistent memory and resulting in assembly of a payload that comprises an update to software running on the device.

Abstract: Devices, systems, and method are provided for tracking items in a store for processing a cashier-less purchase transaction. In one example, a method includes identifying a shopper in a store using sensors and associating the shopper to a shopping account. Monitoring the shopper in the store using one or more sensors, and output of the one or more sensors is an input to one or more deep learning models that generate classification data in connection with a scenario. The method includes receiving natural language voice input containing words spoken from the shopper. And, processing the voice input along with the classification data to generate a response to the words spoken by said shopper. The response is made in a context of the scenario.

Abstract: Increasing a number of advertising impressions in a system configured to facilitate user interaction with an interactive environment containing one or more advertising targets is described. A scene of a portion of the simulated environment is displayed from a camera point of view (camera POV) on a video display. The scene may change as the camera POV changes in response to movement of the camera POV along a camera path during the user's interaction with the simulated environment. Modifying the camera path or a camera field of view can place more of an advertising target within the displayed scene to increase a likelihood of generating an advertising impression. The advertising target is characterized by a field of attraction of the camera POV.

Abstract: A controller is provided. A controller body to be held by a user, the controller body includes an input mechanism for receiving control inputs, an accelerometer for detecting translational or rotational movement of the controller body, and a vibrational device for providing vibration. The controller further includes a light for tracking by a camera, a voice input device and a wireless communication module. The wireless communication module communicates data between the controller and a computer for driving interaction with the video game. The data communicated between the controller and the computer includes control inputs and voice inputs from the voice input device.

Abstract: Energy harvesting Internet of Things (IOT) devices are shown including configurations involving a persistent memory, microcontroller, and flat antenna for electromagnetic RF harvesting. In one embodiment, multiple cycles of energy harvesting are performed by an IOT device, where power harvested via the flat antenna is transferred to a power storage of the device such that when the power storage has an amount of power the microcontroller performs processing resulting in state data stored to persistent memory, then during an additional cycle or cycles of energy harvesting, the device completes a process resulting in a payload that is sent to an end node via wireless transmission. Additional energy harvesting may be provided via an energy harvesting input that provides device input and causes additional energy for harvesting. Configurations include ones where energy harvesting is performed by the device, based on capturing vocal energy from a human voice spoken to the device.

Abstract: Methods and devices are provided. One device includes an antenna, a microcontroller, and a power source. The power source configured to generate power in response to ambient energy received at a first frequency during a cycle of energy harvesting using the antenna. The power is transferred to a power storage cell such that when the power storage cell has an amount of power the microcontroller of the device processes at least a part of a processing task to be sent to an end node, and a result of processing of said at least said part of the processing task is stored. During one or more additional cycles of energy harvesting, using generated power to process one or more additional parts of the processing task to assemble a payload or process a wireless transmission of the payload. The wireless transmission of the payload is sent over a second frequency to the end node.

Abstract: Methods and devices are provided. One device includes persistent memory, a microcontroller and a power source configured to generate power in response to ambient energy received at a first frequency during a cycle of energy harvesting. The power is transferred to a power storage cell such that when the power storage cell has an amount of power the microcontroller performs processing. The microcontroller selects and runs code routines based on the power available and stores associated state data into the persistent memory. During one or more additional cycles of energy harvesting, the device uses the generated power to retrieve state data from persistent memory and continue processing. The processing is related to assembling a payload and to process a wireless transmission of a payload over a second frequency.

Abstract: Methods and systems are described. One system is a light switch having a housing configured for a circuit for a switch and a wireless chip for wireless communication with an end-node. The light switch further includes a processor chip and memory for executing instructions and interfacing with the wireless chip and the switch. A microphone is integrated with the housing and a speaker is integrated with the housing. The instructions are processed by the processor chip in response to voice commands received by the microphone, and the processing of instructions is further configured to send data to the end node and receive data from the end node. The data received from the end node is used to provide an audible voice reply to one or more of the voice commands received by the microphone of the housing of the light switch.

Abstract: A non-transitory computer readable storage medium stores one or more computer programs adapted to cause a processor based system to execute steps that include analyzing an image, identifying one or more faces in the image using a face recognition technique, designating at least one of the identified faces collectively as a first area of interest, and determining whether an insertion area exists in the image where additional content can be inserted without obstructing the first area of interest. Another computer program is adapted to cause a processor based system to execute steps that include determining whether the insertion area can be divided into two or more regions based on color. Methods and processor based apparatuses that perform one or more of these steps are also disclosed.

Abstract: Energy harvesting Internet of Things (IOT) devices are shown including configurations involving a persistent memory, microcontroller, and flat antenna for electromagnetic RF harvesting. In one embodiment, multiple cycles of energy harvesting are performed by an IOT device, where power harvested via the flat antenna is transferred to a power storage of the device such that when the power storage has an amount of power the microcontroller performs processing resulting in state data stored to persistent memory, then during an additional cycle or cycles of energy harvesting, the device completes a process resulting in a payload that is sent to an end node via wireless transmission. Additional energy harvesting may be provided via an energy harvesting input that provides device input and causes additional energy for harvesting. Configurations include ones where energy harvesting is performed by the device, based on capturing vocal energy from a human voice spoken to the device.

Abstract: A non-transitory computer readable storage medium stores one or more computer programs adapted to cause a processor based system to execute steps that include analyzing an image, identifying one or more faces in the image using a face recognition technique, designating at least one of the identified faces collectively as a first area of interest, and determining whether an insertion area exists in the image where additional content can be inserted without obstructing the first area of interest. Another computer program is adapted to cause a processor based system to execute steps that include determining whether the insertion area can be divided into two or more regions based on color. Methods and processor based apparatuses that perform one or more of these steps are also disclosed.

Abstract: A hand-held electronic device, method of operation and computer readable medium are disclosed. The device may include a case having one or more major surfaces. A visual display and a touch pad are disposed on at least one of the major surfaces. A processor is operably coupled to the visual display and touch screen. Instructions executable by the processor may be configured to: a) present an image on the visual display containing one or more active elements; b) divide the image into one or more regions that fill the display, wherein each region corresponds to a different active element; c) correlating an active element in the image on the visual display to a corresponding active portion of the touch interface; and d) activate one of the one or more active elements in response to a touch to a corresponding one of the active portions of the touch interface.

Abstract: Methods and systems are provided. One method includes associating a plurality of sensor devices to a shelf having plurality of physical items. Each of the physical items is capable of being associated with one or more state data in response to user interaction. The method includes detecting user interaction by a user with one of the physical items. The user interactions cause a sensor device associated with the physical item to transmit a message over a network to an end node. The end node is configured to receive the message and process an action for the message. At least one physical item is offered for sale in a retail store and where the user interaction is associated to a user account. An indication of a status of the physical item as to whether the user has touched the physical item, lifted the physical item from the shelf, moved the physical item, or released the physical item in the retail store is associated to a log or status for the user account of the user.

Abstract: A wireless coded communication (WCC) device and method for using the device are provided. In one example, the device includes a wireless chip and a power pump. The power pump is configured to generate power in response a mechanical force applied to an element of the power pump, and the power is transferred to a power storage cell such that the wireless chip is enabled to execute a predefined function. The predefined function is to send code data to an end node over a wireless link. A mechanism is interfaced with the element of the power pump, and the mechanism is configured to move an incidental trigger coupled to the mechanical force. In this example, moving the mechanism transfers the mechanical force onto the element so as to transition the element from an initial state to the strained state, the transitioning from the initial state to the strained state generates the power that is transferred to the power storage cell.

Abstract: Method of identifying actions of a shopper to account for taken items by the shopper in a cashierless checkout includes sampling a shopping environment using one or more video cameras to generate video features related a shopper in connection to an item and sampling using one or more supplemental sensors to generate supplemental sensor feature data, receiving output of the sampled video and supplemental sensor features as feature inputs to a deep learning model used for making inferences related to the state of a scenario involving shopper action of taking the item into their possession or held and other actions including moving outside a zone initially associated with the item.

Abstract: A method for providing real-time recommendations to user in a shopping environment involves sampling a shopping environment using video cameras to generate video features related to a shopper in connection to an item, the sampling input to a machine learning model to create labels related to a state of a scenario, the scenario including the shopper handling the item. Supplemental information is provided to the shopper in connection with the item. The makeup of the supplemental information may be sourced from online service or device associated with the shopper. The supplemental information may be delivered to the shopper, or to a shopper-aware display in the store, or elsewhere. A processing entity associated with the store detects a scenario to identify the shopper as having finished shopping, and causing a charge of the item to a cashierless shopping cart associated with the shopper.

Abstract: Methods and systems related to tracking activity in a store in association with a cashier-less environment are provided. One example method includes identifying actions in a store. The method includes sampling a shopping environment using one or more sensors that include at least one camera capable of providing depth sensing to produce image data of a scene that shows a shopper in the store and tracking data related to one or more limbs of the shopper in connection to an item. The method includes receiving output of the sampling as feature inputs to one or more machine learning models and deriving one or more label inferences of a behavior state of the shopper in connection with a state of the item. At least one processing entity associated with the store detects the state of the item to change from one as item handled by said shopper to one as item queued for purchase.

Abstract: A method for use in obtaining input data from an object includes capturing a live image of the object with an image capture device, receiving information related to a tilt angle of the object from one or more sensors other than the image capture device, using the information related to a tilt angle of the object to obtain at least one rotated reference image of the object, comparing the live image of the object with the rotated reference image of the object, and generating an indication in response to the live image matching the rotated reference image.