Abstract: Techniques for state-based provisioning of image data streams are described herein. In some examples, a plurality of image data streams, such as video streams, may be captured from one or more electronically presented content items. Upon being captured, the image data streams may be transmitted to an image data streaming service, such as a video streaming service, for transmission to spectators or other viewers. In addition to the image data, state data associated with the image data streams may also be transmitted to the image data streaming service. The state data may include information that describes the contents of the image data streams. In some examples, the image data streaming service may use the state data to provision the image data streams, for example to determine one or more image data streams that match a viewer's interest and to transmit those streams to the viewer.

Abstract: Techniques for state-based provisioning of image data streams are described herein. In some examples, a plurality of image data streams, such as video streams, may be captured from one or more electronically presented content items. Upon being captured, the image data streams may be transmitted to an image data streaming service, such as a video streaming service, for transmission to spectators or other viewers. In addition to the image data, state data associated with the image data streams may also be transmitted to the image data streaming service. The state data may include information that describes the contents of the image data streams. In some examples, the image data streaming service may use the state data to provision the image data streams, for example to determine one or more image data streams that match a viewer's interest and to transmit those streams to the viewer.

Abstract: An articulated controller is provided that enables a user to simply, and intuitively enter complex movements into a game with high accuracy, and while maintaining a constant grip. The controller comprises: a first hand unit, for being held in one hand by the user; a second hand unit, for being simultaneously held in another hand by the user, and an articulable joint coupling the first hand unit and the second hand unit, wherein the articulable joint is at least partly enclosed by the first hand unit to enable the user to maintain a grip on the first hand unit without interference from the articulable joint, and wherein user input is provided to the controller through movement of the articulable joint.

Abstract: A method incorporating real environment for virtuality and reality combined interaction includes: step 1: capturing a frame of image in a real environment, and determining a movement state between a previous frame of image and a current image for at least one edge point in the image; step 2: for each of virtual objects in the virtual content, detecting whether the edge point is existed on the periphery of the virtual object, and applying corresponding function on the virtual object according to the movement state of the edge point when the edge point is existed on the periphery of the virtual object; and step 3: displaying the virtual content and the real environment in a superimposed manner according to function effect of the edge point to the virtual object, and returning back to step 1 to proceed until interaction between virtuality and reality is end.

Abstract: A system for combining six degree of freedom (6DOF) inputs, or positional and orientation inputs, from multiple 6DOF controllers in an augmented reality (AR) environment and/or a virtual reality (VR) environment is provided. In response to the detected movement of multiple controllers, and in particular, rotational movement of the multiple controllers providing user inputs in a virtual reality environment, the detected movements of the multiple controllers may be resolved to a single, common coordinate system to determine intended input to be applied to a selected virtual object in the virtual environment. The ability to resolve these inputs from multiple 6DOF controllers to a common coordinate system may provide a more natural user input mode, thus enhancing the user's experience.

Abstract: Methods, systems, and computer readable media involving a content coupled physical activity surface are disclosed. One system includes a processor and a memory. The system is configured to receive information about a physical action performed by a user based on feedback from a physical activity surface including at least one sensor for detecting physical activity of the user, to determine, based on the feedback, configuration information, and metadata associated with a content coupled experience involving a physical action sequence, a second physical action to perform, information for prompting the user to perform the second physical action, and information for detecting the second physical action via the physical activity surface, and to provide, to the physical activity surface, the information for prompting the user to perform the second physical action and for detecting the second physical action via the physical activity surface.

Abstract: Described herein are, among other things, handheld controllers having touch-sensitive controls, as well as methods for use of the touch-sensitive controls and methods for assembling the handheld controllers. An example handheld controller may include a top-surface control (e.g., a “trigger button”) that includes a switch, a pressure sensor, and a touch sensor for detecting a presence, location, and/or gesture of a finger on the top-surface control.

Abstract: One disclosed example provides a method for determining a pose of a handheld object in a surrounding environment. Optical pose data is stored in an image queue of a first filter. IMU data is received from an IMU of the handheld object and stored in an IMU queue of the first filter. Using at least a portion of the optical pose data and the IMU data, an initial pose of the handheld object is determined and outputted. The method determines that either the image queue or the IMU queue is empty. A second filter comprising the one empty queue and the other non-empty queue is instantiated as a copy of the first filter. Using the data from the non-empty queue in the second filter, the initial pose of the handheld object is updated to an updated pose, and the updated pose is outputted.

Abstract: The method for controlling a game character includes: obtaining a user initial indication position p1 in response to a screen-sliding operation of a user; monitoring a screen-sliding operation track of the user, and obtaining a user current indication position p2; calculating a moving distance between the user current indication position p2 and the user initial indication position p1 as |u|=|p2?p1|; comparing the moving distance |u| with a first preset threshold S1; and generating, according to the vector u=p2?p1, an operating instruction for controlling the game character. By means of the control method, a user may control a game character without being restricted, and may perform more flexible and fluent operations, thereby greatly improving the user experience of a game.

Abstract: A method, system, apparatus, and/or device for sensing an input in an augmented reality construct. The method, system, apparatus, and/or device may include a processing device and a sensor. The processing device may be configured to determine a virtual boundary within an augmented reality construct, define a first portion of the virtual boundary within the augmented reality construct, and define a second portion of the virtual boundary within the augmented reality construct. The sensor may be sense a first input from an end-effector within the first portion of the virtual boundary and sense a second input from the end-effector within the second portion of the virtual boundary, where the processing device may further generate a device input that corresponds to the first input and the second input and send the device input to another device.

Abstract: A computer game program implements a position information obtaining function of obtaining first position information indicating a first position in a game field and second position information indicating a second position in the game field, a position information updating function of respectively updating the first position information and the second position information to move the first position and the second position in response to an operation input by a player, a position identifying function of determining a third position on a first line in accordance with the second position, the first line being a line that passes through the first position and a predetermined fixed position set in the game field, and a direction determining function of determining a direction in which a predetermined game effect is produced in the game field, in accordance with the first position, the second position, and the third position.

Abstract: A non-limiting example game apparatus includes a main body apparatus that functions as a vibration control apparatus and a first controller and a second controller attachable to or detachable from the main body apparatus. For example, the game apparatus can be used in one of a first mode that two controllers are attached to the main body apparatus, a second mode that the two controllers are individually used in a separated state from the main body apparatus, a third mode that the two controllers are used in a state where the two controllers are detached from the main body apparatus and connected integrally to each other, and a fourth mode that a third controller that is different from the two controllers is used. For example, the same type of vibration motor is used for each controller, and a CPU incorporated in the main body apparatus controls a vibration waveform according to the usage mode of the game apparatus.

Abstract: An example information processing system includes a main body apparatus, a handheld console controller, and a wireless controller. The handheld console controller is configured to be unified with the main body apparatus. The wireless controller is configured to be wirelessly connected to the main body apparatus. The main body apparatus sets one of the handheld console controller and the wireless controller, a predetermined button of which has been pressed down, to “active,” and performs a game process based on operation data from the activate controller.

Abstract: A hand held controller for a games console comprising an outer case, a plurality of controls located on a front end and/or top of the controller, at least one additional control located on a back of the controller, a control unit for controlling a mode of operation of the controller and at least one magnetic sensor in communication with the control unit. The control unit is configured to receive a signal from the at least one magnetic sensor in dependence upon a magnetic field being detected by the at least one magnetic sensor and the control unit is configured to determine a mode of operation of the controller in dependence upon the signal received from the at least one magnetic sensor.

Abstract: A data transmission device that includes an image capturing unit and transmits data generated based on an image captured by the image capturing unit is allowed to be located at a case while at least a part of the data transmission device is accommodated in the case, such that an image capturing direction of the image capturing unit is directed toward an inner space of a case main body. An image capturing target member movable in the inner space of the case main body in accordance with an operation made from outside of the case main body is located at a position where an image of the image capturing target member is allowed to be captured by the image capturing unit. Based on the transmitted data, an information process is executed.

Abstract: Pairing data associated with a second device may be received at a first device. The pairing data may be received from a server. A first authentication proof may be generated based on the pairing data received from the server. A second authentication proof may be received from the second device. Furthermore, an authentication status of the second device may be updated based on a comparison of the first authentication proof that is based on the pairing data received from the server and the second authentication proof that is received from the second device.

Abstract: There is provided an information processing device including: a processing unit configured to perform a process of generating preparation information on the basis of first output information regarding a first target acquired from a sensor that senses a predetermined range of an actual space and second output information regarding a second target acquired from a device carried by a user. The preparation information is used to generate operation information on the basis of third output information acquired from the sensor.

Abstract: Implementations of the disclosure describe smart controls for video game controllers that may track and store information related to their use (e.g., actuations) over time to keep track of their expected remaining life. The smart controls may removably couple to a video game controller and be replaced by other smart controls. In implementations, a smart control may include: an actuation component; a sensor to detect actuation of the actuation component in response to movement of the control; a memory to store information associated with the detected actuation; and a casing to house the sensor and memory.

Abstract: A computing system is provided, including a plurality of display devices including at least a first display device and a second display device. The computing system may further include one or more sensors configured to detect a first positional state of the first display device relative to the second display device and at least one user. The first positional state may include an angular orientation of the first display device relative to the second display device. The computing system may further include a processor configured to receive the first positional state from the one or more sensors. The processor may be further configured to generate first graphical content based at least in part on the first positional state. The processor may be further configured to transmit the first graphical content for display at the first display device.

Abstract: There is provided an information processing device including: a processing unit configured to perform a process of generating preparation information on the basis of first output information regarding a first target acquired from a sensor that senses a predetermined range of an actual space and second output information regarding a second target acquired from a device carried by a user. The preparation information is used to generate operation information on the basis of third output information acquired from the sensor.

Abstract: A virtual reality (VR) system supports improved interactive control processes/services. These interactive control processes/services include detecting movement of a controller associated with a virtual reality (VR) environment, determining an angle of rotation based on the movement, determining a magnitude of force associated with the movement, determining a path in the VR environment that corresponds to the angle of rotation and the magnitude of force, and projecting the path in the VR environment.

Abstract: Provided is a feedback device providing thermal feedback. The feedback device, according to one embodiment, may comprise a casing, a heat output module, and a feedback controller. The casing comprises: a grip part that is a region gripped by a user to use the feedback device when a content is reproduced; and a non-grip part that is a region not gripped by the user. The heat output module comprises: a thermoelectric element performing a thermoelectric operation for thermal feedback. The heat output module is disposed on the curve-shaped inside or outside of the grip part, and outputs thermal feedback to the user. The feedback controller is configured so as to control the thermal output module.

Abstract: Methods, systems, and computer programs are provided for generating an interactive space. One method includes operations for associating a first device to a reference point in 3D space, and for calculating by the first device a position of the first device in the 3D space based on inertial information captured by the first device and utilizing dead reckoning. Further, the method includes operations for capturing images with a camera of the first device, and for identifying locations of one or more static features in the images. The position of the first device is corrected based on the identified locations of the one or more static features, and a view of an interactive scene is presented in a display of the first device, where the interactive scene is tied to the reference point and includes virtual objects.

Abstract: An electronic device receives a first set of one or more inputs corresponding to user interface elements displayed on the display and a first set of one or more tactile outputs, and also receives a second set of one or more inputs corresponding to one or more hardware elements and a second set of one or more tactile outputs. In response, in accordance with a determination that the first set of one or more tactile outputs and the second set of one or more tactile outputs overlap, the device outputs, with one or more tactile output generators, a modified tactile output sequence that is modified so as to emphasize the second set of one or more tactile outputs relative to the first set of one or more tactile outputs.

Abstract: Disclosed are various embodiments for determining a wagering game to play on a client device. The client device can determine the orientation of a display using one or more sensors. The wagering game can be selected using the orientation. The selected wagering game can be rendered on the display. An outcome of the wagering game can be generated.

Abstract: A forward direction line is set on a course, in a virtual game world, on which a player object is allowed to move. An advancing direction at a current position of the player object is determined based on the forward direction line. The advancing direction is determined as a direction in which the player object advances so as to control a movement of a player character in accordance with an acceleration instruction, and a leftward-rightward movement instruction from a player. Consequently, it is possible to assist the player in controlling a direction in which an object operated by the player moves.

Abstract: A dial assembly comprises a dial base, a rolling wheel, a dial handle, a reset elastic member, and a sensor. The dial base includes a first rotation channel and a second rotation channel. The rolling wheel is seated on the first rotation channel and rotatable along the first rotation channel. The dial handle is rotatably connected with the dial base and rotatable along the second rotation channel. The dial handle is connected with the rolling wheel and configured to rotate along with the rolling wheel. The reset elastic member is connected with the dial handle and configured to provide a restoring force to the dial handle. The sensor is connected with the dial handle and configured to obtain a rotation angle of the rolling wheel by sensing a rotation of the dial handle and convert the rotation angle into a control signal to transmit.

Abstract: In a case where an attitude is included in a predetermined first range at a timing when a predetermined instruction operation is made by use of an input device, an instruction operation is determined to be successful. In a case where the attitude is included in a second range outside the first range at the timing of the instruction operation, it is further determined that the instruction operation is successful in a case where within a predetermined time period after the timing, the attitude is included in the first range or a third range including at least a part of the first range, and further the operation device is put into a still state or a state of moving by a predetermined amount or less.

Abstract: The disclosure relates to integrated modules for Synchronized Array of Vibration Actuators (FIG. 125A). The modules provide physical interface, power and communication interfaces. Each module may include vibration actuators (FIG. 123A) which can be precisely attached and aligned to the module housing, a microcontroller or other microprocessor, and one or more sensors for closed loop control of actuators (FIG. 126G). Interleaved pairs of ERMs having a center of mass in the same plane eliminate parasitic torque. A single module can produce a vibration force that rotates at a specific frequency and magnitude, which on its own could cancel out some types of periodic vibrations (FIG. 125B). Two modules paired together and counter-rotating with respect to each other can produce a directional vibration at a specific frequency and magnitude, which could prove even more useful for canceling out a vibration. Such modules are also employed to produce beating patterns (FIGS. 131-133).

Abstract: A method and apparatus of touch control for a multi-point touch terminal, wherein the apparatus of the touch control obtains a first operation for a first touch button on a touch screen of the multi-point touch terminal by the user and a second operation for a second touch button thereof by the user, and then carries out an object operation corresponding to the second operation according to an operation object corresponding to the first operation.

Abstract: Some electronic devices may not include hardware such as a gyroscope that is capable of providing precise orientation information. In some implementations, accelerometer data may be used to determine a content display adjustment (e.g., an adjustment to a first person perspective view in a game scene) by sampling accelerometer data over multiple time periods. For example, accelerometer data may be used to determine short term and longer term accelerometer sample values. The content display adjustment may be determined based at least in part on the accelerometer sample values and information associated with the content display adjustment may be communicated to a display.

Abstract: Head-mounted augmented reality (AR) devices can track pose of a wearer's head to provide a three-dimensional virtual representation of objects in the wearer's environment. An electromagnetic (EM) tracking system can track head or body pose. A handheld user input device can include an EM emitter that generates an EM field, and the head-mounted AR device can include an EM sensor that senses the EM field. EM information from the sensor can be analyzed to determine location and/or orientation of the sensor and thereby the wearer's pose. The EM emitter and sensor may utilize time division multiplexing (TDM) or dynamic frequency tuning to operate at multiple frequencies. Voltage gain control may be implemented in the transmitter, rather than the sensor, allowing smaller and lighter weight sensor designs. The EM sensor can implement noise cancellation to reduce the level of EM interference generated by nearby audio speakers.

Abstract: A method for processing information, terminal device and a computer storage medium are disclosed. The method for processing information includes that: a first control instruction is acquired, and a first application is switched to a preset mode according to the first control instruction; a first triggering operation is acquired based on the preset mode, at least two pieces of multimedia data are selected based on the first triggering operation, and a first playing interface is generated; when a second control instruction is acquired, the at least two pieces of multimedia data in the first playing interface are sequentially played; in a process of playing first multimedia data in the at least two pieces of multimedia data, first audio data is acquired; and the first multimedia data and the first audio data are synthesized as second multimedia data.

Abstract: A hybrid game having a user selectable gambling game is provided.

Abstract: In an example game processing of moving a predetermined object in a predetermined course in a virtual space on the basis of an operation performed by a player, first, an input amount according to an input for controlling a moving direction of the predetermined object based on the operation performed by the player is obtained. Next, the input amount according to the input for controlling the moving direction is corrected so as to cause the moving direction of the predetermined object to be close to a direction along a travelling direction as a direction toward a destination, by increasing/decreasing a predetermined correction value which is added to the input amount, on the basis of relationship between a current moving direction of the predetermined object and the travelling direction of the course. Then, movement of the predetermined object is controlled on the basis of the corrected input amount.

Abstract: Disclosed is an apparatus including a touch sensitive user interface and a processor. The processor is configured to detect a first contact at a first position on the user interface, determine a movement of the first contact from the first position and if the movement is less than a predetermined movement threshold, when a release of the first contact is detected, move a first object on the user interface from an initial position on the user interface to an area at or near the first position. If the movement is greater than the predetermined movement threshold to identify a second position corresponding to an area near an end point of the movement and when the release of the first contact is detected, execute an action on the second position from the first object.

Abstract: An example accessory can be attached to an information processing device. The accessory includes a housing, a movable operation section, and a movable portion. An inside of the housing is visible from an outside thereof through at least a portion thereof. At least a portion of the operation section is exposed on the outside of the housing. The movable portion is placed at a position inside the housing that is visible from the outside of the housing through the portion of the housing. A position and/or an attitude of the movable portion changes in response to the operation section being operated.

Abstract: Provided is a feedback device providing thermal feedback. The feedback device, according to one embodiment, may comprise a casing, a heat output module, and a feedback controller. The casing comprises: a contact part, with which a user makes contact when the feedback device moves when a content is being played; and a noncontact part with which the user does not make contact even though the feedback device moves. The heat output module comprises: flexible first and second substrates; a thermoelectric element interposed between the first the second substrates and performing a thermoelectric operation for thermal feedback; and a contact surface disposed on the second substrate. The heat output module is disposed on the curve-shaped inside or outside of the contact part, and outputs thermal feedback to the user via the second substrate and the contact surface. The feedback controller is configured so as to control the thermal output module.

Abstract: An electronic device receives a first set of one or more inputs corresponding to user interface elements displayed on the display and a first set of one or more tactile outputs, and also receives a second set of one or more inputs corresponding to one or more hardware elements and a second set of one or more tactile outputs. In response, in accordance with a determination that the first set of one or more tactile outputs and the second set of one or more tactile outputs overlap, the device outputs, with one or more tactile output generators, a modified tactile output sequence that is modified so as to emphasize the second set of one or more tactile outputs relative to the first set of one or more tactile outputs.

Abstract: Provided are a program, a control method, and an information processing apparatus which may provide an improved user interface on which a user may easily and efficiently execute various processes on a game content. The information processing apparatus may be caused to execute a game content specifying step of specifying a selected game content on the basis of first input operation data from an operation unit, a step of retrieving information from a storage unit, a step of specifying a direction from a start point to an end point of a second input operation on the basis of second input operation data from an operation unit, and an execution step of executing one process associated with the direction from the start point to the end point of the second input operation in the information from the storage unit on the selected game content.

Abstract: Sensor data damping is described, for example, to remove jitter from sensor data to enable control of a computing device. In various examples damped sensor data is compared with a threshold and clamped to the threshold in the case a difference between the sensor data and the damped sensor data is above the threshold. In various examples the damped data has low-latency and is used to control a downstream system such as a game system, natural user interface, robotic system, augmented reality system or other system. In examples, the threshold is adjusted on the fly on the basis of any one or more of: state data from the downstream system, frequency of clamping, velocity of the sensor data. In some examples, the sensor data comprises human/animal joint positions from a depth sensor.

Abstract: There is provided an information processing device including: a processing unit configured to perform a process of generating preparation information on the basis of first output information regarding a first target acquired from a sensor that senses a predetermined range of an actual space and second output information regarding a second target acquired from a device carried by a user. The preparation information is used to generate operation information on the basis of third output information acquired from the sensor.

Abstract: The purpose of the present invention is to provide a position-independent user interface that can realize a large variety of commands and high responsiveness as perceived by a user. A control unit 30 functions when a game involving a plurality of kinds of actions corresponding to predetermined commands represented by predetermined sequences of input events is executed. An input detecting unit 31 detects an input event based on an operation of bringing something into contact with or in proximity to a touchscreen 40. An estimating unit 32 decides, as an estimated command, a command that is estimated as being an input command among the plurality of kinds of commands on the basis of a history of detection results in the input detecting unit 31. A display control unit 33 executes control for displaying an image related to the estimated command on the touchscreen 40.

Abstract: An audio processor for digital audio data is provided, which comprises at least a host interface for connection to a digital audio host to transfer the digital audio data between the digital audio host and the audio processor; a device interface for connection to a user audio device; and a processing unit, connected with the host interface and the device interface. To allow a user to employ an audio device, such as a speaker or a pair of headphones of their choice when connecting to different digital audio hosts, said processing unit is configured to at least conduct a configuration procedure, in which the processing unit communicates with said digital audio host in one of at least a first communication mode and a second communication mode, wherein the communication modes differ from each other, and wherein the communication mode is selected according to the setting of a communication mode selector.

Abstract: A control system for a surgical robot is disclosed. The control system includes a controller, a sensor, a feedback device, a first socket, and a stand-alone input device. The handheld user interface may control a function of a robotic surgical system and is coupled to the sensor and the controller. The sensor is coupled to the controller. The feedback device is coupled to the controller and is configured to provide feedback associated with the robotic surgical system to a user. The controller is communicatively coupleable to the robotic surgical system and is configured to send robot control signals to the robotic surgical system, to receive feedback signals from the robotic surgical system, and to send feedback control signals to the feedback device to control the feedback provided to the user. The controller is configured to couple to a stand-alone input device through the first socket.

Abstract: A first determination region, a second determination region, and a third determination region are set for each non-operation target object. When an operation target object is located within the first determination region, it is determined that the operation target object has collided with the non-operation target object, and a process is performed. In addition, when a touch input is performed in a state where the operation target object is located within the second determination region, it is determined that the operation target object has collided with the non-operation target object, and a process is performed at this time. Moreover, when the operation target object is located within the third determination region, movement control of the operation target object is performed such that the operation target object avoids a collision with the non-operation target object.

Abstract: A virtual reality (VR) system supports improved interactive control processes/services. These interactive control processes/services include detecting movement of a controller associated with a virtual reality (VR) environment, determining an angle of rotation based on the movement, determining a magnitude of force associated with the movement, determining a path in the VR environment that corresponds to the angle of rotation and the magnitude of force, and projecting the path in the VR environment.

Abstract: Methods, apparatuses, systems, and storage media for creating, discovering, and/or resolving spells using a wand are provided. In embodiments, a computing device or a wand may detect one or more gestures and sensors in the wand may generate sensor data representative of the one or more gestures. The one or more gestures may be movements performed using the wand. The sensor data representative of the one or more gestures may be converted into a spell sequence. The wand may transmit the spell sequence to a computing device, and receive, from the computing device, a spell output based on the spell sequence, a wand position, and a quest. The quest may indicate an order in which one or more second devices are to be activated and one or more spells to activate each of the one or more second devices. Other embodiments may be described and/or claimed.

Abstract: A tracking system for durable assets such as personal weapons is provided. The tracking system includes a durable asset tag including an RFID transponder physically mounted within an externally exposed cavity of the durable asset, and an identification card with a machine-readable third unique identifier associated with a person. Different embodiments are disclosed for the durable asset tag, with one embodiment including a helical antenna connected to the RFID transponder for facilitating communication with an RFID reader. The system also includes first and second databases, each storing information associated with the durable asset, and an AIM interface terminal for receiving the first unique identifier from the durable asset tag and the third unique identifier from the identification card, and which communicates with the databases for checking-in or checking-out the durable asset to the person having the identification card.

Abstract: A game apparatus can cast various attacks only by pressing a same operating button without performing any complex operation. Attack methods are each provided with a priority, and also may be provided with a positional condition regarding a positional relationship between a player character and an enemy character, for executing an attack on the enemy character by the player character. For example, the positional condition is “less than 3 m from player character” and the attack method is “close attack with ax.” Since the positional condition “less than 3 m from player character” is given priority over an attack according to the positional condition “3 m or more and less than 10 m from player character,” when an attack operation instruction is received, the player character does an attack with an ax on the enemy character present at a distance of less than 3 m.