Abstract: A method of three hundred and sixty degree) (360°) streaming implemented by a client device. The method includes receiving, by the client device, a media presentation description (MPD) file from a content server, the MPD file describing a media content, the media content comprising a plurality of viewpoints each corresponding to one of a plurality of 360° video camera sets; transmitting, by the client device, a request for a part of the media content based on the MPD file that was received; receiving, by the client device, the part of the media content that was requested; rendering, by the client device, a viewport using the part of the media content that was received, the viewport belonging to one viewpoint from the plurality of viewpoints; and generating, by the client device, a metric containing a viewpoint identifier, the viewpoint identifier identifying the viewpoint that the viewport that was rendered belongs to.

Abstract: An image pickup apparatus for endoscope includes: an imager, an optical device, an optical module on which the optical device is mounted, an optical fiber optically coupled with the optical device, a ferrule having an insertion hole into which the optical fiber is inserted, and a wiring board including a first rigid board, a second rigid board and a flexible intermediate board. The ferrule is fixed to the second rigid board or a first principal surface of the optical module. A first side surface of the optical module is glued to the first rigid board, and the first principal surface is glued to the second rigid board.

Abstract: A method and apparatus of video coding are disclosed. A piece-wise linear mapping is derived to map a target luma sample from a first signal domain to a second signal domain, or vice versa. The piece-wise linear mapping process comprises determining first pivot points for performing video encoding or decoding of the luma samples using a piece-wise linear mapping. The first pivot points are determined so that: if a target mapped pivot point corresponding to one first pivot point in the second signal domain has a multiple of the target interval value, the target mapped pivot point and a next mapped pivot point can be located in a same second segment; and otherwise, the target mapped pivot point and the next mapped pivot point cannot be located in the same second segment.

Abstract: A three-dimensional data encoding method encodes a plurality of three-dimensional points, and includes: selecting one prediction mode from two or more prediction modes for calculating a predicted value of an attribute information item of a first three-dimensional point, in accordance with attribute information items of one or more second three-dimensional points in vicinity of the first three-dimensional point; calculating the predicted value by the selected prediction mode; calculating, as a prediction residual, a difference between a value of the attribute information item of the first three-dimensional point and the calculated predicted value; and generating a first bit stream that includes the selected prediction mode, the prediction residual, and a number of the two or more prediction modes.

Abstract: A video system that partitions slices of video pictures into slice chunks is provided. A video decoder receives data from a bitstream to be decoded as a current picture of a video. When a first syntax element in a picture parameter set (PPS) of the current picture indicates that one or more slices of the current picture are allowed to be divided into multiple slice chunks and when a second syntax element in a slice header of a current slice of the current picture indicates that data of the current slice is encoded and delivered in two or more slice chunks, the video decoder parses and specifies sizes and positions of the slice chunks of the current slice and reconstructs the current picture based on the slice chunks of the current slice.

Abstract: A method for detecting one or more gaze-related parameters of a user is disclosed. In one example, the method includes creating a left image of at least a portion of a left eye of the user using a first camera of a head-wearable device worn by the user, and creating a right image of at least a portion of a right eye of the user using a second camera of the head-wearable device. The left and right images are fed together as an input into a convolutional neural network. One or more gaze-related parameters are obtained from the convolutional neural network as a result of the left and right images input.

Abstract: A control apparatus includes one or more processors which functions as a detection unit configured to acquire image data captured by an image pickup unit and detect an object from the image data, a capturing control unit configured to output an instruction to start capturing to the image pickup unit to cause the image pickup unit to automatically capture moving images, a camerawork decision unit configured to decide camerawork to be given to the moving images based on information indicating a detection result from the detection unit, and a control unit configured to perform control to change at least one of a composition of the image pickup unit and a focus of the photographic optical system with a predetermined pattern during the capturing of the moving images based on a decision result from the camerawork decision unit.

Abstract: Modules and control units cooperate to simultaneously and independently control and adjust pixel parameters non-uniformly at regional increments across an entire image captured in an image frame by pixels in a pixel array. Pixel parameter changes for pixels in a given region occur, based on i) a contextual understanding of what contextually was happening in the one or more prior image frames and ii) whether salient items are located within that region. Additionally, guidance is sent to the sensor control unit to i) increase or decrease pixel parameters within those regions with salient items and then either to i) maintain, ii) increase or iii) decrease pixel parameters within regions without salient items in order to stay within any i) bandwidth limitations ii) memory storage, and/or iii) power consumptions limitations imposed by 1) one or more image sensors or 2) the communication loop between the sensor control unit and the image processing unit.

Abstract: Trisoup node size per slice enables flexibility when encoding a point cloud. Instead of each block/node being the same size, a user or machine is able to indicate block/node sizes such that regions of interest are able to have smaller node sizes for more specificity in that region.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. The processing circuitry decodes a first syntax element at coding locations within a transform block for a current block in a first coding pass that scans the coding locations within the transform block, and decodes a second syntax element at the coding locations within the transform block in a second coding pass that is after the first coding pass and scans the coding locations within the transform block. Then, the processing circuitry determines residuals in the transform block based on at least the decoded first syntax element and the decoded second syntax element at the coding locations in the transform block, and reconstructs samples of the current block based on the residuals in the transform block.

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. Various compression strategies may be used to encode an occupancy map and related block-to-patch information indicating which portions of the image frame correspond to which packed patches. Packed image frames comprising patches and padding, along with an encoded occupancy map and related block-to-patch information are sent to a decoder. The decoder is configured to generate a decompressed point cloud based on the packed image frames, compressed occupancy map, and related block-to-patch information.

Abstract: Methods and apparatus for detecting space-shifted media content associated with a digital recording/playback device are disclosed. An example apparatus includes means for detecting that first data associated with media is being written to a first storage of a first media device on a home network at a monitored location, the means for detecting to receive information on the first data from a first metering device and, in response to detecting the first data being written, request, from a second metering device, second data being read from a second storage of a second media device on the home network. The example apparatus also include means for determining that the media has been space-shifted to the first media device from the second media device when the first data that is being written to the first storage matches the second data being read from the second storage.

Abstract: Described herein are techniques for tracking objects (including human body parts such as a hand), namely: 1) two-state transducer interpolation in acoustic phased-arrays; 2) modulation techniques in acoustic phased-arrays; 3) fast acoustic full matrix capture during haptic effects; 4) time-of-flight depth sensor fusion system; 5) phase modulated spherical wave-fronts in acoustic phased-arrays; 6) long wavelength phase modulation of acoustic field for location and tracking; and 7) camera calibration through ultrasonic range sensing.

Abstract: An image coding method includes selecting two or more transform components from among a plurality of transform components that include a translation component and non-translation components, the two or more transform components serving as reference information that represents a reference destination of a current block; coding selection information that identifies the two or more transform components that have been selected from among the plurality of transform components; and coding the reference information of the current block by using reference information of a coded block different from the current block.

Abstract: There is provided an image processing apparatus and an image processing method capable of suppressing a reduction in encoding efficiency. The number of significant figures of a prediction residual of an image is expanded on the basis of a bit depth indicating a range of pixel values of a local level that is a data unit smaller than a sequence level of the image; the number of significant figures of a quantized coefficient obtained by performance of orthogonal transform and quantization on the prediction residual the number of significant figures of which is expanded is normalized on the basis of the bit depth of the local level; and the quantized coefficient the number of significant figures of which is normalized is encoded and a bit stream is generated. The present disclosure is applicable to, for example, an image processing apparatus, an image encoding apparatus, or an image decoding apparatus.

Abstract: A distributed video management system that allows for monitoring a camera allocation parameter and dynamic reallocation of video cameras to available camera nodes in response to detecting a change in the allocation parameter including selectively dropping at least one camera from the system based on a priority of the camera. The change in allocation parameter may be due to a number of potential contexts including a change in availability of camera nodes, a change in the nature of the video data captured, a change in computational load, or other change that results in a change in allocation parameter. The disconnection or “dropping” of a camera may be temporary in response to an increase in computational load on the system. The use of priority values of the cameras may allow for sufficient camera coverage to be provided by the system while maintaining processing of video data from higher priority cameras.

Abstract: A robotic imaging apparatus is disclosed. A robotic imaging apparatus includes a robotic arm, a stereoscopic camera, and a sensor positioned between the robotic arm and the stereoscopic camera. The sensor transmits output data that is indicative of translational and/or rotational force imparted on the stereoscopic camera by an operator. The robotic imaging apparatus also includes a processor that is configured to determine a movement sequence for the robotic arm based on a current position of the robotic arm and the output data from the sensor and to cause at least one of the joints of the robotic arm to rotate based on the determined movement sequence via one or more motor control signals provided to the at least one joint. The rotation of the at least one joint provides power-assisted movement of the robotic arm based on the detected translational and/or rotational forces imparted by the operator.

Abstract: A method of encoding a video frame into a bitstream is described including: applying a downsampling scheme to an original video frame of a first resolution for determining a first low-resolution, LR, original frame and one or more second original LR frames, the first LR original frame and the one or more second LR original frames being of a second resolution that is lower than the first resolution; partitioning the first LR original frame into first original blocks and partitioning the one or more second LR frames into second original blocks; using a prediction method for determining first predicted blocks, the first predicted blocks defining predictions for the first original blocks of the first LR original frame; determining first residual blocks based on the first predicted blocks and the first original blocks and, subsequently, determining first reconstructed blocks based on the first residual blocks and the first predicted blocks; determining second predicted blocks based on the first reconstructed block

Abstract: An image decoding method which can improve both image quality and coding efficiency is an image decoding method for decoding a coded stream which includes a plurality of processing units and a header for the processing units, the coded stream being generated by coding a moving picture, the processing units including at least one processing unit layered to be split into a plurality of smaller processing units, the image decoding method including specifying a hierarchical layer having a processing unit in which a parameter necessary for decoding is stored, by parsing hierarchy depth information stored in the header, and decoding the processing unit using the parameter stored in the processing unit located at the specified hierarchical layer.

Abstract: Systems and methods to monitor and interact with users viewing screens are disclosed. An example system includes a sensor to gather gaze data from a user viewing images on a display. The display has spatial coordinates. The system includes a processor communicatively coupled to the display and the sensor. The processor determines a first gaze location having first spatial coordinates based on the gaze data and calibration settings associated with determining gaze locations. The processor alters a portion of the display at or near the first gaze location. After the portion of the display has been altered, the processor determines a second gaze location having second spatial coordinates based on the gaze data and the calibration settings. The processor performs a comparison of the first gaze location to the second gaze location.