Abstract: A method and apparatus use a geometric modified image for video encoding/decoding. The encoding method may include: generating a geometric modified reference picture by geometrically modifying a reference picture; generating a prediction block of a current block within an encoding target picture by performing inter prediction by referencing the reference picture or the geometrically modified reference picture; and encoding inter-prediction information of the current block.
Type:
Grant
Filed:
January 28, 2021
Date of Patent:
November 29, 2022
Assignees:
Electronics and Telecommunications Research Institute, University-Industry Cooperation Group of Kyung Hee University
Inventors:
Jung Won Kang, Hyun Suk Ko, Sung Chang Lim, Jin Ho Lee, Dong San Jun, Hui Yong Kim, Gwang Hoon Park, Jin Soo Choi, Tae Hyun Kim, Dae Young Lee, Young Su Heo
Abstract: A real-time broadcasting device includes a plurality of image capturing units arranged to capture images at the same time in different directions from the same point; an image selection unit for comparing the angle of view covered by each of the plurality of image capturing units and the gaze direction of a user terminal, and selecting an image of the image capturing unit, among the plurality of image capturing units, capturing images corresponding to the gaze direction of the user terminal; an image transmission unit for transmitting virtual reality images captured by the image capturing unit selected by the image selection unit to the user terminal in real time; and a gaze direction reception unit for receiving feedback about which direction the gaze direction of the user terminal viewing the virtual reality images is, and transmitting same to the image selection unit.
Abstract: By moving at least one of a culture container having a plurality of wells or an imaging optical system that forms an image of an observation target in each of the wells, an observation position in the culture container is scanned to observe the observation target. In a case where an auto-focus control for each observation position is performed, a start timing of the auto-focus control for each observation position is switched on the basis of a boundary portion between the adjacent wells in a scanning direction of the observation position.
Abstract: Different implementations are described, particularly implementations for video encoding and decoding based on wherein the partitioning tree structure is partially shared between luma and chroma blocks are presented. According to an implementation, a single partitioning tree structure is shared between luma and chroma blocks from a root node of the partitioning tree down to a switching node and a dual partitioning tree structure is determined for luma and chroma blocks from the switching node down to a leaf node of the partitioning tree. Thus, this implementation optimizes the coding efficiency by allowing separated trees for smaller blocks, while limiting the complexity of decoding pipeline.
Abstract: A multiview autostereoscopic display includes a display area including an array of angular pixels, an eye tracker, and a processing system. Each angular pixel emits color that varies across a field of view of that angular pixel. The array of angular pixels displays different views in different viewing zones across the field of view of the display. The eye tracker detects the presence of the eyes of at least one viewer within specific viewing zones and produces eye tracking information including locations of the detected eyes within the specific viewing zones. The processing system renders a specific view for each detected eye based upon the location of the detected eye within the viewing zone with detected eyes, and generates control information for the array of angular pixels to cause the specific view for each detected eye to be displayed in the viewing zone in which that eye was detected.
Type:
Grant
Filed:
November 2, 2020
Date of Patent:
October 18, 2022
Assignee:
GOOGLE LLC
Inventors:
Kari Pulli, Gordon Wetzstein, Ryan Spicer, Andrew Jones, Tomi Maila, Zisimos Economou
Abstract: A surgical imaging system including a surgical imaging device including identification information; a holding arm that holds and controls a position of the imaging device; a user interface configured to provide non-contact operation of the holding arm; and processing circuitry configured to control the holding arm according to the identification information and an output of the user interface.
Type:
Grant
Filed:
January 25, 2018
Date of Patent:
October 18, 2022
Assignee:
SONY CORPORATION
Inventors:
Seiji Wada, Tatsumi Sakaguchi, Takeshi Maeda, Kana Matsuura
Abstract: According to a disclosure of the present document, image information including prediction mode information and information associated with luma mapping with chroma scaling (LMCS) is acquired from a bitstream, wherein the image information includes LMCS adaptation parameter sets (APSs), and by limiting the range of APS ID information included in the LMCS APSs, a memory used in a LMCS procedure may be reduced (limited).
Abstract: Information about changes in vision over time is useful to determine the health of a user. An electronic device has a display that presents visual information to a user. A sensor generates distance data that is used to determine a distance between the user and the display at particular times. Other data may also be acquired that is indicative of whether the user is wearing glasses, tilt of the user's head relative to the display, ambient light level, display brightness, what is being presented on the display such as video content or text content, font size, and so forth. The data is used to determine if the user's vision has changed beyond a threshold amount. If so, an action may be taken, such as providing a recommendation to the user. For example, the user may be advised to consult a health care provider.
Abstract: Methods and systems for improving coding decoding efficiency of video by providing a syntax modeler, a buffer, and a decoder. The syntax modeler may associate a first sequence of symbols with syntax elements. The buffer may store tables, each represented by a symbol in the first sequence, and each used to associate a respective symbol in a second sequence of symbols with encoded data. The decoder decodes the data into a bitstream using the second sequence retrieved from a table.
Abstract: An apparatus for video decoding includes processing circuitry. The processing circuitry can be configured to receive data of a current block coded with an intra block copy (IBC) mode in a bitstream. A block vector of the current block can be determined based on a history-based block vector prediction (HBVP) table that includes one or more entries each corresponding to a previously decoded block. Each entry can include a block vector of the corresponding previously decoded block and a location of the corresponding previously decoded block. The current block can be reconstructed based on the determined block vector of the current block.
Abstract: A head-mounted viewable device includes a display configured to display and project a virtual scene image to a user's eye, a VR optical lens configured to construct an optical path between the display and the user's eye for allowing a virtual scene image being observed by the user's eye, and an eye-tracking system configured to detect a sight direction of the user's eye and adjust a display position of the virtual scene image based on the detected sight direction. The eye-tracking system includes at least one light source configured to project the detection light and a receiving module configured to receive the reflected detection light reflected to determine the sight direction of the user's eye. The receiving module is positioned at a side of the VR optical lens and arranged to face towards the user's eye such that the detection light reflected by the user's eye is directly received by the receiving module.
Abstract: There is provided an image processing apparatus and an image processing method for enabling suppression of an increase in a memory capacity required for orthogonal transform and inverse orthogonal transform. A second transformation matrix is derived using a first transformation matrix, a prediction residual of an image is orthogonally transformed using the derived second transformation matrix, and coefficient data obtained by orthogonally transforming the prediction residual is encoded to generate a bit stream. The present disclosure can be applied to, for example, an image processing apparatus, an image encoding device, an image decoding device, or the like.
Abstract: Low-power eye tracking for detecting position and movements of a user's eyes in a head-mounted device (HMD). An eye tracking system for an HMD may include eye tracking cameras. The eye tracking cameras may be used to capture low-resolution frames between capturing high-resolution frames, for example by binning pixels on the camera sensor or by capturing horizontal and vertical stripes or lines of pixels on the camera sensor rather than entire frames. This low-resolution information may be used to track relative movement of the user's eyes with respect to the device in intervals between the processing of full, high-resolution frames captured by the eye tracking cameras.
Abstract: A method for video processing is provided. The method includes determining, for a conversion between a current video block of a video that is a chroma block and a coded representation of the video, parameters of a cross-component linear model that are completely determinable by two chroma samples and corresponding two luma samples; and performing the conversion based on the determining.
Type:
Grant
Filed:
March 15, 2021
Date of Patent:
September 6, 2022
Assignees:
BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
Inventors:
Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
Abstract: A method of video decoding at a video decoder can include partitioning a coding tree block (CTB) into coding blocks, determining whether an intra sub-partition (ISP) mode is allowable for a current block based on a first block size of the current block that is one of the coding blocks, and decoding the current block according to the ISP mode when the ISP mode is allowed for the current block.
Type:
Grant
Filed:
August 21, 2020
Date of Patent:
September 6, 2022
Assignee:
TENCENT AMERICA LLC
Inventors:
Liang Zhao, Xin Zhao, Xiang Li, Shan Liu
Abstract: According to a disclosure of the present document, image information including prediction mode information and information associated with luma mapping with chroma scaling (LMCS) is acquired from a bitstream, wherein the image information includes LMCS adaptation parameter sets (APSs), and by limiting the range of APS ID information included in the LMCS APSs, a memory used in a LMCS procedure may be reduced (limited).
Abstract: A virtual reality display device, a display device, and a calculation method of a line-of-sight angle are provided. The virtual reality display device includes: a display screen configured to display a picture to a user, at least one infrared light source, and an infrared camera; and the infrared camera is on a side of the display screen away from an eye of the user, and is configured to acquire an eye image of the eye of the user that is illuminated by the at least one infrared light source.
Abstract: This application provides a video picture prediction method and apparatus, to resolve a problem in a conventional technology that a length of a coded video sequence is increased. The first type of identifier may be added to a bitstream. The first type of identifier is used to indicate whether an affine motion model-based inter prediction mode is enabled for a video picture. For a video picture or a picture block included in the slice for which the affine motion model does not need to be used, a parameter, related to the affine motion model, of the picture block may not need to be transmitted. On a decoder side, during decoding of the picture block, the parameter related to the affine motion model does not need to be parsed. This can reduce load of a decoder, increase a processing speed, and decrease a processing time.
Abstract: A gaze-tracking system for use in head-mounted display apparatus. The gaze-tracking system includes: illuminators; camera; and processor configured to: illuminate illuminators in sequential manner; control camera to capture eye images of user's eye during illumination of illuminators; identify reflection(s) of illuminator in eye image; determine extent of deformation in shape of reflection(s) with respect to shape of illuminator; determine extent of displacement in position of reflection(s) with respect to position of illuminator; compute user-specific score for illuminator based on extents of deformation and displacement; select illuminator(s) based on user-specific scores; illuminate illuminator(s); control camera to capture eye image of user's eye during illumination of illuminator(s); and detect gaze direction of user based upon relative position of pupil of user's eye with respect to reflections of illuminator(s) in eye image.
Type:
Grant
Filed:
April 9, 2021
Date of Patent:
August 23, 2022
Assignee:
Varjo Technologies Oy
Inventors:
Thomas Carlsson, Ville Miettinen, Oleksii Shtankevych, Tomi Lehto