Abstract: A processing system including at least one processor may detect a location and an orientation of an augmented reality endpoint device of a user at a venue, identify a permission zone of the venue within a field of view of the augmented reality endpoint device in accordance with the location and the orientation of the augmented reality endpoint device, determine at least one condition for the user to access the permission zone, and present, via the augmented reality endpoint device, first visual information associated with the at least one condition for the user to access the permission zone, where the first visual information associated with the at least one condition is presented within the field of view and comprises at least one feature indicative of an association with the permission zone.

Abstract: A stereo calibration method for a movable vision system. The movable vision system involved in the method comprises at least two photography components, at least one calculation component, and at least one control component. The method comprises: placing a calibration template in front of photography components; rotating the photography components by degrees of freedom of motion; obtaining one or more groups of images including calibration template features, and obtaining corresponding position information at the degrees of freedom of motion when the images are obtained; obtaining, by means of calculation, a calibration result of the photography components and the degrees of freedom of motion, i.e.

Abstract: A system, method or compute program product for restricting convergence and divergence when viewing stereo 3D imagery. The technique includes receiving data representing a 3D virtual scene, receiving data indicating an eyepoint and a three-dimensional frustum rendering region with the three dimensional frustum rendering region identifying a position and orientation of a render plane, receiving data indicating a user stereo comfort region, rendering virtual objects in a first portion of the 3D virtual scene that is in the three-dimensional frustum rendering region and within the user stereo comfort region onto the render plane according to a first type of projection, and rendering virtual objects in a second portion of the 3D virtual scene that is in the three-dimensional frustum rendering region and outside the user stereo comfort region onto the render plane according to a different second type of projection.

Abstract: One embodiment is a navigation system for an aircraft including a positioning system to generate information related to a position of the aircraft, a group of cameras mounted to a body of the aircraft, each camera of the group of cameras to simultaneously capture images of a portion of an environment that surrounds the aircraft, and a processing component coupled to the positioning system and the group of cameras, the processing component to determine a current position of the aircraft based on the information related to the position of the aircraft and the images.

Abstract: The system is configured to locate, track and/or analyze activities of living beings in an environment. The system does not require the input of personal biometric data. The sensor system detects infrared (IR) energy from a living being moving in an environment, determines a temperature of the living being based on IR energy data of the IR energy, projects the temperature onto a grid having sequential pixels, determines serial changes of the temperature in the sequential pixels and determines a trajectory of the living being based on the serial changes of the temperature in the sequential pixels.

Abstract: Systems and methods for object detection. The methods comprise, by a computing device: obtaining a plurality of intensity values denoting at least a difference in a first location of at least one object in a first image and a second location of the at least one object in a second image; converting the intensity values to 3D position values; inputting the 3D position values into a classifier algorithm to obtain classifications for data points of a 3D point cloud (each of the classifications comprising a foreground classification or a background classification); and using the classifications to detect at least one object which is located in a foreground or a background.

Abstract: Systems and methods for performing image search are described. An image search method may include generating a feature vector for each of a plurality of stored images using a machine learning model trained using a rotation loss term, receiving a search query comprising a search image with object having an orientation, generating a query feature vector for the search image using the machine learning model, wherein the query feature vector is based at least in part on the orientation, comparing the query feature vector to the feature vector for each of the plurality of stored images, and selecting at least one stored image of the plurality of stored images based on the comparison, wherein the at least one stored image comprises a similar orientation to the orientation of the object in the search image.

Abstract: When an operation panel accepts a movement instruction to move a designated first icon among a plurality of icons from a first position to a second position on an edit screen, the first icon is moved to the second position, and a size of the first icon is changed with movement based on an inter-icon distance between the first icon after the movement and a second icon adjacent to the first icon after the movement.

Abstract: A camera module device includes: a base plate; one or more cameras fixed to and disposed on one surface of the base plate; a plurality of movable cameras movably disposed on the one surface of the base plate and configured to move individually or collectively; a driving gear disposed on the base plate; and a plurality of sub-gears engaged with the driving gear, wherein positions of the plurality of sub-gears are configured to change to selectively transfer power to one or more of the plurality of movable cameras.

Abstract: A display module and a method for driving the same, a display apparatus, and a vehicle are provided. The display module includes a backlight component, and a display component and a light-adjusting component that are located at a side of the backlight component facing toward a light-emitting direction of the display module. The backlight component includes a first light guide structure and a light regulating structure. The light-adjusting component includes first and second electrodes, and a first liquid crystal. The display module has a sharing mode and an anti-peeping mode. In the sharing mode, the first electrode and the second electrode are not energized, and the first liquid crystal is in a wide viewing angle state. In the anti-peeping mode, the first electrode and the second electrode drive the first liquid crystal to be in a narrow viewing angle state.

Abstract: The present invention relates to a lighting system for a motor vehicle. The lighting system comprises at least one first light emitting device mounted on a front right side of the vehicle and adapted to project in front of the vehicle a first pixelated light beam. The lighting system further comprises at least one second light emitting device mounted on a front left side of the vehicle and adapted to project in front of the vehicle a second pixelated light beam. One of the first pixelated light beam and second pixelated light beam, called high resolution beam, has a number of pixels greater than or equal to at least five times, in particular greater than or equal to at least ten times, the number of pixels of the other of said pixelated light beams, called low resolution beam.

Abstract: Techniques are described for passive three-dimensional (3D) image sensing based on chromatic differentiation. For example, an object can be imaged by using a photodetector array to detect light reflected off of the object and focused through a lens onto the array. Light components of different wavelengths tends to be focused through the lens to different focal lengths, which can tend to impact the brightness of each wavelength as detected. For example, if the detector array is closer to a shorter-wavelength focal plane, a white spot will tend to be detected with a higher magnitude of blue light components than of red light components. Ratios of brightness magnitudes for different wavelengths vary in a manner that strongly correlates to object distance from the lens. Embodiments exploit this correlation to passively detect object distance. Some embodiments further provide various types of distance and/or chromatic calibration to further facilitate such detection.

Abstract: A partial electronic see-through HMD includes one or more subassemblies that occlude a central portion of a user's field of view (the peripheral portions of the user's field of view may remain unobstructed). Each subassembly includes an outward facing camera, a display, and an eyepiece. Images of the occluded central zone are captured by the camera and projected to the user via the display and eyepiece. The projected images can also include electronic information, such as AR image overlays. The peripheral zones are not occluded and remain directly viewable by the user. Thus, the projected images complete (or partially complete) the user's FOV of the external environment between the peripheral zones and may provide additional electronic information to the user.

Abstract: A moving picture decoding apparatus, method, and medium for decoding a current block are provided. A first candidate is derived from a first motion vector that has been used to decode a first block. The first block is adjacent to the current block. A first index identifying a reference picture to be selected for decoding the current block is decoded. A second candidate having a second motion vector that includes a non-zero value is derived. The non-zero value is assigned to the reference picture. A selected candidate is selected from a plurality of candidates, including the first candidate and the second candidate. A second index identifying the selected candidate is decoded. The current block is decoded using the selected candidate. The second candidate includes the non-zero value of the reference picture, with the reference picture being selected from a plurality of referable reference pictures.

Abstract: A system for initiating a command of an electric vertical take-off and landing (eVTOL) aircraft includes a flight controller configured to receive a topographical datum, identify an air position as a function of a sensor and the topographical datum, wherein identifying further comprises obtaining a sensor datum as a function of the sensor, and identifying the air position as a function of the sensor datum and the topographical datum using a similarity function, determine a command as a function of the air position, and initiate the command.

Abstract: Embodiments of the present disclosure provide a system, method, apparatus and computer-readable medium for teleoperation. An exemplary system includes a robot machine having a machine body, at least one sensor, at least one robot processor, and at least one user processor operable to maintain a user simulation model of the robot machine and the environment surrounding the robot machine, the at least one user processor being remote from the robot machine. The system further includes at least one user interface comprising a haptic user interface operable to receive user commands and to transmit the user commands to the user simulation model, a display operable to display a virtual representation of the user simulation model.

Abstract: A method includes receiving, through a network by a computing system associated with an artificial-reality device, video data of a user of a second computing system comprising a first and second image of the user. The first and second images may be captured concurrently by a first camera and a second camera of the second computing system, respectively. The computing system generates a planar proxy for displaying the user and determines a pose for the planar proxy within a three-dimensional virtual environment. The computing system renders a left image for a left-eye display and a right image for a right-eye display of the artificial-reality device based on the planar proxy having the determined pose and the first image, and the planar proxy having the determined pose and the second image, respectively. The computing system displays the rendered left image and right image using the left-eye display and right-eye display, respectively.

Abstract: A method of synthesizing intermediate views of a light field includes selecting a configuration of specific input views of a light field collected by a light field acquiring device, specifying coordinates of intermediate views to be synthesized and inputting the specified coordinates to a neural network, and synthesizing intermediate views based on a scene disparity, a selected configuration of the specific input views, and the specified coordinates of the intermediate views, using a neural network.

Abstract: An assembly apparatus includes a retainer, a position measurement device, and a machining device. The retainer is configured to hold an assembly. The position measurement device is configured to measure a difference between an intended machining position and an actual machining position of a first coupling hole in a first assembly component. The first coupling hole is capable of being coupled to the assembly. The machining device is configured to form a second coupling hole capable of communicating with the first coupling hole in the assembly based on a reference position set on the assembly and the difference.

Abstract: An image processing unit includes a shake amount calculation section and a static image-storage control section, and the shake amount calculation section includes a shake amount-calculation processing section and an algorithm switching section. The algorithm switching section applies an algorithm varying for each image, and selects images of which the shake amounts calculated by the shake amount-calculation processing section are small. A first image and a second image, which are selected as the images of which the shake amounts are small, are stored in a static image-storage unit. A display control unit displays static images for storage.

Abstract: Provided is a method for transmitting metadata for omnidirectional content including a plurality of viewpoints. The method comprises identifying the metadata for the omnidirectional content including the plurality of viewpoints; and transmitting the identified metadata, wherein the metadata includes information about an identifier (ID) of a viewpoint group including at least one viewpoint of the plurality of viewpoints, and wherein the at least one viewpoint in the viewpoint group shares a common reference coordinate system.

Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise an image capturing device to capture one or more images, the one or more images corresponding to a field of the view of a user of a head-mounted augmented reality device, and a processor communicatively coupled to the image capturing device to extract a set of map points from the set of images, to identify a set of sparse points and a set of dense points from the extracted set of map points, and to perform a normalization on the set of map points.

Abstract: A method comprising the steps of obtaining at least one frame of input data from at least one sensor, the frame of input data representative of a real-world environment at a given time. The frame is analysed to determine at least a foveal region within the frame, and at least a method for generating depth information associated with the real-world environment based on the frame of input data is selected. The method is applied to the foveal region to generate depth information associated with the foveal region, and at least the depth information associated with the foveal region is outputted.

Abstract: A display processor and computer-implemented method are provided for processing three-dimensional [3D] image data for display on a 3D display. The 3D display is arranged for emitting a series of views of the 3D image data which enables stereoscopic viewing of the 3D image data at multiple viewing positions. The series of views may be displayed on the 3D display using overscan. The degree of overscan may be determined as a function of one or more depth range parameters, the one or more depth range parameters characterizing, at least in part, a degree of depth perceived by a viewer when the series of views is displayed on the 3D display.

Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.

Abstract: From a bit stream, at least the following are decoded: a stereoscopic image of first and second views; a maximum positive disparity between the first and second views; and a minimum negative disparity between the first and second views. In response to the maximum positive disparity violating a limit on positive disparity, a convergence plane of the stereoscopic image is adjusted to comply with the limit on positive disparity. In response to the minimum negative disparity violating a limit on negative disparity, the convergence plane is adjusted to comply with the limit on negative disparity.

Abstract: A system for generating three-dimensional (3D) images from captured images of a target when executing digital magnification. A controller executes a digital magnification on the first image of the target captured by the first image sensor and on the second image captured by the second image sensor of the target. The controller crops the first image and the second image to overlap a first portion of the target captured by the first image sensor with a second portion of the target captured by the second image sensor. The controller adjusts the cropping of the first image and the second image to provide binocular overlap of the first portion of the target with the second portion of target. The displayed cropped first image and the cropped second image display the 3D image at the digital magnification to the user.

Abstract: Provided are a display apparatus and an operation method thereof for preventing image flicker when displaying mixed images: generating a first image corresponding to video content on a first plane, generating, on a second plane, a second image, outputting a mixed image that is a mixture of the first image and the second image, generating a third image on a third plane corresponding to the mixed image, and displaying the third image based on removal of the first image from the display.

Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.

Abstract: This disclosure describes systems, methods, and devices related to the synchronization of image sensors with different exposure durations. In some embodiments, a system may include multiple image sensors, such as cameras, that have differing exposure durations. A data management component may be configured to receive sensor data from the image sensors. In addition, a synchronization component may be configured to transmit a shutter synchronization pulse to the image sensors. Finally, a tracking component may be configured to temporally center, based at least in part on the shutter synchronization pulse, the differing exposure durations of the image sensors. Various other systems and methods are also disclosed.

Abstract: The present disclosure relates to methods and apparatus for graphics processing. In some aspects, the apparatus may receive, by a first device from a second device, first position information corresponding to a first orientation of the second device. The apparatus can also generate, by the first device, first graphical content based on the first position information. Further, the apparatus can also generate, by the first device, motion information for warping the first graphical content. The apparatus can also encode, by the first device, the first graphical content. Additionally, the apparatus can provide, by the first device to the second device, the motion information and the encoded first graphical content.

Abstract: A method and apparatus for depth estimation of a monocular image, and a storage medium are provided. The method includes: obtaining, through a depth estimation neural network, a global feature of a monocular image according to absolute features of preset regions and relative features among the preset regions in the monocular image; and obtaining a predicted depth map of the monocular image according to the global feature, and the absolute features of preset regions and relative features among the preset regions in the monocular image.

Abstract: A method for synthesizing an image of a view from images of N (N>2), implemented by an image synthesis device. The method includes: projecting, to a position corresponding to the image of the view to be synthesized, N depth maps associated with the N views, respectively; for at least one given pixel of at least one projected depth map, for which a depth value has been associated on completion of projection, modifying the depth value of the at least one given pixel if an item of reliability information associated with the depth value is at a certain value, the modification using the depth value of a pixel whose position corresponds to that of the at least one given pixel, in at least one other projected depth map, which generates at least one modified projected depth map.

Abstract: An image rendering method comprises receiving 3D model data for a 3D model and processing the 3D model data to render image data for a hogel view to a render target. Processing the 3D model data to render the image data comprises defining a frustum having an origin at an image plane and rendering multiple sides of the frustum in a single pass without duplicating geometric shapes that pass through the image plane. The frustum comprises a plurality of side planes and having a top portion of the frustum and a bottom portion of the frustum, the plurality of side planes having a set of side plane edges that pass through the origin.

Abstract: A measuring device and a measuring system. The measuring device includes circuitry to obtain at least one pair of stereo captured images captured by a stereo camera, detect two or more feature points from each one of the at least one pair of stereo captured images, and measure a disparity error using a distance between a pair of feature points of the two or more feature points on each one of the at least one pair of stereo captured images, where an equation S img > ? ? ? S E da ? d is satisfied. In the equation, Simg denotes the distance, ? denotes a detection error between the pair of imaging devices. Moreover, Eda denotes precision of measurement of a disparity error in disparity between a pair of images of the at least one pair of stereo captured images, and d denotes the disparity. The stereo camera including a pair of imaging devices.

Abstract: Methods and systems for light field image encoding and decoding are disclosed. According to some embodiments, scene metadata and input light field images associated with a scene are received. A first encoding operation is performed on the scene metadata and input light field images to generate reference images, reference disparity information, and an order of reference views. A second encoding operation is performed based on the reference images and reference disparity information to output light field encoded data. The light field encoded data includes the encoded reference images, the encoded reference disparity information, and the order of reference views. The light field encoded data is transmitted.

Abstract: A display system for a vehicle comprises an imager configured to capture image data in a field of view rearward relative the vehicle. The system further comprises a display device and a controller. The display device comprises a screen disposed in a passenger compartment of the vehicle. The controller is in communication with the imager and the display device. The controller is operable to process the image data to identify at least one feature. Based on a position or orientation of the at least one feature in the image data, the controller adjusts at least one of a position and an orientation of a desired view of the image data for display on the screen.

Abstract: Transform kernel candidates including a vertical transform type associated with a vertical motion and a horizontal transform type associated with a horizontal motion can be encoded or decoded. During an encoding operation, a residual block of a current block is transformed according to a selected transform kernel candidate to produce a transform block. A probability model for encoding the selected transform kernel candidate is then identified based on neighbor transform blocks of the transform block. The selected transform kernel candidate is then encoded according to the probability model. During a decoding operation, the encoded transform kernel candidate is decoded using the probability model. The encoded transform block is then decoded by inverse transforming dequantized transform coefficients thereof according to the decoded transform kernel candidate.

Abstract: An example device for accessing media data includes a memory configured to store media data; and one or more processors implemented in circuitry and configured to: receive a scene description of a GL Transmission Format 2.0 (glTF2) bitstream including a timed media object; determine a position of the timed media object in a presentation environment using the scene description; retrieve current timed media data for the timed media object for a current presentation time; and present the current timed media data according to the position of the timed media object at the current presentation time.

Abstract: An image processing device includes: a solid object extraction unit that divides each of a plurality of captured images into a foreground image part occupied by an existent object and a background image part; a background complementing unit that complements each background image part; a background image synthesis unit that generates a background bird's eye synthetic image by performing bird's eye transformation and combining together the background image parts after undergoing the bird's eye transformation; a solid object recognition unit that acquires posture information on the existent object; a solid object projection unit that acquires a three-dimensional virtual object by using the posture information; a three-dimensional space superimposition unit that generates a three-dimensional space image by superimposing the three-dimensional, virtual object on the background bird's eye synthetic image; and a display image output unit that outputs a bird's eye synthetic image generated based on the three-dimension

Abstract: An optical display system and an AR/VR display device are provided. The optical display system includes: a display screen; a first optical structure, disposed on a light emitting side of the display screen, and configured to divide light from the display screen into different types of polarized light; and a second optical structure, disposed on an emitting path of the different types of polarized light to an image forming side, and configured to form a plurality of virtual image planes corresponding to at least two focal lengths.

Abstract: A method for shortening a waiting time for human-robot interaction, a device and a storage medium are provided. A robot acquires a to-be-executed task, plans an optimal navigation path according to a task location of the to-be-executed task, and goes to a first location according to the planned optimal navigation path to execute a task corresponding to the first location. The robot determines whether there is a worker, capable of performing human-robot cooperation, at the first location. In a case where there is a worker, capable of performing human-robot cooperation, at the first location, the robot sends prompt information and waits, at the first location, for the worker to cooperatively complete the task corresponding to the first location. In a case where there is no worker, capable of performing human-robot cooperation, at the first location, the robot goes to a next location according to the optimal navigation path.

Abstract: Systems and methods of the present disclosure can facilitate determining a three-dimensional surface representation of an object. In some embodiments, the system includes a computer, a calibration module, which is configured to determine a camera geometry of a set of cameras, and an imaging module, which is configured to capture spatial images using the cameras. The computer is configured to determine epipolar lines in the spatial images, transform the spatial images with a collineation transformation, determine second derivative spatial images with a second derivative filter, construct epipolar plane edge images based on zero crossings of second derivative epipolar planes image based on the epipolar lines, select edges and compute depth estimates, sequence the edges based on contours in a spatial edge image, filter the depth estimates, and create a three-dimensional surface representation based on the filtered depth estimates and the original spatial images.

Abstract: This patent provides a novel set of stereoscopic imaging techniques. Such techniques allow extremely large field of view datasets capable of stereoscopic display, such as greater than 270° horizontal field of view and 180° vertical field of view. Thus it is possible to record data in a way that is larger than a user could visualize. A user can thus select which subset of the dataset he/she wants to view. Then, allow the user to view naturally via head tracking and eye tracking to allow one to see and inspect a scene as if one were naturally there viewing it in real time.

Abstract: The present disclosure related to a method for playing a multidimensional reaction-type image. The method includes at least: receiving, by a computer, input manipulation to an object from a user; and extracting, by the computer, an image frame matched to a detailed cell corresponding to location information and depth information in a reaction-type image, depending on the location information and the depth information of the input manipulation received at each playback time point. The depth information is information about pressure strength of the input manipulation applied to the reaction-type image or time length to which the input manipulation is applied. The location information is information about a location of a two-dimensional space in which the input manipulation is applied to the reaction-type image.

Abstract: A system and method for calibrating stereoscopic cameras in an aircraft utilizes a plurality of lasers aimed at a desired convergence point, such as at a point on a runway or other ground facility or projection surface. Each of the stereoscopic cameras are adjusted in terms of pitch, yaw, and roll to align the convergence point in each camera. Misalignments are iteratively corrected, as required. An alignment crosshair is applied, physically or electronically, and the convergence point aligned to the alignment crosshair.

Abstract: In a normal state, a video input interface receives video data. In a setup state, a control input interface receives graphics data for an On Screen Display (OSD) function. In the setup state, an encoder encodes the graphics data, and stores compressed image data S6 thus encoded in memory. In the normal state, a decoder reads one item of the compressed image data from the memory according to an instruction signal, and decodes the compressed image data thus read so as to reproduce the original graphics data. A multiplexer superimposes graphics data on frame data, and outputs the superimposed graphics data.

Abstract: A device for projecting an image on a surface of an object includes an extracting unit configured to extract information about a plurality of lines from an image of the object based on depth information and color information extracted from the image of the object; an image projection distortion information deriving unit configured to derive image projection distortion information about the surface of the object based on the information about the plurality of lines; and a projecting unit configured to project a content image on the surface of the object based on the derived image projection distortion information.

Abstract: A voice output corresponding to a fixed position of a wide viewing angle image is easily obtained. A transmission unit configured to transmit spatial voice data and information regarding a predetermined number of registered viewpoints is included. For example, the spatial voice data is data of scene-based audio. Then, for example, the data of the scene-based audio is each component of an HoA format. For example, the information regarding a viewpoint includes information regarding an azimuth angle (azimuth information) and an elevation angle (elevation angle information) that indicate a position of this viewpoint. For example, the data of the scene-based audio and the information regarding the predetermined number of registered viewpoints are transmitted with being included in a packet of object audio.

Abstract: The present application discloses a method and apparatus for generating a panoramic image. A cuboid three-dimensional image of each local space is determined according to an original two-dimensional image of each local space in the overall space and a preset cuboid model corresponding to each local space, and then a three-dimensional panoramic image of the overall space is generated according to all determined cuboid three-dimensional images. Since the three-dimensional panoramic image of the overall space is generated according to the cuboid three-dimensional images of all local spaces, the overall space may be visually viewed at a three-dimensional angle of view to achieve the three-dimensional real-scene effect.