Abstract: An image captured by a camera having a fixed imaging range and an image captured by a camera capable of changing an imaging range are appropriately distributed. An imaging apparatus includes a plurality of first imaging units, a second imaging unit configured to be capable of changing an imaging range, and a distribution unit configured to distribute a plurality of first captured images in a sequence based on a region.

Abstract: Provided is an imaging apparatus that includes a first imaging section that sequentially shoots a plurality of images including a first image, a second imaging section that shoots at least one image including a second image, a signal processor that synthesizes the plurality of images shot by the first imaging section, a characteristic amount calculator that calculates a characteristic amount of a subject based on the first image and the second image, and an exposure amount controller that controls exposure amounts of the first imaging section and the second imaging section to reduce a difference between the exposure amount of the first image and the exposure amount of the second image.

Abstract: An image data communication system includes: a first communication terminal including first circuitry; and a second communication terminal including second circuitry. The first circuitry of the first communication terminal is configured to transmit a plurality of pieces of image data and layer display order information indicating a layer display order in which a plurality of images represented by the plurality of pieces of image data are to be displayed. The second circuitry of the second communication terminal is configured to display the plurality of images represented by the plurality of pieces of image data transmitted from the first communication terminal in the layer display order based on the layer display order information transmitted from the first communication terminal.

Abstract: There is provided a generation apparatus, a generation method, a reproduction apparatus, and a reproduction method by which a display image generated by use of an omnidirectional image is made approximately uniform in image quality in all visual line directions. A down-conversion part down-converts an omnidirectional image. A perspective projection part generates multiple images by projecting on multiple two-dimensional planes the omnidirectional image mapped onto a 3D model. This disclosure may be applied, for example, to generation apparatuses that generate an omnidirectional image from captured images in six directions so as to generate low- and high-resolution streams of the omnidirectional image.

Abstract: A method, apparatus and computer program is provided. The method comprises: causing display of a panoramic menu in which a first panoramic menu item and a second panoramic menu item are simultaneously displayed, wherein the first panoramic menu item extends beyond a user's field of view and is associated with first mediated reality content, and the second panoramic menu item extends beyond a user's field of view and is associated with second mediated reality content, different from the first mediated reality content.

Abstract: An electronic device is provided that includes a display, and a first camera module including a first lens and a first lens driving unit. The electronic device also includes a second camera module including a second lens and a second lens driving unit. The electronic device further includes a processor configured to display a first image, which is obtained through the first camera module. The processor is also configured to receive an input associated with switching from the first camera module to the second camera module. Additionally, the processor is configured to move the second lens in a direction that reduces parallax with the first camera module by using the second lens driving unit. The processor is further configured to display a second image, which is obtained through the second camera module in the state in which the second lens is moved.

Abstract: An image capture apparatus suitable for capturing images for use in generating a virtual reality environment, the apparatus comprising a three-dimensional frame that defines an internal volume and a plurality of cameras arranged on the frame so as to form a three-dimensional array, wherein the cameras are arranged to face inwards towards a part of the internal volume and are arranged to capture images of a scene located outside the internal volume, the images also comprising at least a portion of the internal volume.

Abstract: There is provided an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.

Abstract: In various embodiments, a finite aperture omni-directional camera is modeled by aligning a finite aperture lens and focal point with the omni-directional part of the projection. For example, each point on an image plane maps to a direction in camera space. For a spherical projection, the lens can be orientated along this direction and the focal point is picked along this direction at focal distance from the lens. For a cylindrical projection, the lens can be oriented along the projected direction on the two dimensional (2D) xz-plane, as the projection is not omni-directional in the y direction. The focal point is picked along the (unprojected) direction so its projection on the xz-plane is at focal distance from the lens. The final outgoing ray can be constructed by sampling of point on this oriented lens and shooting a ray from there through the focal point.

Abstract: Disclosed herein are a mobile terminal and an operating method thereof. The mobile terminal includes a short-range communication module configured to perform short-range communication with an omnidirectional capture device for capturing an omnidirectional image, a display unit configured to display the omnidirectional image received through the short-range communication module and to receive user input, and a controller configured to set an area, in which a moving image is generated, in the omnidirectional image and to generate the moving image in the set area. Therefore, it is possible to acquire the moving image of the moving object in the omnidirectional image.

Abstract: Embodiments of the present application provide a method, apparatus, electronic device for displaying an image and a storage medium. The method and apparatus are applied to an electronic device. The method comprises: determining a display angle of a 3D wallpaper containing elements, wherein the 3D wallpaper is obtained by pasting an overall spherical panoramic image containing all the elements onto one 3D model; determining a graphic to be displayed corresponding to the display angle in the overall spherical panoramic image; and rendering the graphic to be displayed and displaying the rendered graphic. In the embodiments, when the graphic to be displayed corresponding to the display angle of the 3D wallpaper is rendered, the operation on unnecessary occluded parts is avoided, thereby reducing the amount of computation in displaying the 3D wallpaper and saving the computing resources.

Abstract: Systems and methods are described for colorizing a point cloud comprising a set of point cloud data points associated with a particular object using a plurality of candidate images. For each respective data point in the set of point cloud data points, an image is selected, from a subset of the plurality of candidate images that include an un-occluded point of the particular object corresponding to the respective data point, that has a shortest subject distance to the un-occluded point of the particular object. The respective data point is colorized based on a color in the selected image of the un-occluded point of the particular object corresponding to the respective data point.

Abstract: A set of images is mapped to a three-dimensional shape. A two-dimensional image that includes at least two portions is generated based on the three-dimensional shape, and within at least one of the at least two portions is rendered a transformation of at least a subset of the set of images. The two-dimensional image is provided to a display device to cause the display device to simultaneously display at least the two portions on a display surface.

Abstract: An apparatus for applying a convolutional neural network (CNN) to a wide-angle camera image is described herein. The apparatus includes a camera, controller, convolution mechanism and a fully connected layer. The camera is to capture a wide-angle image, and the controller is to map the image on a 3D surface. The convolution mechanism is to perform convolution on the 3D surface and the fully connected layer is to classify a plurality of features generated by the convolution mechanism.

Abstract: As user device can receive and display 360 panoramic content in a 360 depth format. 360 depth content can comprise 360 panoramic image data and corresponding depth information. To display 360 depth content, the user device can generate a 3D environment based on the 360 depth content and the current user viewpoint. A content display module on the user device can render 360 depth content using a standard 3D rendering pipeline modified to render 360 depth content. The content display module can use a vertex shader or fragment shader of the 3D rendering pipeline to interpret the depth information of the 360 depth content into the 3D environment as it is rendered.

Abstract: Now it is time to extend the capability of Internet to “Virtual Existence”; make a rapid change to “the 3D World”, both in real and animation environment; start the new Era of “the instant travels”; “stop the wasted time” with many hours of travelling with cars and replace (reduce) the cars with the best alternative: “Task-Ins Cubicle”. Task-Ins-Cubicle is “a round room”, equipped with Monitors, Cameras, Speakers, and Microphones inside and outside, equipped inside with a Control Console, Internet Connection, and with possibly seating or laying arrangement. The Local Cubicle communicates with a Remote Cubicle placed anywhere in the world. A person in the Local Cubicle is able to feel everything of the Remote Cubicle. Persons at the Remote Task-Ins Cubicle are able to feel the complete holographic existence of the person from the Local Task-Ins Cubicle. Remote Task-Ins Cubicle can be replaced with a virtual Emulation World, to enable 3D Experience with Games and Imaginary Worlds.

Abstract: Apparatus and methods for providing block-based layouts for non-rectangular regions between non-contiguous imaging regions in projections such as, for example, Rotated Sphere Projections (RSP). In one embodiment, methods and apparatus for selecting coding unit block sizes for non-rectangular regions disposed between non-contiguous imaging portions is disclosed.

Abstract: A system that facilitates collecting data is described herein. The system includes a digital camera that is configured to capture images in a visible light spectrum and a near-infrared camera that is configured to capture near infrared images, wherein a field of view of the digital camera and the field of view of the near-infrared camera are substantially similar. The system further includes a trigger component that is configured to cause the digital camera and the near-infrared camera to capture images at a substantially similar point in time, and also includes a mounting mechanism that facilitates mounting the digital camera and the near-infrared camera to an automobile.

Abstract: An image processing apparatus according to an embodiment of the present invention specifies a partial area of a three-dimensional shape model that is generated based on a plurality of captured images obtained by a plurality of cameras. The image processing apparatus includes: a display control unit configured to display a display image based on a captured image of at least one camera of the plurality of cameras on a display unit; a designation unit configured to designate an area on the display image displayed by the display control unit; and a specification unit configured to specify an area on a three-dimensional shape model, which corresponds to an area designated by the designation unit on the display image, based on captured images of two or more cameras of the plurality of cameras.

Abstract: Systems, methods and computer-readable media for creating and using video analysis rules that are based on map data are disclosed. A sensor(s), such as a video camera, can track and monitor a geographic location, such as a road, pipeline, or other location or installation. A video analytics engine can receive video streams from the sensor, and identify a location of the imaged view in a geo-registered map space, such as a latitude-longitude defined map space. A user can operate a graphical user interface to draw, enter, select, and/or otherwise input on a map a set of rules for detection of events in the monitored scene, such as tripwires and areas of interest. When tripwires, areas of interest, and/or other features are approached or crossed, the engine can perform responsive actions, such as generating an alert and sending it to a user.

Abstract: A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.

Abstract: Systems and methods related to augmented reality guidance for an image capture process using panorama paths may include presenting various text, cues, and indications to guide the image capture process. A user device including an imaging sensor and position and orientation sensors may present, via a display, the various text, cues, and indications during portions of the image capture process, including a plurality of image capture locations, imaging sensor sweep guides, textual instructions, arrows, and position guides.

Abstract: The alignment of a camera system is less expensive when using a holder with a plurality of connecting pieces, each implemented for connecting, fitting or clamping with a counterpart of a camera housing or an objective, a holder that is implemented such that the connecting pieces or holder modules of the holder, where the connecting pieces are held rigidly or merely at rotation axes, are held rigidly with respect to one another along at least one common spatial direction.

Abstract: An image processing device may include a control unit. The control unit may be operable, in a first mode, to control display on a display screen of a representative image of a group of images and, in a second mode, to control display on the display screen of an image of the group of images corresponding to a posture of the device. In addition, the control unit may be operable to switch between operation in the first mode and the second mode.

Abstract: A system and method for distributed analysis of image data in a video surveillance system can be deployed in households, businesses, and within corporate entities, in examples. The image data are processed on local video analytics systems located within the networks of the businesses or on remote video analytics systems hosted by a cloud service. To limit the data traffic imposed by the image data on the network, the system divides the image data processing into separate object detection and analysis functions. The system can also integrate the object detection function within the surveillance cameras or on a local gateway. This can significantly reduce the data traffic sent over networks as compared to current video surveillance systems and methods since only image data containing object of interest needs to be sent.

Abstract: Disclosed is a method for photographing a panoramic image including the steps of recognizing movement of a corresponding photographing apparatus by comparing a current real-time input image with a previous image through a motion estimation mechanism with exposure compensation, determining a time to photograph each next picture by determining whether movement in a photography direction reaches a preset threshold value, and photographing each next picture by manual or automatic operation at the determined time.

Abstract: Embodiments of the present invention are directed towards methods and systems for providing an enhanced telepresence experience to users participating in a videoconferencing session (VCS). In the embodiments a camera is configured and arranged to capture image data covering objects within a substantial portion of the field of view (FOV) of a display device, without capturing image data encoding images displayed on the display device. That is, the camera's FOV is aligned with the display device's FOV. As such, the camera captures image data encoding images in a substantial portion of the display's FOV. According, users within a VCS may approach their display without falling outside their camera's FOV. This provides an enhanced telepresence experience, where the users may interact with each other through what appears to be a transparent window or barrier.

Abstract: A method for encoding a LUT defined as a lattice of vertices is disclosed. At least one value is of each vertex of the lattice. The method comprises for a current vertex: predicting the at least one value of said current vertex from another value which is for example obtained from reconstructed values of neighboring vertices; and encoding in a bitstream at least one residue computed between the at least one value of the current vertex and its prediction in a bitstream.

Abstract: A method and a system for selective-content processing of panoramic multimedia signals are disclosed. Features of panoramic cameras and low-latency virtual-reality headsets are exploited to create an advanced efficient system for covering events of diverse and fast-motion actions for the purpose of both broadcasting and data streaming. The disclosed system employs a virtual-reality headset to produce a display of a multimedia signal and generate geometric data defining a view region of the display. A content-filtered signal is extracted from the multimedia signal, according to the geometric data, for broadcasting and dissemination to client devices of a universal streaming server.

Abstract: The present application discloses a method and system for interactive transmission of panoramic video, wherein the method comprises: determining, by a client, the location information of a user's current region of interest; requesting a server for video information of the region of interest by using the location information; and, acquiring, by the server, a panoramic video slice corresponding to the region of interest according to the location information, and transmitting the panoramic video slice to the client. With the present invention, resource overhead and a delay of transmission of panoramic video can be reduced.

Abstract: An information processing apparatus configured to paste a full-spherical panoramic image along an inner wall of a virtual three-dimensional sphere; calculate an arrangement position for arranging a planar image closer to a center point of the virtual three-dimensional sphere than the inner wall, in such an orientation that a line-of-sight direction from the center point to the inner wall and a perpendicular line of the planar image are parallel to each other, the planar image being obtained by pasting an embedding image to be embedded in the full-spherical panoramic image, on a two-dimensional plane; and display a display image on a display unit. The display image is a two-dimensional image viewed from the center point in the line-of-sight direction in a state in which the full-spherical panoramic image is pasted along the inner wall of the virtual three-dimensional sphere and the planar image is arranged at an arrangement position.

Abstract: The present invention is a system for capturing and assembling panoramic image data having a panoramic image capture device with image assembly parameters and configured to capture image content data, an encoding device coupled to the panoramic image capture device and configured to combine the image content data and the image assembly parameters into a panoramic image file, and a decoding device configured to receive the panoramic image file and assemble, based on the image assembly parameters, at least a portion of the image content data into an output image.

Abstract: A device includes a display panel configured to display an interface. The device includes a motion sensor configured to detect a motion of the device and to output a detection signal in response to the detection of the motion. The device includes circuitry configured to control, based on the detection signal, the display panel such that at least one of a display position and a display size of an element displayed in the interface changes, wherein when the motion includes a physical shock on the device, the detection signal includes an indication of a hitting position corresponding to a position on the device where the physical shock is detected by the motion sensor, and the circuitry controls the display panel such that the at least one of the display position and the display size of the element changes based on the hitting position.

Abstract: An electronic device comprises a camera; a sensor configured to sense a motion; and one or more processors, wherein the one or more processors are configured to: sequentially acquire a plurality of images using the camera and acquire motion information of the plurality of images using the sensor, during a specified time; create a panoramic image with a first image sub-set comprising a portion of the plurality of images and a second image sub-set comprising another portion of the plurality of images, and moving picture data related to the panoramic image; and determine whether to correct at least a partial section of the moving picture data using a particular image from the second image sub-set that corresponds to the at least the partial section of the moving picture data, based on the frame rate of the at least the partial section of the moving picture data.

Abstract: A system for displaying an anamorphic image on a viewing surface comprises a screen having a viewing surface and an image source configured to display the anamorphic image on the viewing surface such that an image viewed on the viewing surface appears undistorted from a viewing point. In addition, the system may also include a reflective lens having a convex exterior surface and a refractive lens having a plurality of surfaces to redirect light toward an image capture device. Further, the system may include an image conversion module for converting a non-anamorphic image into the anamorphic image suitable for displaying on the viewing surface and a selected portion of the anamorphic image into at least one non-anamorphic image.

Abstract: This invention encodes, using less memory, a wide-angle image obtained by performing image capturing a plurality of times. An apparatus includes a compositing unit that, each time an image capturing unit captures an image, crops a partial image of a predetermined region in the captured image, and composes the partial image with a composed image obtained from a previously captured image, an encoding unit that, when the composed image updated by the compositing unit has a pre-set size, encodes the image of the tile in the composed image, a releasing unit that releases an area used for the encoded tile in the memory, and a control unit that controls the compositing unit, the encoding unit, and the releasing unit so as to repeatedly perform operations until a pre-set condition is satisfied.

Abstract: An image capturing apparatus according to the present disclosure displays, on a display, a live view image captured by an image sensor and a guide indicating a predetermined area being an area within the live view image, being located at a position unrelated to an object included in the live view image, including no edge of the live view image, and being located within an area to be clipped from a first image to generate a panoramic image but excluding a joining portion of the area to be clipped. A first partial area including an entire area corresponding to the predetermined area in the first image among a plurality of images captured in a series of image capturing processes in panoramic image capturing is combined with a plurality of partial areas among the plurality of images other than the first image to generate the panoramic image.

Abstract: A method and system for generating a video production of an event that can be implemented automatically in real-time and with minimal operator intervention. The method includes receiving a plurality of video signals of an event. Each video signal includes a plurality of image frames. Each image frame corresponds to a view of the event. In addition, the method includes receiving at least one predefined condition associated with the event. Further, the method includes selecting a section of at least one of the plurality of image frames based on the at least one predefined condition to generate at least one output image frame. The method also includes generating a video production from the at least one output image frame.

Abstract: An apparatus includes a plurality of cameras and a circuit. The cameras may be mounted on a vehicle and configured to generate a plurality of initial video signals of a scene outside of the vehicle. A plurality of fields of view of adjoining ones of the cameras may spatially overlap each other. The circuit may be configured to (i) store calibration values of the cameras generated during a calibration process, (ii) modify at least one of the initial video signals by applying the calibration values and (iii) generate a final video signal suitable to display to a user of the vehicle by stitching together the initial video signals. The calibration values may be used by the circuit to generate approximately continuous brightness within the scene in the final video signal.

Abstract: The optical system is characterized by a rotationally symmetric front group that is located on a single axis of rotational symmetry passing through the center of an image plane, a rotationally symmetric back group, and an aperture, wherein the front group includes two internal reflecting surfaces and two transmitting surfaces, a light beam incident from at least one object plane on the front group forms an optical path along which the light beam enters a first transmitting surface, is reflected off a first reflecting surface and then off a second reflecting surface, and exits out of a second transmitting surface, and the light beam passes through the back group and aperture and is imaged in a position of the image plane away from the axis of rotational symmetry without being intermediately imaged within a section including the axis of rotational symmetry.

Abstract: An electronic device and a method of operating a panorama function in the electronic device are provided. The electronic device includes at least one processor, a memory, a camera configured to sequentially obtain a plurality of images if an image capture is started, and a sensor configured to sense motion of the electronic device. The at least one processor is configured to store in the memory a panorama content file comprising panorama image data and dynamic panorama data generated based on the plurality of images and the motion of the electronic device sensed during the image capture.

Abstract: An image processing apparatus including an interface that receives an input identifying a subject, and a processor that controls a display to display information indicating a position of the subject in a graphic representation corresponding to a panoramic image based on an orientation of a device capturing image data for generating the panoramic image.

Abstract: A wide-angle lens assembly includes a first lens, a second lens, a third lens, a fourth lens, a fifth lens, and a sixth lens. The first lens is with refractive power. The second lens includes a convex surface facing the object side. The third lens is with positive refractive power and includes a convex surface facing the image side. The fourth lens is with refractive power. The fifth lens includes a concave surface facing the object side. The sixth lens includes a concave surface facing the image side. The wide-angle lens assembly satisfies: 0.62<(R41?R42)/(R41+R42)<5.60, wherein R41 is a radius of curvature of an object side surface of the fourth lens and R42 is a radius of curvature of an image side surface of the fourth lens.

Abstract: A method and an apparatus for presenting a panoramic photo in a mobile terminal, and a mobile terminal. A trigger instruction that is used to instruct the mobile terminal to enter an immersive browsing mode is detected, where the immersive browsing mode is a browsing mode in which a panoramic photo moves as the mobile terminal rotates; and if the trigger instruction is detected, a rotation angle of the mobile terminal is detected and determined, and a panoramic photo that is presented in a normal mode in the mobile terminal is moved and presented according to the determined rotation angle. Using the present disclosure, complexity of panoramic photo browsing can be reduced, which makes it convenient for a user to browse a panoramic photo.

Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.

Abstract: Techniques and systems to support immersive media content navigation and editing are described. A two-dimensional equirectangular projection of a spherical video is generated by a computing device and displayed in a navigator portion of a user interface of a content editing application. A visual position indicator, indicative of a position within the spherical video, is displayed over the 2D equirectangular projection of the spherical video. A portion of the spherical video is determined based on the position, and a planar spherical view of the portion of the spherical video is generated by the computing device and displayed in a compositor portion of the user interface. The navigator portion and the compositor portion are linked such that user input to the navigator portion or the compositor portion of the user interface causes corresponding visual changes in both the navigator portion and the compositor portion of the user interface.

Abstract: An optical system includes a central portion having a magnification per unit angle of view which increases from a center to an outside at an increase rate and a circumferential portion being outside the central portion and having a magnification per unit of view which increases from the central portion to an outside at an increase rate smaller than the increase rate of the central portion.

Abstract: A video processing method includes receiving an omnidirectional content corresponding to a sphere, generating a projection-based frame according to the omnidirectional content and a pyramid projection layout, and encoding, by a video encoder, the projection-based frame to generate a part of a bitstream. The projection-based frame has a 360-degree content represented by a base projection face and a plurality of lateral projection faces packed in the pyramid projection layout. The base projection face and the lateral projection faces are obtained according to at least projection relationship between a pyramid and the sphere.

Abstract: An image processing apparatus including an interface that receives an input identifying a subject, and a processor that generates a panoramic image based on captured image data so that the subject is positioned in a reference position in the panoramic image.

Abstract: Apparatus and methods for providing a rotated spherical viewpoint (RSV). In one or more embodiments, the RSV is implemented using equirectangular projections (ERPs). The RSV methodologies described herein are particularly suitable for panning within virtual reality (VR) or 360° panoramic content as there is minimal, if any, geometric distortions at the edge of a given viewport. Moreover, the RSV methodologies described herein may reduce the bandwidth requirements of, for example, devices operating in a client-server architecture. Additionally, the computation requirements for providing RSV are minimal and can be provided using relatively simple rotation transforms.