With Monoscopic To Stereoscopic Image Conversion (epo) Patents (Class 348/E13.02)
  • Patent number: 11937771
    Abstract: In a method of using a structured-light based system, real-time 2D images of a portion of a field of view are captured using an endoscope. A portion of an object in the field of view is illuminated with a structured light pattern, and light reflected from the field of view is detected. From the reflected light, a 3D image of the field of view is constructed, and 3D locations of points on a surface of the object are determined. The real time 3D spatial position of the endoscope and/or a surgical tool is determined. If a distance between the surface the endoscope and/or surgical tool, as determined using the 3D spatial position, falls below a predetermined distance, an alert is generated to notify a user.
    Type: Grant
    Filed: September 14, 2021
    Date of Patent: March 26, 2024
    Assignee: Asensus Surgical Europe S.à.R.L.
    Inventors: Tal Nir, Motti Frimer, Gal Atarot
  • Patent number: 11917200
    Abstract: Hybrid video decoder supporting intermediate view synthesis of an intermediate view video from a first- and a second-view video which are predictively coded into a multi-view data signal with frames of the second-view video being spatially subdivided into sub-regions and the multi-view data signal having a prediction mode is provided, having: an extractor configured to respectively extract, from the multi-view data signal, for sub-regions of the frames of the second-view video, a disparity vector and a prediction residual; a predictive reconstructor configured to reconstruct the sub-regions of the frames of the second-view video, by generating a prediction from a reconstructed version of a portion of frames of the first-view video using the disparity vectors and a prediction residual for the respective sub-regions; and an intermediate view synthesizer configured to reconstruct first portions of the intermediate view video.
    Type: Grant
    Filed: July 22, 2021
    Date of Patent: February 27, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Thomas Wiegand, Karsten Mueller, Philipp Merkle
  • Patent number: 11861132
    Abstract: Systems and methods are provided for identifying and rendering content relevant to a user's current mental state and context. In an aspect, a system includes a state component that determines a state of a user during a current session of the user with the media system based on navigation of the media system by the user during the current session, media items provided by the media system that are played for watching by the user during the current session, and a manner via which the user interacts with or reacts to the played media items. In an aspect, the state of the user includes a mood of the user. A selection component then selects a media item provided by the media provider based on the state of the user, and a rendering component effectuates rendering of the media item to the user during the current session.
    Type: Grant
    Filed: June 6, 2022
    Date of Patent: January 2, 2024
    Assignee: Google LLC
    Inventors: Thabet Alfishawi, Sagar Mittal, Mark Stevens
  • Patent number: 11710212
    Abstract: In one embodiment, the system may determine an estimated distance of an eye of a user to a display plane of a display. The system may access, from a memory storage, a number of transmission maps characterizing non-uniform transmission characters of the display as measured from a number of pre-determined view positions within a measurement plane. The measurement plane may be separated from the display plane by a known distance. The system may generate a custom transmission map for the estimated distance of the eye based on the transmission maps using light field rendering. The system may determine a custom correction map based on the custom transmission map. The system may adjust an image to be displayed on the display using the custom correction map. The system may display the image adjusted using the custom correction map on the display.
    Type: Grant
    Filed: January 21, 2022
    Date of Patent: July 25, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Edward Buckley, Bennett Sampson Wilburn
  • Patent number: 11657474
    Abstract: In one embodiment, the system may determine an estimated distance of an eye of a user to a display plane of a display. The system may access, from a memory storage, a number of transmission maps characterizing non-uniform transmission characters of the display as measured from a number of pre-determined view positions within a measurement plane. The measurement plane may be separated from the display plane by a known distance. The system may generate a custom transmission map for the estimated distance of the eye based on the transmission maps using light field rendering. The system may determine a custom correction map based on the custom transmission map. The system may adjust an image to be displayed on the display using the custom correction map. The system may display the image adjusted using the custom correction map on the display.
    Type: Grant
    Filed: January 21, 2022
    Date of Patent: May 23, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Edward Buckley, Bennett Sampson Wilburn
  • Patent number: 11652973
    Abstract: A three dimensional system including rendering with variable displacement.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: May 16, 2023
    Assignee: VEFXi Corporation
    Inventors: Craig Peterson, Markus Roberts, Sergey Lomov, Manuel Muro, Pat Doyle
  • Patent number: 11650566
    Abstract: A system for detecting and evaluating environmental quantities and events is formed by a detection and evaluation device and a mobile phone, connected through a wireless connection. The device is enclosed in a containment casing housing a support carrying a plurality of inertial sensors and environmental sensors. A processing unit is coupled to the inertial sensors and to the environmental sensors. A wireless connection unit, is coupled to the processing unit and a wired connection port, is coupled to the processing unit. A programming connector is coupled to the processing unit and is configured to couple to an external programming unit to receive programming instructions of the processing unit. A storage structure is coupled to the processing unit and a power-supply unit supplied power in the detection and evaluation device. The mobile phone stores an application, which enables a basicuse mode, an expert use mode, and an advanced use mode.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: May 16, 2023
    Assignee: STMicroelectronics S.r.l.
    Inventors: Luca Fontanella, Andrea Labombarda, Marco Bianco, Davide Ghezzi, Christian Raineri, Paolo Gatti
  • Patent number: 11541386
    Abstract: An example fluidic device includes an elastic tube, a first actuator coupled to an outer surface of the elastic tube between a first end and a second end of the elastic tube, and a second actuator coupled to the outer surface of the elastic tube between the first actuator and the second end of the elastic tube. The first actuator and the second actuator are configured to move apart from one another to transition a portion of the elastic tube positioned between the first actuator and the second actuator from a first condition to a second condition. A diameter of the elastic tube is greater in the first condition than in the second condition. The fluidic device also includes one or more rotatable components coupled to the first actuator and the second actuator which are configured to rotate the portion of the elastic tube positioned between the first actuator and the second actuator.
    Type: Grant
    Filed: November 6, 2018
    Date of Patent: January 3, 2023
    Assignee: University of Washington
    Inventors: Mark E. Fauver, Eric J. Seibel
  • Patent number: 11521317
    Abstract: Provided is a method for analyzing a tissue specimen, including treating a tissue specimen with an aqueous clearing agent and with at least two fluorescent probes to obtain a cleared and labeled tissue specimen; imaging the cleared and labeled tissue specimen to generate a three-dimensional (3D) image of the tissue specimen; preparing a stained tissue section from the cleared and labeled tissue specimen; capturing a reference two-dimensional (2D) image of the stained tissue section; matching the reference 2D image with the 3D image to extract from the 3D image a series of 2D image slices including a corresponding 2D image slice that corresponds to the reference 2D image; and determining at least one pathological score for each of the series of 2D image slices and reporting the presence or absence and the extent of the disease based on the pathological scores. The method can improve the accuracy of histopathologic diagnosis.
    Type: Grant
    Filed: June 3, 2020
    Date of Patent: December 6, 2022
    Inventors: Ann-Shyn Chiang, Dah-Tsyr Chang, Jia-Ling Yang, Yen-Yin Lin, Yu-Chieh Lin
  • Patent number: 11503991
    Abstract: Embodiments of the present invention may be used to perform measurement of surfaces, such as external and internal surfaces of the human body, in full-field and in 3-D. Embodiments of the present invention may include an electromagnetic radiation source, which may be configured to project electromagnetic radiation onto a surface. The electromagnetic radiation source may be configured to project the electromagnetic radiation in a pattern corresponding to a spatial signal modulation algorithm. The electromagnetic radiation source may also be configured to project the electromagnetic radiation at a frequency suitable for transmission through the media in which the radiation is projected. An image sensor may be configured to capture image data representing the projected pattern.
    Type: Grant
    Filed: February 27, 2020
    Date of Patent: November 22, 2022
    Assignee: Virtual 3-D Technologies Corp.
    Inventor: Robert Zeien
  • Patent number: 9800863
    Abstract: The present disclosure provides an optical-field 3D display apparatus based on multi-layer transparent excitation display, display method thereof, and an electronic device. The 3D display apparatus comprises an array of multiple layers of display units comprising at least two layers of display units, any layer of display unit of the said layers of display units being configured with a transparent fluorescent excitation thin film layer; and an array of excitation projection units comprising at least one excitation projection unit, the light emitted from all the projection units in the array of excitation projection units being projected to corresponding display units in the array of multiple layers of display units to excite the transparent fluorescent excitation thin film layer to display corresponding images, the corresponding images being superimposed for imaging.
    Type: Grant
    Filed: March 31, 2014
    Date of Patent: October 24, 2017
    Assignee: LENOVO (BEIJING) CO., LTD.
    Inventors: Yifan Peng, Guang Yang, Ke Shang
  • Patent number: 9661300
    Abstract: A dynamic stereo and holographic image display includes: an image acquisition lattice, an encoder, a display panel, and a light shielding matrix. The image acquisition lattice acquires an image at each acquisition point. The encoder outputs the image acquired at each acquisition point to a corresponding block of the display panel for display. The display panel displays a corresponding image in each block. The light shielding matrix is disposed in front of the display panel, and restricts emission of light in a specified block on the display panel under the control of the encoder.
    Type: Grant
    Filed: April 16, 2015
    Date of Patent: May 23, 2017
    Inventor: Yang Li
  • Patent number: 9335553
    Abstract: In exemplary implementations of this invention, two LCD screens display a multi-view 3D image that has both horizontal and vertical parallax, and that does not require a viewer to wear any special glasses. Each pixel in the LCDs can take on any value: the pixel can be opaque, transparent, or any shade between. For regions of the image that are adjacent to a step function (e.g., a depth discontinuity) and not adjacent to a sharp corner, the screens display local parallax barriers comprising many small slits. The barriers and the slits tend to be oriented perpendicular to the local angular gradient of the target light field. In some implementations, the display is optimized to seek to minimize the Euclidian distance between the desired light field and the actual light field that is produced. Weighted, non-negative matrix factorization (NMF) is used for this optimization.
    Type: Grant
    Filed: August 26, 2015
    Date of Patent: May 10, 2016
    Assignee: Massachusetts Institute of Technology
    Inventors: Douglas Lanman, Matthew Hirsch, Yun Hee Kim, Szymon Jakubczak, Ramesh Raskar
  • Patent number: 8866884
    Abstract: An image processing apparatus includes an image input unit that inputs a two-dimensional image signal, a depth information output unit that inputs or generates depth information of image areas constituting the two-dimensional image signal, an image conversion unit that receives the image signal and the depth information from the image input unit and the depth information output unit, and generates and outputs a left eye image and a right eye image for realizing binocular stereoscopic vision, and an image output unit that outputs the left and right eye images. The image conversion unit extracts a spatial feature value of the input image signal, and performs an image conversion process including an emphasis process applying the feature value and the depth information with respect to the input image signal, thereby generating at least one of the left eye image and the right eye image.
    Type: Grant
    Filed: December 3, 2010
    Date of Patent: October 21, 2014
    Assignee: Sony Corporation
    Inventors: Atsushi Ito, Toshio Yamazaki, Seiji Kobayashi
  • Publication number: 20140118494
    Abstract: A combined depth map is generated for a monoscopic image based on a weighted combination of a color depth map, a spatial depth map, and a motion depth map for the image, each describing the depth of pixels in the image relative to the image plane. The color depth map determines the depth of pixels according to their color, the spatial depth map determines the depth of pixels according to their location in the image, and the motion depth map determines the depth of pixels according to their motion in the image. Each of the depth maps is associated with a weight that is used to generate the weighted combination. The weights are adaptive to account for variation between different monoscopic images.
    Type: Application
    Filed: November 1, 2012
    Publication date: May 1, 2014
    Applicant: Google Inc.
    Inventors: Chen Wu, Debargha Mukherjee, Meng Wang
  • Publication number: 20130162768
    Abstract: A 2D video to 3D video conversion system includes a video content analysis unit, a depth estimation unit, a post-processing unit, and a stereoscopic video generation unit. The video content analysis unit can analyze a 2D video datum and extract useful information including motion and color from the 2D video datum for depth estimation. The depth estimation unit is adapted for receiving the useful information, calculating motion cue and contrast cue for initial depth estimation, and generating an initial depth map. The post-processing unit is adapted for correcting the initial depth map in spatial domain and temporal domain to increase accuracy in spatial domain and depth continuity between adjacent time instances and for processing the caption in the video to generate a final depth map. The stereoscopic video generation unit is adapted for synthesizing 3D video datum from the final depth map and 2D video datum.
    Type: Application
    Filed: July 6, 2012
    Publication date: June 27, 2013
    Inventors: Wen-Nung LIE, Hsiang-Yun Huang, Wei-Chih Chen
  • Publication number: 20130027515
    Abstract: A method and scanner system for scanning interior surfaces include providing a probe shaped scanner having an axis, the probe shaped scanner includes at least one light source configured to create and project structured light, and at least one camera configured to record 2D images; entering the probe shaped scanner into a cavity of an object, where the cavity is bounded by an interior surface of the object; creating and projecting structured light from the light source of the probe producing a pattern on the interior surface of the object; recording a series of 2D images of the reflection of the pattern from the interior surface using the camera; combining the series of 2D images to obtain 3D real world coordinates of the interior surface; and providing data and processing the data such that surface information for areas of the surface, where image scanning is not complete, is created.
    Type: Application
    Filed: March 30, 2011
    Publication date: January 31, 2013
    Inventors: Michael Vinther, David Fischer, Karl-Josef Hollenbeck, Mike Van Der Poel
  • Publication number: 20120293616
    Abstract: Provided are an appCaratus and a method for converting 2D contents into 3D contents, and a computer-readable medium thereof. The method of converting 2D contents into 3D contents through a content converting apparatus includes: determining a quality of 3D contents to be converted from 2D contents that are video contents and include a plurality of frames; extracting an object from a frame among the plurality of frames; assigning depth to the extracted object; and performing rendering for conversion into 3D contents on the frame having the object assigned with the depth, wherein at least one of the extracting the object, the assigning the depth, and the performing the rendering is performed in accordance with the determined quality of 3D contents. Accordingly, it is possible to provide 3D contents having a variety of quality catering to user's tastes.
    Type: Application
    Filed: March 23, 2012
    Publication date: November 22, 2012
    Applicant: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Oh-yun KWON
  • Publication number: 20120196320
    Abstract: Claimed is an imaging and diagnostic system and method for focal scanning of a specimen using optical projection tomographic microscopy and computer generation of three-dimensional images. One embodiment comprises a light source and an imaging system having an adjustable focal position which acquires a plurality of digital 2D projection images of biological tissue placed within a specimen tube that translates and rotates past an optical lens in a helical pattern. A computer captures the images and generates a 3D composite image. Also claimed is a system and method for preparing a specimen for optical microscopy. One embodiment comprises fixing, staining, and/or optically clearing biological tissue within a microfluidic specimen chamber prior to placement in a specimen tube.
    Type: Application
    Filed: April 20, 2011
    Publication date: August 2, 2012
    Inventors: Eric J. Seibel, Qin Miao, Ryan Lee Coe, Per G. Reinhall, Duane W. Storti
  • Publication number: 20120092455
    Abstract: A video data processing system comprises a control module coupled with a source module for receiving video data from the source module, the video data being associated with at least one source viewpoint; and a view adjustment module coupled with the control module for generating at least one adjusted viewpoint of the video data based on at least one of a set viewpoint number and a number of the at least one source viewpoint. The set viewpoint number is associated with at least one of a viewpoint number of at least one previously received video data and a viewpoint number of at least one previously coupled player module.
    Type: Application
    Filed: December 28, 2010
    Publication date: April 19, 2012
    Inventors: Ya-Chi Tsai, Meng-Han Tsai, Chih-Chun Yang, Ji-Da Chen
  • Publication number: 20120026289
    Abstract: The video processing device enhances the perceived depth of video image obtained by an image obtaining unit, and is provided with: a depth information obtaining unit that obtains depth information indicating the distance in the depth direction of each of a plurality of image portions included in the video image; an image dividing unit that divides the video image, based on the depth information and the video image, into a plurality of image portions having different distances in the depth direction; and an image combining unit that combines the image portions divided at the image dividing unit and a depth-enhancing image used for enhancing the depth of the video image such that the depth-enhancing image is superposed onto one image portion and further that the other image portion having a shorter distance in the depth direction than the one image portion is superposed onto the depth-enhancing image.
    Type: Application
    Filed: March 29, 2010
    Publication date: February 2, 2012
    Inventors: Takeaki Suenaga, Kenichiro Yamamoto, Masahiro Shoi, Makoto Ohtsu, Mikio Seto
  • Publication number: 20110292177
    Abstract: According to one embodiment, an information output control apparatus includes a detector and a controller. The detector is configured to detect a connection of a 3D image incompatible first image display apparatus. The controller is configured to execute control to output 3D image incompatibility information indicating that the first image display apparatus is incompatible with a 3D image in response to the detection of the connection of the first image display apparatus.
    Type: Application
    Filed: April 5, 2011
    Publication date: December 1, 2011
    Inventors: Tokuhiro Sakurai, Teruo Kinoshita, Hideyuki Toma, Masatsugu Mukuge
  • Publication number: 20110074930
    Abstract: There is provided a method for obtaining three-dimensional surface points of an object in an object coordinate system having two groups of steps. The method first comprises providing a set of target positioning features on the object.
    Type: Application
    Filed: December 3, 2010
    Publication date: March 31, 2011
    Inventors: Patrick HÉBERT, Éric ST-PIERRE, Dragan TUBIC
  • Publication number: 20100182404
    Abstract: A three dimensional video reproduction apparatus includes a video input unit operable to input a signal for displaying a 2D image or a 3D image; a separation unit operable to divide an image indicated by the signal inputted in the video input unit into two images; a difference extraction unit operable to extract a difference or correlation between the two divided images; a determination unit operable to determine whether the signal inputted in the video input unit is a signal for displaying a 3D image or a signal for displaying a 2D image, based on the output of the difference extraction unit; and a 2D/3D changeover unit operable to change over an output mode for outputting an image between a 2D mode for displaying a 2D image and a 3D mode for displaying a 3D image, based on the result of the determination by the determination unit.
    Type: Application
    Filed: December 4, 2009
    Publication date: July 22, 2010
    Applicant: Panasonic Corporation
    Inventor: YOSHIKI KUNO
  • Publication number: 20080079660
    Abstract: A method of displaying 3D image on a 3D image displaying apparatus that produces a parallax at least in one direction, the method includes displaying by a displaying unit 2D information that is viewed as a 2D content by a viewer in such a manner that a 2D information angle (?_2D) formed with a virtual display surface of the 2D information and a real horizontal plane satisfies ?_D<?_2D?90°, wherein a display surface is arranged at an angle (?_D) formed with the real horizontal plane in a real space, where 0°??_D<90°.
    Type: Application
    Filed: September 10, 2007
    Publication date: April 3, 2008
    Inventors: Rieko Fukushima, Yuzo Hirayama, Miwako Doi