Patents Examined by Mark Zimmerman
  • Patent number: 10032311
    Abstract: Present novel and non-trivial system, device, and method for enhancing a three-dimensional synthetic image are disclosed. The image generating system is comprised of a first image data source, a second image data source, an image processing unit (“IPU”), and a display system. The IPU may be configured to receive first image data of a first image of a first external scene produced from object data; receive second image data of a second image of a second external scene produced from point cloud data acquired by one or more image capturing devices or object data augmented with point cloud data; combine the first image data with the second image data to produce third image data of a third image of the first external scene; and provide the third image data set to the display system. Fourth image data could be received and included in the production of the three image data.
    Type: Grant
    Filed: September 29, 2014
    Date of Patent: July 24, 2018
    Assignee: Rockwell Collins, Inc.
    Inventors: Max G. Taylor, Scott E. Schultz, Matthew J. Cunnien, Michael J. Armstrong, Ryan J. Olson, Peter J. Flugstad, Shawn M. Spencer
  • Patent number: 10026213
    Abstract: Systems and techniques relating to scene rendering in computer graphics applications, such as rendering a scene using image based lighting, include a method including: performing, by a computer, ray tracing for a scene to be rendered by the computer, wherein performing the ray tracing include calculating a ray spread value for a ray propagated through the scene, the ray spread value being calculated based on a reflection geometry of at least one surface within the scene, and calculating a ray divergence value for the ray propagated through the scene, the ray divergence value being calculated based on one or more material properties of the at least one surface; defining, by the computer, a filter using both the calculated ray spread value and the calculated ray divergence value; and rendering, by the computer, the scene using the filter.
    Type: Grant
    Filed: March 23, 2016
    Date of Patent: July 17, 2018
    Assignee: Autodesk, Inc.
    Inventor: Adam Arbree
  • Patent number: 10026142
    Abstract: A mechanism is described for facilitating multi-level nesting of batch buffers at computing devices. A method of embodiments, as described herein, includes facilitating a hardware extension to accommodate a plurality of batch buffers to engage in a multi-level nesting, where the plurality of batch buffers are associated with a graphics processor of a computing device. The method may further include facilitating the multi-level nesting of the plurality of batch buffers, where the multi-level nesting is spread over a plurality of levels associated with the plurality of batch buffers, where the plurality of levels include more than two levels of nesting associated with more than two batch buffers of the plurality of batch buffers.
    Type: Grant
    Filed: April 14, 2015
    Date of Patent: July 17, 2018
    Inventors: Hema Chand Nalluri, Balaji Vembu, Jeffery S. Boles
  • Patent number: 10002451
    Abstract: A method, which is performed by an electronic device, for resizing an image having text is disclosed. The method may include determining layout information of at least one text region in the image. The layout information may include at least one of a number, a size, a location, a shape, or a text density of the at least one text region in the image. The method may also select a seam carving operation, a cropping operation, or a scaling operation for the image based on the layout information, a size of the image, and a target image size. The selected operation may be performed to resize the image to the target image size based at least on one of the layout information, the size of the image, or the target image size. The resized image may include the at least one text region.
    Type: Grant
    Filed: January 15, 2015
    Date of Patent: June 19, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Seungwoo Yoo, Hee-Seok Lee, Jihoon Kim
  • Patent number: 9996964
    Abstract: An apparatus for generating cartoon content includes a cut input controller configured to control inputting of a signal of adding a cut comprising one or more layers; an effect input controller configured to control inputting of a plurality of effects applied to a first layer among the one or more layers and receiving of property information such that directing of the plurality of effects interact with each other; and a cut generator configured to determine at least one of a directing start time, a directing end time, and a directing speed of the plurality of effects such that the plurality of effects interact with each other and are displayed, and generate a first final cut such that the plurality of effects are expressed according to the property information, wherein the effect input controller enters an input that sets the property information of the plurality of effects to be synchronized with the plurality of effects, and wherein the cut generator generates the first final cut such that a directing start
    Type: Grant
    Filed: January 14, 2016
    Date of Patent: June 12, 2018
    Assignee: NAVER Corporation
    Inventors: Hyo Kim, Hyun Chul Lee, Ji Han Kim, Dai Hyun Lim, Byoung Kwan Kim
  • Patent number: 9996949
    Abstract: Views of a virtual space may be presented based on predicted colors of individual pixels of individual frame images that depict the views of the virtual space. Predictive models may be assigned to individual pixels that predict individual pixel colors of individual pixels at individual time points. Individual models may be updated and/or reprojected to other pixels based on comparisons of the predicted pixel colors and colors specified by in a raster input signal.
    Type: Grant
    Filed: October 21, 2016
    Date of Patent: June 12, 2018
    Assignee: Disney Enterprises, Inc.
    Inventors: Kenneth J. Mitchell, Charalampos Koniaris, Jose Antonio Iglesias-Guitian, Bochang Moon, Eric Smolikowski
  • Patent number: 9987553
    Abstract: A virtual world processing apparatus and method. Sensed information, which is information collected by a sensor is inputted. The sensed information is adapted, based on a sensor capability, which is information on capability of the sensor. Accordingly, interoperability between a real world and a virtual world or interoperability between virtual worlds may be achieved.
    Type: Grant
    Filed: February 10, 2017
    Date of Patent: June 5, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Seung Ju Han, Jae Joon Han, Do Kyoon Kim, Won Chul Bang
  • Patent number: 9947139
    Abstract: A method for generating a hybrid reality environment includes receiving data of a first user and a second user at different locations. The method also includes generating a scene of an augmented reality (AR) based environment that includes the first user and a virtual object related to the second user; and generating a scene of an augmented virtuality (AV) based environment that includes the virtual object related to the second user and a virtual object related to the first user. The method further includes sending signals for displaying the scene of the AR based environment to the first user and displaying the scene of the AV based environment to the second user such that the first user can interact with the virtual object related to the second user in real time and the second user can interact with the virtual object related to the first user in real time.
    Type: Grant
    Filed: June 19, 2015
    Date of Patent: April 17, 2018
    Assignee: Sony Interactive Entertainment America LLC
    Inventor: Taizo Yasutake
  • Patent number: 9940727
    Abstract: The present disclosure describes systems and techniques relating to generating three dimensional (3D) models from range sensor data. According to an aspect, frames of range scan data captured using one or more three dimensional (3D) sensors are obtained, where the frames correspond to different views of an object or scene; point clouds for the frames are registered with each other by maximizing coherence of projected occluding boundaries of the object or scene within the frames using an optimization algorithm with a cost function that computes pairwise or global contour correspondences; and the registered point clouds are provided for use in 3D modeling of the object or scene. Further, the cost function, which maximizing contour coherence, can be used with more than two point clouds for more than two frames at a time in a global optimization framework.
    Type: Grant
    Filed: June 19, 2015
    Date of Patent: April 10, 2018
    Assignee: University of Southern California
    Inventors: Gerard Guy Medioni, Ruizhe Wang, Jongmoo Choi
  • Patent number: 9940757
    Abstract: A portion of a simulated element of a graphical simulation available for modification is identified in view of a cursor location associated with a user input device. The identified portion of the simulated element is selected for modification. The selected portion of the simulated element is then modified according to a direct manipulation of a display of the selected portion of the simulated element by a user using the user input device.
    Type: Grant
    Filed: March 31, 2015
    Date of Patent: April 10, 2018
    Inventors: Srikumar M. B. Nair, Steven Ray Rheinfrank, Glenn Shayn Song, Pawel Piotr Wrotek
  • Patent number: 9916682
    Abstract: The power consumption of processor-based devices may be reduced by reducing the consumption of power during graphics processing. In some embodiments, the precision of pixel shading in parts of images where artifacts are less objectionable may be reduced. For example, in areas the user is not directly looking at, precision may be reduced to save power. At the same time, because a person is not focusing on those regions, even if usually perceptible artifacts occur because of the reduced precision, an overall pleasing depiction may be achieved.
    Type: Grant
    Filed: October 28, 2015
    Date of Patent: March 13, 2018
    Assignee: Intel Corporation
    Inventors: Rahul P. Sathe, Bimal Poddar, Jon N. Hasselgren
  • Patent number: 9916680
    Abstract: Techniques are disclosed for suppressing access to a depth processing unit associated with a graphics processing pipeline. The method includes receiving a graphics primitive from a first pipeline stage associated with the graphics processing pipeline. The method further includes determining that the graphics primitive is visible over one or more graphics primitives previously rendered to a frame buffer, and determining that the depth buffer is in a read-only mode. The method further includes suppressing an operation to transmit the graphics primitive to the depth processing unit. One advantage of the disclosed technique is that power consumption is reduced within the GPU by avoiding unnecessary accesses to the depth processing unit.
    Type: Grant
    Filed: October 12, 2012
    Date of Patent: March 13, 2018
    Inventors: Christian Amsinck, Christian Rouet, Tony Louca
  • Patent number: 9910831
    Abstract: A display apparatus and a method for providing a font effect thereof are provided. The method includes obtaining character information and font information of a character; determining an attribute value of a font effect according to at least one of characteristics of the character and characteristics of the display apparatus; rendering the font effect based on the determined attribute value and applying the rendered font effect to the character; and outputting the character to which the font effect is applied.
    Type: Grant
    Filed: September 16, 2014
    Date of Patent: March 6, 2018
    Inventors: Kyu-hun Jung, Bong-je Cho, Sang-Beom Cho, Han-sol Kim
  • Patent number: 9905032
    Abstract: In scenarios involving the capturing of an environment, it may be desirable to remove temporary objects (e.g., vehicles depicted in captured images of a street) in furtherance of individual privacy and/or an unobstructed rendering of the environment. However, techniques involving the evaluation of visual images to identify and remove objects may be imprecise, e.g., failing to identify and remove some objects while incorrectly omitting portions of the images that do not depict such objects. However, such capturing scenarios often involve capturing a lidar point cloud, which may identify the presence and shapes of objects with higher precision. The lidar data may also enable a movement classification of respective objects differentiating moving and stationary objects, which may facilitate an accurate removal of the objects from the rendering of the environment (e.g., identifying the object in a first image may guide the identification of the object in sequentially adjacent images).
    Type: Grant
    Filed: December 19, 2016
    Date of Patent: February 27, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Aaron Matthew Rogan, Benjamin James Kadlec
  • Patent number: 9898841
    Abstract: A method for operating a computing system is provided. The method includes at a local computing device and while an ink input is occurring, rendering a local uncommitted ink stroke on a local display based on the ink input and sending uncommitted ink data corresponding to the uncommitted ink stroke to a remote computing device, the uncommitted ink data including an uncommitted ink stroke path and a global unique identifier differentiating the uncommitted ink data from other uncommitted ink data corresponding to different computing devices and ink inputs. The method further includes responsive to receiving an ink stroke commitment input, rendering a local committed ink stroke on the local display and sending committed ink data including an ink commitment command and the global unique identifier associated with the uncommitted ink stroke path to the remote computing device.
    Type: Grant
    Filed: October 1, 2015
    Date of Patent: February 20, 2018
    Inventors: Xiao Tu, Walker Duhon, Jason Hartman
  • Patent number: 9892715
    Abstract: An apparatus includes a housing and a fixing mechanism configured to attach the housing to an object. The housing includes a display device and at least one processor configured to receive measurement data in a measurement mode during a physical exercise, to process the received measurement data, thus generating exercise data characterizing the exercise, and to display the exercise data through the display device during the physical exercise. The display device is configured to provide a plurality of display view orientations associated with different rotation angles between a first display view orientation, defined by attachment of the fixing mechanism to the object, and a 90-degree rotation from the first display view orientation. At least one function of the processor is associated with the rotation of the display view.
    Type: Grant
    Filed: June 26, 2015
    Date of Patent: February 13, 2018
    Assignee: POLAR ELECTRO OY
    Inventors: Olli Komulainen, Lauri Lumme
  • Patent number: 9839409
    Abstract: Provided is an image processing apparatus for fitting a model to image data. The image processing apparatus determines a final parameter set and a final inlier scale of a first model by iteratively performing a model estimation process and an inlier scale estimation process, wherein the model estimation process determines a model parameter set, and the inlier scale estimation process determines an inlier scale by using the determined model parameter set.
    Type: Grant
    Filed: November 21, 2014
    Date of Patent: December 12, 2017
    Inventors: Kwang-hee Lee, Jae-moon Jo
  • Patent number: 9837053
    Abstract: A display method includes steps of: receiving, by the controller, a first frame and a second frame from an input data; up-converting, by the controller, a frame rate of the input data to produce a third frame based on the first frame and the second frame; identifying, by the controller, a static image content of the third frame according to a comparison of the first frame and the second frame; controlling, by the controller, the driver circuit not to update data of pixels within a static display area of the display panel corresponding to the static image content during the period of time that the third frame is displayed by the display panel.
    Type: Grant
    Filed: June 7, 2016
    Date of Patent: December 5, 2017
    Inventors: Jhih-Siou Cheng, Po-Hsiang Fang
  • Patent number: 9836871
    Abstract: A method for creating a plane panorama from point cloud data using Hough transformations is disclosed. The method involves converting the three-dimensional point cloud into a two-dimensional histogram with bins grouping neighboring points, and performing a Hough transformation on the histogram. The resulting transformed data is segmented and the method searches the segments iteratively for a major line, followed by lines that are orthogonal, diagonal, or parallel to the major line, and discards outlying data in each bin as lines are identified. The detected lines are connected to form planes, and the planes are assembled into a hole- and gap-filled panorama. The method may also use an algorithm such as a Random Sample Consensus (RANSAC) algorithm to detect a ground plane.
    Type: Grant
    Filed: July 30, 2013
    Date of Patent: December 5, 2017
    Assignee: HERE Global B.V.
    Inventor: Jaechoon Chon
  • Patent number: 9824496
    Abstract: In an information display system, an information apparatus includes a target information storage section that stores target information to be published by the information apparatus and an extraction section that extracts the target information from the target information storage section on the basis of user information that is information regarding a user of a head mounted display device, and the head mounted display device includes an information generating section that generates information for additional presentation for providing the augmented reality to the user using the target information acquired from the information apparatus and an image display section that enables the user to view the generated information for additional presentation as a virtual image.
    Type: Grant
    Filed: February 20, 2014
    Date of Patent: November 21, 2017
    Assignee: Seiko Epson Corporation
    Inventor: Fusashi Kimura