With Electronic Viewfinder Or Display Monitor Patents (Class 348/333.01)
  • Patent number: 11367199
    Abstract: Systems and methods provide editing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. An eye-gaze network may produce a hotspot map of predicted focal points in a video frame. These predicted focal points may then be used by a gaze-to-mask network to determine objects in the image and generate an object mask for each of the detected objects. This process may then be repeated to effectively track the trajectory of objects and object focal points in videos. Based on the determined trajectory of an object in a video clip and editing parameters, the editing engine may produce editing effects relative to an object for the video clip.
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: June 21, 2022
    Assignee: Adobe Inc.
    Inventors: Lu Zhang, Jianming Zhang, Zhe Lin, Radomir Mech
  • Patent number: 11350042
    Abstract: Image capture devices and methods may use field variable tone mapping for 360 content. An image capture device may comprise an image sensor and a processor. The image sensor may capture a hyper-hemispherical image that includes an image circle portion and a dark corner portion. The processor may perform local tone mapping (LTM) on a first area of the image circle portion and perform global tone mapping (GTM) on a second area of pixels of the image circle portion. The GTM may be performed on a condition that a portion of a predefined area of pixels overlaps with a stitch line. The processor may be configured to stitch the hyper-hemispherical image and a second hyper-hemispherical image at the stitch line to obtain a processed image. The processor may be configured to display, store, output, or transmit the processed image.
    Type: Grant
    Filed: April 8, 2020
    Date of Patent: May 31, 2022
    Assignee: GoPro, Inc.
    Inventors: Guillaume Matthieu Guérin, Julien Caron
  • Patent number: 11343440
    Abstract: A method includes capturing, by a camera disposed behind a display panel of an electronic device, a plurality of point spread functions (PSFs) through a semi-transparent pixel region of the display panel. Each of the plurality of PSFs is captured at a different exposure time. The method further includes determining, for each of the PSFs, pixel intensity data for each of a plurality of pixel locations of the PSF. The pixel intensity data is associated with the exposure time of the respective PSF. The method further includes calculating, for each pixel location, a weighted average pixel intensity value based on the pixel intensity data and the exposure time for the respective pixel location over the plurality of PSFs, and generating a high dynamic range (HDR) PSF utilizing the weighted average pixel intensity values.
    Type: Grant
    Filed: February 5, 2021
    Date of Patent: May 24, 2022
    Assignee: SAMSUNG ELECTRONICS COMPANY, LTD.
    Inventors: Ye Zhao, Changgeng Liu, Ernest Rehmatulla Post, Brian R. Patton, Congzhong Guo
  • Patent number: 11340504
    Abstract: A display panel is provided and includes an array substrate and a display region disposed on a surface of the array substrate, wherein a portion of the array substrate not covered by the display region forms a bezel, and a driving chip and a flexible circuit board are bound in the bezel; wherein at least one a protrusion is formed at an end of the bezel away from the display region, the driving chip is located between an edge of the protrusion and an edge of the display region; and a portion of the flexible circuit board is bent to a back of the array substrate via an edge of an indent on at least one lateral side of the protrusion.
    Type: Grant
    Filed: November 15, 2019
    Date of Patent: May 24, 2022
    Assignee: Wuhan China Star Optoelectronics Technology Co., Ltd.
    Inventors: Yantao Lu, Guanghui Liu, Chao Wang, Jiakuai Bian
  • Patent number: 11317011
    Abstract: Provided are a terminal device and an apparatus. The terminal device includes: a cover plate having a transparent middle area and an opaque light shielding area at least partially surrounding the middle area, the light shielding area having a light transmitting hole. The terminal device includes a display panel disposed next to the cover plate. The terminal device includes a camera, where a first projection of the camera onto the cover plate is at least partially located within a second projection of the display panel onto the cover plate. The terminal device also includes a light transmitting element having a first and second ends, where the first end is connected to a lens of the camera, and the second end is opposite to the light transmitting hole. The light transmitting element is configured to transmit light from an external object to the lens of the camera.
    Type: Grant
    Filed: April 22, 2020
    Date of Patent: April 26, 2022
    Assignee: Beijing Xiaomi Mobile Software Co., Ltd.
    Inventor: Xiankun Hu
  • Patent number: 11301051
    Abstract: A mobile device, such as a smart phone, is provided with a camera. Digital content displayed on display screen of the mobile device may be manipulated in response to natural movements of the mobile device by a user. Motion of the mobile device is detected relative to a nearby textured surface by analyzing images of the textured surface. The displayed digital content is manipulated in response to the detected motion of the mobile device.
    Type: Grant
    Filed: November 3, 2020
    Date of Patent: April 12, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventor: Vinay Sharma
  • Patent number: 11297221
    Abstract: An image-capturing apparatus includes: an image sensor having a first image-capturing region and a second image-capturing region different from the first image-capturing region; and a control unit that displays an image generated by the first image-capturing region and an image generated by the second image-capturing region on a display unit, with a region targeted for setting image-capturing conditions of the image sensor being selectable.
    Type: Grant
    Filed: March 27, 2019
    Date of Patent: April 5, 2022
    Assignee: NIKON CORPORATION
    Inventors: Satoshi Tsuchiya, Yuuki Asano, Shuhei Yoshikawa, Aiko Namikawa
  • Patent number: 11249279
    Abstract: An imaging apparatus includes: a focus lens driving section; an imaging section; and a focus detecting section. The focus lens driving section moves a position of a focus lens from one of an image side and an object side to the other over a predetermined driving period. The imaging section generates image data by starting exposure for a plurality of lines simultaneously and then by ending the exposure for the plurality of lines simultaneously within the predetermined driving period. The focus detecting section detects an in-focus position of the focus lens on a basis of contrast of the image data.
    Type: Grant
    Filed: November 9, 2016
    Date of Patent: February 15, 2022
    Assignee: Sony Group Corporation
    Inventor: Hiroshi Sumihiro
  • Patent number: 11250281
    Abstract: A method for enhanced liveness detection of facial image data is provided that includes capturing movement data of an electronic device while capturing, using the electronic device, facial image data of a user. In response to determining the captured movement data is consistent with movement data expected to be captured during capture of facial image data, the method includes deciding the captured facial image data is genuine. In response to determining the captured movement data is different than movement data expected to be generated during capture of facial image data, the method includes deciding the captured facial image data is fraudulent.
    Type: Grant
    Filed: October 21, 2020
    Date of Patent: February 15, 2022
    Assignee: DAON ENTERPRISES LIMITED
    Inventor: Adria Perez-Rovira
  • Patent number: 11233923
    Abstract: One embodiment provides a method, comprising: receiving, at an information handling device, an indication to activate a camera positioned underneath a display portion of the information handling device; identifying, using a processor, a location of at least one pixel on the display portion positioned overtop the camera; disabling, based on the identifying, the at least one pixel; performing, subsequent to the disabling and using the camera, a function; and enabling, responsive to identifying that the function was performed, the at least one pixel. Other aspects are described and claimed.
    Type: Grant
    Filed: March 27, 2019
    Date of Patent: January 25, 2022
    Assignee: Lenovo (Singapore) Pte. Ltd.
    Inventors: John Weldon Nicholson, Daryl Cromer, Howard Locker
  • Patent number: 11221542
    Abstract: An electronic device includes a first housing, a second housing, an accommodating space and a lens module. The second housing is connected to the first housing and includes an arc edge. The accommodating space is formed between the first housing and the second housing and includes an arc area having a position corresponding to the arc edge. The lens module is located in the accommodating space, matches the shape of the accommodating space, and includes a bottom case, a side case, a top case, an internal space and a photography unit. The side case is connected to the bottom case and includes an inclined surface area which is provided in the arc area. The top case is connected to the side case and includes a top opening.
    Type: Grant
    Filed: January 9, 2020
    Date of Patent: January 11, 2022
    Assignee: CHICONY ELECTRONICS CO., LTD.
    Inventors: San-Pen Yang, Cheng-Hun Yang
  • Patent number: 11210828
    Abstract: An electronic device according to one embodiment of the disclosure includes a display, a memory that stores an application for editing an image, and a processor that outputs the image through the application onto the display. The processor may be configured to output, on the display, the image, a first guide indicating an area to be cropped in the image, and a preview corresponding to the first guide in a first mode of the application. The processor may output, on the display, an image changed in accordance with a second mode in response to a user input to change a mode from the first mode to the second mode. The processor may output a second guide corresponding to the second mode on the display such that the preview corresponding to the first guide is output. In addition, various embodiments understood through the specification are possible.
    Type: Grant
    Filed: October 27, 2017
    Date of Patent: December 28, 2021
    Inventors: Mi Ji Park, Jae Han Lee, Ho Young Lee
  • Patent number: 11212594
    Abstract: Provided is a server device that is capable of making it easy to attach comments to videos while reflecting the individuality of various users. A center server, when a user terminal is connected, delivers video data according to a request by the user terminal. The center server also specifies a stamp selected by each user among a plurality of stamps that have been prepared in advance, and, on the basis of symbol data for managing symbols that are separately set for users in order to visually identify each user, specifies the symbol of the user who has selected the stamp. The center server, when a request is made for delivery the video data, provides the user terminal with information about the stamp and the symbol so that a comment icon in which the selected stamp and the symbol of the user are combined is attached to the video.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: December 28, 2021
    Assignee: KONAMI DIGITAL ENTERTAINMENT CO., LTD.
    Inventor: Eiri Mikoshiba
  • Patent number: 11211433
    Abstract: Cameras are located within the display area of a display. In-display cameras allow for thinner display bezels. In-display cameras allow for the creation of ultra-high resolution images. The ability to capture an object from multiple perspectives allows for holographic image recording and playback. Multiple views of an image can be captured with varying depths of focus, allowing an image's depth of field to be adjusted during post processing. In-display cameras can also be used for user authentication, touch detection and three-dimensional gesture recognition. Thermal sensors located within the display area allow for control of the display temperature, improved control over system performance, and compensation for micro-LED degradation that can occur due to aging or increased temperature. Microlens assemblies located above pixels can adjust the viewing cone angle of the display or a portion of the display and microassemblies located under individual pixels or pixel arrays can adjust a viewing angle.
    Type: Grant
    Filed: May 4, 2020
    Date of Patent: December 28, 2021
    Assignee: Intel Corporation
    Inventors: Ramon C. Cancel Olmo, Evrim Binboga, Vivek Paranjape, Satish Prathaban, Shantanu D. Kulkarni, Kunjal S. Parikh, Siddhartha Saxena
  • Patent number: 11212428
    Abstract: An image-capturing apparatus includes a main body and a finder unit configured to transition between a retracted state and a projected state. The finder unit includes a non-rotatable portion provided with a rotation shaft, a rotatable portion that is rotatable around the rotation shaft and has an eyepiece, and a restricting member that restricts a transition from a pulled-out state to the retracted state, the eyepiece has an engaging portion and the restricting member has an engaged portion having a convex shape, the engaging portion and the engaged portion being engaged with each other in a transition between the projected state and the retracted state, and an engagement between the engaging portion and the engaged portion is released when the rotatable portion is rotated in the pulled-out state.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: December 28, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Ryoji Okuno, Hidetoshi Kei, Shingo Iwatani, Keita Iwai
  • Patent number: 11190697
    Abstract: There is provided a camera apparatus, including circuitry configured to: output a first image signal for displaying a first image, output a second image signal for displaying a second image. The second image signal is an image signal transmitted as a return signal. Further, the second image is an image that includes one of a location of a focus adjustment in the first image and an enlarged image corresponding to a part of the first image.
    Type: Grant
    Filed: April 10, 2020
    Date of Patent: November 30, 2021
    Assignee: SONY CORPORATION
    Inventor: Yuuji Ooba
  • Patent number: 11178298
    Abstract: An information processing apparatus includes first and second switching units. The first switching unit switches, when a first icon displayed on a screen is selected, the first icon to a second icon on the screen. The first icon is used for executing a first function. The second icon is used for executing a second function different from the first function. The second switching unit switches the second icon to a third icon on the screen in accordance with a state of a device. The third icon is used for executing a third function.
    Type: Grant
    Filed: January 30, 2020
    Date of Patent: November 16, 2021
    Assignee: FUJIFILM Business Innovation Corp.
    Inventor: Jun Nagumo
  • Patent number: 11153520
    Abstract: Disclosed is an electronic device including a display configured to display a screen, a display driver circuit configured to receive video information to control the display to display the screen, a module comprising at least one of a camera or a sensor disposed in a first region of the display, and at least one processor operatively connected with the display driver circuit and the module, wherein the at least one processor or the display driver circuit is configured to control the electronic device to compensate for, based on a change in an image of the first region of the screen or a pixel value of the first region, the image displayed in the first region.
    Type: Grant
    Filed: October 7, 2019
    Date of Patent: October 19, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Minyoung Park, Giwook Kim, Bona Lee, Jiwon Lee, Kwangtai Kim, Hochul Hwang
  • Patent number: 11146724
    Abstract: An electronic apparatus and a method by which the electronic apparatus provides recommendation information related to photography are provided. The method includes identifying a subject included in a preview image recognized by a first camera, obtaining information of the identified subject, obtaining information related to light in surroundings of the identified subject, determining a recommended photographing composition based on the information of the identified subject and the information related to the light in the surroundings of the subject, and providing information about the determined recommended photographing composition.
    Type: Grant
    Filed: October 16, 2018
    Date of Patent: October 12, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Jae-ho Jung, Yeul-tak Sung
  • Patent number: 11128802
    Abstract: A photographing method and a mobile terminal are provided, which are related to communication technologies. The photographing method includes: receiving a photographing function start instruction; displaying, on the first display screen and the second display screen respectively in a full screen display manner, a preview image acquired by the rear camera; displaying, on the second display screen, pre-stored composition reference information; determining target composition information in the composition reference information; and controlling the rear camera to perform a photographing operation, based on the target composition information.
    Type: Grant
    Filed: July 25, 2018
    Date of Patent: September 21, 2021
    Assignee: VIVO MOBILE COMMUNICATION CO., LTD.
    Inventor: Guilin Peng
  • Patent number: 11122214
    Abstract: An image capture device includes a light source, an image capture circuit, and a processor. The light source is used for generating emitting light. The image capture circuit is used for capturing an image corresponding to the emitting light. The processor is coupled to the light source and the image capture circuit for optionally adjusting the intensity of the emitting light of the light source according to luminance corresponding to the image and a target value.
    Type: Grant
    Filed: July 26, 2018
    Date of Patent: September 14, 2021
    Assignee: eYs3D Microelectronics, Co.
    Inventor: Chi-Feng Lee
  • Patent number: 11119396
    Abstract: Active areas of image sensors are determined by one or more parameters defining a mergeline or memory addresses where image data is stored. Image data generated by active areas of different image sensors are combined to create a panoramic image. Image distortion is detected in image data generated by an active area of an image sensor. Distortion in image data is addressed by configured image processing instructions. A dedicated image processor is assigned to at least each image sensor. At least one set of instructions assures that connecting image data generated by different image sensors is smoothed and/or blended to create a combined image with a substantially seamless transition between areas.
    Type: Grant
    Filed: March 10, 2020
    Date of Patent: September 14, 2021
    Assignee: Spatial Cam LLC
    Inventor: Peter Lablans
  • Patent number: 11114032
    Abstract: The present disclosure relates to a display structure, a display panel, and a display device. The display structure includes: a plurality of pixels and a plurality of first driving circuits. The plurality of pixels are provided in a first area of the display structure. The plurality of pixels are arranged based on a preset pattern. An area of the preset pattern is less than that of the first area. Each pixel includes sub-pixels of a plurality of colors, and each sub-pixel includes an organic light emitting diode. The plurality of first driving circuits are provided in a second area outside the first area, connected to the organic light emitting diodes, and configured to drive the organic light emitting diodes to emit light.
    Type: Grant
    Filed: August 28, 2019
    Date of Patent: September 7, 2021
    Assignee: Beijing Xiaomi Mobile Software Co., Ltd.
    Inventor: Qingfang Bian
  • Patent number: 11108955
    Abstract: Disclosed in the present disclosure are a mobile terminal-based dual camera power supply control method and system, and a mobile terminal. The method comprises: when it is detected that a user operational instruction or other applications start a camera, determining whether the current condition is a specific using condition; if yes, starting supplying power to a camera corresponding to a camera serial number and turning on i the camera; and if no, starting supplying power to a camera corresponding to a default camera serial number and turning on the camera.
    Type: Grant
    Filed: March 16, 2018
    Date of Patent: August 31, 2021
    Assignee: TCL COMMUNICATIONS (NINGBO) CO., LTD.
    Inventors: Bin Yu, Weiqin Yang
  • Patent number: 11100893
    Abstract: The present invention discloses an eye protection method and system for an intelligent terminal, which uses a light sensor to acquire ambient light, uses a distance sensor to acquire a distance between a user's eyes and a screen of the intelligent terminal, uses a camera to identify a user identity, and uses eye protection software to monitor display content and perform data analysis, thereby achieving automatic adjustment of screen brightness, automatic adjustment of screen color temperature, adjustment of display mode, automatic restriction of use time, switching to basic communication function, and so on. The present invention intelligently adjusts the eye protection threshold, improves the practicability and effectiveness of the eye protection method, and improves the experience effect of the user's eye protection function.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: August 24, 2021
    Assignee: Chinese Academy of Medical Sciences & Peking Union Medical College, Institute of Biomedical Engineering
    Inventors: Yingxin Li, He Huang, Huijuan Yin, Xiaoxi Dong
  • Patent number: 11094772
    Abstract: The present disclosure provides a display panel having sub-pixels that include light-emitting sub-pixels and compensation sub-pixels located in a first display area. A density of sub-pixels in a first semi-transmissive area and in a second semi-transmissive area is smaller than a density of sub-pixels in a second display area. The first display area, the first semi-transmissive area, and the second semi-transmissive area have a same density of light-emitting sub-pixels. First pixel columns are provided in the first display area. Second pixel columns are provided in the second display area. A first data line passes through the first pixel column, and a second data line passes through the second pixel column.
    Type: Grant
    Filed: December 27, 2019
    Date of Patent: August 17, 2021
    Assignee: WuHan TianMa Micro-electronics CO., LTD.
    Inventors: Yangzhao Ma, Ruiyuan Zhou, Yingjie Chen
  • Patent number: 11095822
    Abstract: Systems and methods for previewing newly captured image content and reviewing previously stored image content using an electronic device are provided. The previously stored image content may include an individual distinct image or at least two consecutive video frame images.
    Type: Grant
    Filed: December 6, 2019
    Date of Patent: August 17, 2021
    Assignee: APPLE INC.
    Inventors: Michael Matas, Mallory Paine
  • Patent number: 11095821
    Abstract: An imaging apparatus includes an imaging optical system, an imaging element acquiring an image of an object, a unit that acquires distance information corresponding to distance between the imaging optical system and the object, a unit that generates a map information corresponding to the image based on the distance information, a unit that is able to detect touch operation of a user on a display unit displaying the image and that detects a position in the image corresponding to a position touched by the user, and a control unit configured to acquire the distance information at the position of the acquired image from the map information to set the position as a focus point according to the acquired distance information, or configured to display, on the display unit, an enlarged image obtained by cutting an area of part of the image including the position.
    Type: Grant
    Filed: November 1, 2017
    Date of Patent: August 17, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Tatsushi Katayama
  • Patent number: 11094290
    Abstract: A screen includes a main body display module and multiple auxiliary display units. By dividing a lighting functional coordination area of a main body display module into a lighting sub-area and a coordination sub-area out of the lighting sub-area, and arranging auxiliary display units in the coordination sub-area, the light transmission of the lighting sub-area is no longer interfered by the peripheral auxiliary display units, and thus the lighting effect is improved. In addition, the display effect of the auxiliary display units disposed in the coordination sub-area in a working state can be matched with a display content of a main display area, so that the influence of the lighting functional coordination area on the overall display effect of a screen is reduced.
    Type: Grant
    Filed: January 12, 2020
    Date of Patent: August 17, 2021
    Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
    Inventors: Jing Gao, Zhidong Yin
  • Patent number: 11082609
    Abstract: Disclosed herein is a user device for facilitating the controlled operation of a camera. Further, the user device may include at least one sensor, at least one camera, a processing device, a presentation device, and an input device. Further, the at least one sensor may be configured for generating at least one sensor data associated with the user device. Further, the at least one camera may be configured to generate at least one image. Further, the processing device may be communicatively coupled with the at least one sensor and the at least one camera. Further, the presentation device communicatively coupled with the processing device. Further, the input device communicatively coupled with the processing device. Further, the input device may be configured for receiving at least one input data from a user associated with the user device.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: August 3, 2021
    Inventor: Joseph Garff
  • Patent number: 11070742
    Abstract: A processor of a camera for capturing a time-lapse is configured to acquire a first frame of the time-lapse; calculate an exposure setting for a second frame of the time-lapse; and acquire the second frame of the time-lapse using the exposure setting. The exposure setting prevents a flickering effect in the time-lapse. The exposure setting is determined using one or more preview images that are previewed in a time gap between the first frame and the second frame.
    Type: Grant
    Filed: August 5, 2020
    Date of Patent: July 20, 2021
    Assignee: GoPro, Inc.
    Inventors: Nicolas Bessou, Romain Gounelle
  • Patent number: 11060864
    Abstract: A controller obtains a distance index associated with first and second cameras and a camera distance between the first and second cameras. The controller receives a first and second image captured by the first and second cameras, respectively. The first and second images include a first and second object image of an object, respectively. The controller calculates a first object distance between the first camera and the object using a distance index associated with the first and second cameras, the camera distance, the first object image, and the second object image. The controller calculates an object real size of the object using the first object distance, the second object image, the camera distance, and the distance index. The controller determines whether policy criteria are satisfied by the first object distance and/or the object real size. When satisfied, the controller performs an action associated with the criteria.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: July 13, 2021
    Assignee: TP Lab, Inc.
    Inventor: Chi Fai Ho
  • Patent number: 11039099
    Abstract: An increase in memory capacity is suppressed in a solid-state imaging element that performs correlated double sampling processing. A pixel circuit sequentially generates each of a predetermined reset level and a plurality of signal levels corresponding to the exposure amount. An analog-to-digital converter converts a predetermined reset level into digital data and outputs the data as reset data, converts each of the plurality of pieces of signal data into digital data, and outputs the data as signal data. An arithmetic circuit holds a difference between the reset data and the signal data output first, as held data in a memory, and then adds the held data and the signal data output second and subsequent times together and causes the memory to hold the added data as new held data.
    Type: Grant
    Filed: October 10, 2017
    Date of Patent: June 15, 2021
    Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
    Inventors: Masaki Sakakibara, Yorito Sakano, Satoko Iida
  • Patent number: 11030459
    Abstract: Methods and apparatus for projecting augmented reality (AR) enhancements to real objects in response to user gestures detected in a real environment are disclosed. An example apparatus includes an object detector, a gesture detector, and an enhancement determiner. The object detector is to detect one or more real objects located in a real environment based on depth data obtained from a sensor array located within the real environment. The gesture detector is to detect a user gesture within the real environment based on motion data obtained from the sensor array, the user gesture being associated with a target real object from among the one or more real objects. The enhancement determiner is to determine an AR enhancement based on the user gesture and the target real object. The enhancement determiner is to instruct a projector to project the AR enhancement to the target real object.
    Type: Grant
    Filed: June 27, 2019
    Date of Patent: June 8, 2021
    Assignee: INTEL CORPORATION
    Inventors: Ankur Agrawal, Glen J. Anderson, Benjamin Bair, Rebecca Chierichetti, Pete Denman
  • Patent number: 11030973
    Abstract: Systems, devices, and methods for detecting ambient light with wearable heads-up displays are described. An ambient light sensor can be positioned close to a user's eye area on a user-side of a wearable heads-up display. By positioning the ambient light sensor on a user-side of the wearable heads up display, the ambient light sensor can be in a position and/or orientation which receives ambient light in a similar manner a user's eye, and thus ambient light detection can be more accurate. Brightness of display light output by the wearable heads-up display can be adjusted in response to the detected brightness of ambient light.
    Type: Grant
    Filed: September 12, 2019
    Date of Patent: June 8, 2021
    Assignee: Google LLC
    Inventors: Joshua Moore, Lloyd Frederick Holland, Jonathan Blake Huras, Charles Eiric Johnstone, Jiwon Yang, Victor Emile Isbrucker
  • Patent number: 11032467
    Abstract: The present invention relates to a mobile terminal having a plurality of cameras and a video image capturing control method thereof. The mobile terminal according to an embodiment of the present invention comprises: a memory; a display unit; a first camera for acquiring a first image corresponding to a preview image being displayed on the display unit; a second camera for detecting an object in the preview image by the first camera, and acquiring a second image for the detected object; and a control unit for controlling the first camera to respond to a signal for acquiring the first image, and the second camera to acquire the second image together.
    Type: Grant
    Filed: February 20, 2017
    Date of Patent: June 8, 2021
    Assignee: LG ELECTRONICS INC.
    Inventor: Jungki Kim
  • Patent number: 11017573
    Abstract: An information processing device includes a selection unit and an embedding unit. The selection unit selects, in a case where a moving image obtained by photographing plural targets that are present in front of a display screen of a display device is displayed on the display screen, plural related targets that are related to each other from the plural targets, based on a frame image of the moving image. The embedding unit embeds a composite image obtained based on an image of at least part of the plural related targets and a presentation image into the frame image.
    Type: Grant
    Filed: February 12, 2018
    Date of Patent: May 25, 2021
    Assignee: FUJI XEROX CO., LTD.
    Inventor: Kazuto Hayashi
  • Patent number: 11017706
    Abstract: A display screen and an electronic device are provided. The display screen includes a number of display pixels arranged on a display area of the display screen and a plurality of image capturing pixels arranged in gaps between the plurality of display pixels. The display screen is operable in a display mode or an image capturing mode. The plurality of display pixels is switched on when the display screen is in the display mode and the plurality of image capturing pixels is switched on when the display screen is in the image capturing mode. The display screen integrates display pixels and image capturing pixels, so the display screen may be used for display and image capturing at the same time.
    Type: Grant
    Filed: July 29, 2019
    Date of Patent: May 25, 2021
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventor: Jianqiang Lu
  • Patent number: 11010030
    Abstract: A display controller including: a display control unit configured to, in response to a first case, perform control so that an image is displayed in a display mode among a plurality of display modes wherein the first case is a case where a receiving unit has received a manual focus operation in a first state in which a display item indicating information on focus is not superimposed or displayed on a live-view image captured by an imaging unit and the live-view image is displayed with a first magnification wherein the plurality of display modes include: a first display mode in which the display item is superimposed and displayed on the live-view image without enlarging the live-view image from the first magnification; and a second display mode in which the live-view image is displayed with a second magnification larger than the first magnification.
    Type: Grant
    Filed: January 29, 2019
    Date of Patent: May 18, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Junichi Imamiya
  • Patent number: 10999496
    Abstract: An electronic device is capable of assigning a function selected by a user as a function to be executed in accordance with each of a plurality of operations, and the electronic device includes: a first accepting unit configured to accept a first user operation for selecting any of a plurality of groups obtained by classifying a plurality of assignable functions; a second accepting unit configured to, after any of the plurality of groups is selected, narrow down options to a plurality of assignable functions included in the selected group among all assignable functions excluding functions not included in the selected group, and accept a second user operation for selecting a function to be respectively assigned to the plurality of operations among the options; and an assigning unit configured to assign the function selected by the second user operation to each of the plurality of operations.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: May 4, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Koji Yoshida, Takuro Miyajima, Daiyu Ueno, Ryu Wakui, Eriko Sato, Takeshi Kikkawa
  • Patent number: 10998512
    Abstract: A power saving system using a plurality of flexible display devices placed on various places is provided. A structure of a bendable portion in a display device is improved. Specifically, a wiring partly including a metal nanoparticle is used. Openings are formed in an insulating layer so that the wiring becomes substantially longer by meandering in cross section. When a plurality of openings are formed and aligned, a portion that is easy to bend is formed along the line where they are aligned. A plurality of display panels are used for one display portion. The flexible display portion can be provided on a surface, specifically, a curved surface of furniture such as a chair or a sofa.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: May 4, 2021
    Assignee: Semiconductor Energy Laboratory Co., Ltd.
    Inventor: Hideaki Kuwabara
  • Patent number: 10999514
    Abstract: A digital camera has an electronic image sensor and an electronic viewfinder, which is configured to display images and/or videos acquired by the image sensor. The digital camera additionally has a display screen, which is also configured to display images and/or videos acquired by the image sensor. The display screen, which is independent of the electronic viewfinder and which is bounded by a circumferential border, has a touch-sensitive surface, wherein a touch of the surface is recognizable in the electronic viewfinder. A haptically perceptible structure, which is located inside the circumferential border, is configured such that a finger of a user can orient itself on the structure. The surface of the display screen has two planar sections which are arranged inclined in relation to one another. The haptically perceptible structure is formed as a buckled edge, at which the two sections adjoin one another.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: May 4, 2021
    Assignee: Carl Zeiss AG
    Inventors: Aaron von Fintel, Dominik Meier, Franziska Haas, Alexander Peters, Julia Raith
  • Patent number: 10992853
    Abstract: An image capture control apparatus comprises a touch detector being capable of detecting a touch operation, a tracking unit that tracks a tracking target in a live view image captured by an image capturing unit, and a display control unit that, in response to the touch detector detecting a movement operation of moving a touch position, carries out control to display an indicator at a position, in a display, that is based on a movement amount of the movement operation, and a control unit configured to, in response to a predetermined amount of time elapsing after the touch for making the movement operation has been released, carry out control such that a tracking target determined on the basis of the position of the indicator is tracked by the tracking unit.
    Type: Grant
    Filed: February 25, 2019
    Date of Patent: April 27, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Seiji Ogawa
  • Patent number: 10989989
    Abstract: An image pickup apparatus that can store a display device in an apparatus body and that prevents snap fit connection from releasing in a pulled-out state where the display device is pulled out while keeping ease of assembly in manufacturing. The image pickup apparatus includes a first barrel, a second barrel that is connected to the first barrel and achieves a stored state and the pulled-out state of the display device by relatively moving with respect to the first barrel, and a third barrel that is connected to the second barrel by snap fit connection. The first barrel has a fastening part at its end of connection with the second barrel so that the fastening part suppresses release of the snap fit connection in the pulled-out state and does not suppress the release of the snap fit connection in the stored state.
    Type: Grant
    Filed: January 17, 2020
    Date of Patent: April 27, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Taro Murakami, Kiyoshi Nitto, Nobuyoshi Suzuki
  • Patent number: 10965847
    Abstract: An image observation apparatus includes a first member for fixing an image display unit, a second member for holding an observation optical system and for moving between a retracted position retracted in the first member and a protruded position protruding from the first member in an optical axis direction of the observation optical system, and a guide bar held by the first member and penetrating a guide hole portion provided in the second member in the optical axis direction. The second member has a barrel portion housing the observation optical system, and a projection portion projecting orthogonal to the optical axis direction from the barrel portion, and the projection portion has the guide hole. When the second member is at the retracted position, the projection portion and part of the image display unit overlap each other in the direction orthogonal to the optical axis direction.
    Type: Grant
    Filed: October 2, 2019
    Date of Patent: March 30, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Kiyoshi Nitto
  • Patent number: 10957111
    Abstract: A multiuser, collaborative augmented reality (AR) system employs individual AR devices for viewing real-world anchors, that is, physical models that are recognizable to the camera and image processing module of the AR device. To mitigate ambiguous configurations when used in the collaborative mode, each anchor is registered with a server to ensure that only uniquely recognizable anchors are simultaneously active at a particular location. The system permits collaborative AR to span multiple sites, by associating a portal with an anchor at each site. Using the location of their corresponding AR device as a proxy for their position, AR renditions of the other participating users are provided. This AR system is particularly well suited for games.
    Type: Grant
    Filed: July 2, 2019
    Date of Patent: March 23, 2021
    Inventors: Jordan Kent Weisman, William Gibbens Redmann
  • Patent number: 10957028
    Abstract: An image generation device includes a first reception unit and a control unit. The first reception unit receives travel information about the travel state of a moving body. The control unit sets, based on the travel information, a multiple-exposure region in an imaging region of an image sensor used on the moving body, and generates image data in which the multiple-exposure region in the imaging region is formed through a multiple exposure and a region other than the multiple-exposure region is not formed through the multiple exposure.
    Type: Grant
    Filed: September 12, 2017
    Date of Patent: March 23, 2021
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Osamu Shibata, Hiroshi Iwai, Kazuko Nishimura, Yasuo Miyake, Yoshiaki Satou
  • Patent number: 10958853
    Abstract: A portable apparatus to provide a screen capturing function, when a display unit of the apparatus displays moving pictures on a display panel thereof, includes a button signal input unit to receive a button signal inputted by a user; a picture capturing unit to capture individual pictures of the moving pictures, when the inputted button signal is determined to be a first button signal; a thumbnail creating unit to create thumbnails of the captured pictures, the thumbnails being sequentially arranged on a predetermined portion of the display panel; and a screen recording button located on an exterior of the portable apparatus to generate the first button signal.
    Type: Grant
    Filed: April 9, 2019
    Date of Patent: March 23, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Ji-yeon Kwak
  • Patent number: 10943404
    Abstract: Disclosed is an electronic device including a memory that stores content-related information, a display that outputs a screen associated with the content, a camera module that photographs a surrounding environment of the electronic device, and a processor that is electrically connected to the memory, the display, and the camera module, wherein the processor may activate the camera module based on a change in physical quantity acting on the electronic device in a state where at least a part of a screen area of the display is turned off, and output a first display object associated with an arbitrary object on the display of which the at least a part of the screen area is turned off when information related to the arbitrary object recognized by the activated camera module is present in the memory. Various embodiments understood through the disclosure may be possible.
    Type: Grant
    Filed: December 6, 2017
    Date of Patent: March 9, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yeo Jun Yoon, Ji Yeon Kwak, Ye Rin Park, Hyun Joo Kang, Jae Ik Lee
  • Patent number: RE48876
    Abstract: In embodiments of the invention, an apparatus may include a display comprising a plurality of pixels and a computer system coupled with the display and operable to instruct the display to display images. The apparatus may further include an SLM array located adjacent to the display and comprising a plurality of SLMs, wherein the SLM array is operable to produce a light field by altering light emitted by the display to simulate an object that is in focus to an observer while the display and the SLM array are located within a near-eye range of the observer.
    Type: Grant
    Filed: March 27, 2017
    Date of Patent: January 4, 2022
    Assignee: NVIDIA CORPORATION
    Inventors: David Patrick Luebke, Douglas Lanman, Thomas F. Fox, Gerrit Slavenburg