Patents by Inventor JINGKANG LIU

JINGKANG LIU has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11968449
    Abstract: A camera lens smoothing method includes: obtaining a current video frame of a camera video and gyroscope information of the current video frame, and calculating a current first rotation matrix; conducting smoothing on the first rotation matrix, and calculating a third rotation matrix; conducting viewpoint decomposition on the current video frame according to the third rotation matrix, and calculating a fourth rotation matrix; and conducting 3D rotation on the current video frame according to the fourth rotation matrix, and rebuilding an anti-shake video.
    Type: Grant
    Filed: January 20, 2022
    Date of Patent: April 23, 2024
    Assignee: ARASHI VISION INC.
    Inventors: Cong Chen, Zhuo Guo, Jingkang Liu
  • Patent number: 11955143
    Abstract: Provided are an automatic video editing method and a portable terminal, the method comprising: obtaining a video to be edited; extracting key frames of the video to be edited; inputting the key frames to a pre-trained scene classification method and a pre-trained target detection method, and respectively obtaining scene type markers and target object markers of the key frames; selecting multiple video segments from the video to be edited which satisfy preset editing criteria; respectively calculating average scores of the multiple video segments by means of a pre-trained image quality scoring method; respectively obtaining the video segment having the highest average score of each shot type for splicing.
    Type: Grant
    Filed: April 22, 2020
    Date of Patent: April 9, 2024
    Assignee: ARASHI VISION INC.
    Inventors: Wenjie Jiang, Jinlin Cai, Jingkang Liu
  • Publication number: 20230043497
    Abstract: The present invention is applicable to the technical field of aerial photography. Disclosed are a panoramic photographing apparatus, a panoramic photographing system, a photographing method, and an aircraft. The photographing apparatus comprises a support connected to an aircraft body and a photographing module mounted on the support. The photographing module comprises a first photographing module and a second photographing module arranged in a first direction and a second direction. The first direction is opposite to the second direction. A line of sight corresponding to a maximum angle of view of the first photographing module intersects a line of sight corresponding to a maximum angle of view of the second photographing module. The photographing method uses the photographing apparatus. The aircraft comprises the photographing apparatus. The panoramic photographing system comprises the remote terminal and the photographing apparatus/aircraft.
    Type: Application
    Filed: January 7, 2021
    Publication date: February 9, 2023
    Inventors: Qijiang Wu, Jingkang Liu, Kehui He
  • Patent number: 11509859
    Abstract: The present invention provides a video decoding method and a camera. Said method comprises: loading a video, and decoding each frame from the video; calculating, for any two adjacent frames, a first optical flow field; calculating, according to the first optical flow field, a second optical flow field of a position where a frame is to be inserted, the position being located between two adjacent frames; using the second optical flow field to calculate a corresponding pixel position, in a previous frame of two adjacent frames, of each pixel of the frame to be inserted, and assigning the pixel value of the previous frame to the pixel of the frame to be inserted; and placing the inserted frame and the decoded original frame together according to a time sequence, so as to reconstitute a video having a high frame rate. The present invention eliminates or improves discrete motion, providing a more fluent viewing experience.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: November 22, 2022
    Assignee: ARASHI VISION INC.
    Inventors: Liang Xie, Jingkang Liu
  • Patent number: 11388339
    Abstract: The present invention provides an anti-shake method for a panoramic video, which comprises: obtaining, in real time, an output video frame, a fisheye image corresponding thereto, a pixel timestamp in the video frame, and a corresponding camera gyroscope timestamp; synchronizing the pixel timestamp in the video frame with the corresponding camera gyroscope timestamp, and calculating a rotation matrix of the camera movement in the camera gyroscope timestamp; smoothing the camera movement and establishing a coordinate system of a smooth trajectory; correcting the fisheye image distortion; and rendering the fisheye image by means of forward rendering to generate a stable video. According to the present invention, the rolling shutter distortion of a panoramic video sequence can be corrected, the image distortion caused by the rolling shutter of a CMOS can be corrected, and the rolling shutter is eliminated, thereby achieving a better anti-shake effect of a video image.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: July 12, 2022
    Assignee: ARASHI VISION INC.
    Inventors: Cong Chen, Jingkang Liu, Wenjie Jiang, Yibin Guo
  • Publication number: 20220199121
    Abstract: Provided are an automatic video editing method and a portable terminal, the method comprising: obtaining a video to be edited; extracting key frames of the video to be edited; inputting the key frames to a pre-trained scene classification method and a pre-trained target detection method, and respectively obtaining scene type markers and target object markers of the key frames; selecting multiple video segments from the video to be edited which satisfy preset editing criteria; respectively calculating average scores of the multiple video segments by means of a pre-trained image quality scoring method; respectively obtaining the video segment having the highest average score of each shot type for splicing.
    Type: Application
    Filed: April 22, 2020
    Publication date: June 23, 2022
    Inventors: Wenjie JIANG, Jinlin CAI, Jingkang LIU
  • Publication number: 20220141387
    Abstract: A camera lens smoothing method includes: obtaining a current video frame of a camera video and gyroscope information of the current video frame, and calculating a current first rotation matrix; conducting smoothing on the first rotation matrix, and calculating a third rotation matrix; conducting viewpoint decomposition on the current video frame according to the third rotation matrix, and calculating a fourth rotation matrix; and conducting 3D rotation on the current video frame according to the fourth rotation matrix, and rebuilding an anti-shake video.
    Type: Application
    Filed: January 20, 2022
    Publication date: May 5, 2022
    Inventors: Cong Chen, Zhuo Guo, Jingkang Liu
  • Patent number: 11233944
    Abstract: Provided in the present invention are a method for achieving a bullet time capturing effect and a panoramic camera. The method comprises: acquiring a panoramic video captured when a panoramic camera rotates around a capture target; acquiring from within the panoramic video hemispherical images close to the side of the capture target; splicing the hemispherical images to generate a spliced image; and fixing a viewpoint of the spliced image, thus achieving a bullet time capturing effect. According to the present invention, only one panoramic camera is needed to be able to capture the bullet time capturing effect, so that the capturing cost of the bullet time capturing effect in the present invention is low. Meanwhile, since the bullet time capturing effect is obtained by means of a panoramic video being captured when a panoramic camera rotates around a capture target and processing being carried out on the panoramic video, the precision is high.
    Type: Grant
    Filed: November 2, 2018
    Date of Patent: January 25, 2022
    Assignee: ARASHI VISION INC.
    Inventors: Cong Chen, Wenjie Jiang, Jingkang Liu
  • Patent number: 11055818
    Abstract: A panorama image alignment method method comprises: obtaining multipath spherical images; calculating rotation Euler angles between each spherical image and a middle portion, a left portion and a right portion of an adjacent spherical image according to a middle portion, a left portion and a right portion of each spherical image to obtain a first left portion rotation matrix and a second right portion rotation matrix; obtaining a first left panorama image, a first right panorama image, a second left panorama image and a second right panorama image; aligning the second left panorama image to the first left panorama image, obtaining a second left portion rotation matrix by means of calculation, and then obtaining a rotation matrix of a left panorama; aligning the second right panorama image to the first right panorama image, obtaining a second right portion rotation matrix by means of calculation, and obtaining a rotation matrix of a right panorama.
    Type: Grant
    Filed: April 26, 2018
    Date of Patent: July 6, 2021
    Assignee: ARASHI VISION INC.
    Inventors: Chenglong Yin, Wenjie Jiang, Jingkang Liu
  • Patent number: 11050985
    Abstract: Disclosed in the present invention are an image purple fringe eliminating system, method, a computer-readable storage medium, and a photographing device. The system traverses an image, calculates a hue of a pixel, counts a ratio of purple hue to adjacent purple hue pixels in the image, and calculates a dynamic purple fringe detection threshold; creates a mask with the same size as the image acquired by an image acquisition module, and detects the pixels that fall into a purple fringe area; corrects the detected pixel falling into the purple fringe area, correcting both a red channel intensity value and a blue channel intensity value of the pixels within the purple fringe region using a green channel intensity value. The invention can automatically correct the purple fringe of the image, improve the image shooting quality and the user experience.
    Type: Grant
    Filed: January 11, 2018
    Date of Patent: June 29, 2021
    Assignee: ARASHI VISION INC.
    Inventors: Jinlin Cai, Jingkang Liu
  • Publication number: 20210185274
    Abstract: The present invention provides a video decoding method and a camera. Said method comprises: loading a video, and decoding each frame from the video; calculating, for any two adjacent frames, a first optical flow field; calculating, according to the first optical flow field, a second optical flow field of a position where a frame is to be inserted, the position being located between two adjacent frames; using the second optical flow field to calculate a corresponding pixel position, in a previous frame of two adjacent frames, of each pixel of the frame to be inserted, and assigning the pixel value of the previous frame to the pixel of the frame to be inserted; and placing the inserted frame and the decoded original frame together according to a time sequence, so as to reconstitute a video having a high frame rate. The present invention eliminates or improves discrete motion, providing a more fluent viewing experience.
    Type: Application
    Filed: November 16, 2018
    Publication date: June 17, 2021
    Inventors: LIANG XIE, JINGKANG LIU
  • Publication number: 20210006718
    Abstract: The present invention provides an anti-shake method for a panoramic video, which comprises: obtaining, in real time, an output video frame, a fisheye image corresponding thereto, a pixel timestamp in the video frame, and a corresponding camera gyroscope timestamp; synchronizing the pixel timestamp in the video frame with the corresponding camera gyroscope timestamp, and calculating a rotation matrix of the camera movement in the camera gyroscope timestamp; smoothing the camera movement and establishing a coordinate system of a smooth trajectory; correcting the fisheye image distortion; and rendering the fisheye image by means of forward rendering to generate a stable video. According to the present invention, the rolling shutter distortion of a panoramic video sequence can be corrected, the image distortion caused by the rolling shutter of a CMOS can be corrected, and the rolling shutter is eliminated, thereby achieving a better anti-shake effect of a video image.
    Type: Application
    Filed: March 15, 2019
    Publication date: January 7, 2021
    Inventors: CONG CHEN, JINGKANG LIU, WENJIE JIANG, YIBIN GUO
  • Patent number: 10812718
    Abstract: The present application is applicable in the field of videos. Provided are a method and system for panoramic video stabilization, and a portable terminal. The method comprises: acquiring in real time the timestamp of a current state, an accelerometer count value, and an angular velocity value of a portable terminal; estimating the rotation vector of the current state by utilizing an Extended Kalman Filtering combined with the accelerometer count value and the angular velocity value; calculating a current rotation matrix via the Rodrigues' rotation formula on the basis of the rotation vector of the current state; and rotating a panoramic image on the basis of the current rotation matrix and producing a stabilized video frame. The present invention allows the stabilization of a jittering video frame and alleviates VR motion sickness.
    Type: Grant
    Filed: February 5, 2018
    Date of Patent: October 20, 2020
    Assignee: ARASHI VISION INC.
    Inventors: Jinlin Cai, Wenjie Jiang, Jingkang Liu
  • Patent number: D898802
    Type: Grant
    Filed: September 1, 2019
    Date of Patent: October 13, 2020
    Assignee: ARASHI VISION INC.
    Inventors: Jingkang Liu, Weibin Guo, Kehui He
  • Patent number: D939604
    Type: Grant
    Filed: June 1, 2020
    Date of Patent: December 28, 2021
    Assignee: ARASHI VISION INC.
    Inventors: Wen Su, Lei Zhang, Hui Xu, Jingkang Liu, Fei Gao
  • Patent number: D982644
    Type: Grant
    Filed: February 7, 2021
    Date of Patent: April 4, 2023
    Assignee: ARASHI VISION INC.
    Inventors: Wen Su, Kehui He, Jingkang Liu, Fei Gao, Zhuo Guo
  • Patent number: D998678
    Type: Grant
    Filed: September 29, 2022
    Date of Patent: September 12, 2023
    Assignee: ARASHI VISION INC.
    Inventors: Wen Su, Jingkang Liu, Fei Gao, Meihua Cao
  • Patent number: D1006863
    Type: Grant
    Filed: October 12, 2022
    Date of Patent: December 5, 2023
    Assignee: ARASHI VISION INC.
    Inventors: Limin Ma, Jingkang Liu, Fei Gao
  • Patent number: D1019730
    Type: Grant
    Filed: January 30, 2022
    Date of Patent: March 26, 2024
    Assignee: ARASHI VISION INC.
    Inventors: Jingkang Liu, Lingwu Huang
  • Patent number: D1025189
    Type: Grant
    Filed: June 14, 2023
    Date of Patent: April 30, 2024
    Assignee: ARASHI VISION INC.
    Inventors: Mingzhe Guo, Jingkang Liu, Fei Gao