Patents by Inventor JINGKANG LIU
JINGKANG LIU has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11968449Abstract: A camera lens smoothing method includes: obtaining a current video frame of a camera video and gyroscope information of the current video frame, and calculating a current first rotation matrix; conducting smoothing on the first rotation matrix, and calculating a third rotation matrix; conducting viewpoint decomposition on the current video frame according to the third rotation matrix, and calculating a fourth rotation matrix; and conducting 3D rotation on the current video frame according to the fourth rotation matrix, and rebuilding an anti-shake video.Type: GrantFiled: January 20, 2022Date of Patent: April 23, 2024Assignee: ARASHI VISION INC.Inventors: Cong Chen, Zhuo Guo, Jingkang Liu
-
Patent number: 11955143Abstract: Provided are an automatic video editing method and a portable terminal, the method comprising: obtaining a video to be edited; extracting key frames of the video to be edited; inputting the key frames to a pre-trained scene classification method and a pre-trained target detection method, and respectively obtaining scene type markers and target object markers of the key frames; selecting multiple video segments from the video to be edited which satisfy preset editing criteria; respectively calculating average scores of the multiple video segments by means of a pre-trained image quality scoring method; respectively obtaining the video segment having the highest average score of each shot type for splicing.Type: GrantFiled: April 22, 2020Date of Patent: April 9, 2024Assignee: ARASHI VISION INC.Inventors: Wenjie Jiang, Jinlin Cai, Jingkang Liu
-
Publication number: 20230043497Abstract: The present invention is applicable to the technical field of aerial photography. Disclosed are a panoramic photographing apparatus, a panoramic photographing system, a photographing method, and an aircraft. The photographing apparatus comprises a support connected to an aircraft body and a photographing module mounted on the support. The photographing module comprises a first photographing module and a second photographing module arranged in a first direction and a second direction. The first direction is opposite to the second direction. A line of sight corresponding to a maximum angle of view of the first photographing module intersects a line of sight corresponding to a maximum angle of view of the second photographing module. The photographing method uses the photographing apparatus. The aircraft comprises the photographing apparatus. The panoramic photographing system comprises the remote terminal and the photographing apparatus/aircraft.Type: ApplicationFiled: January 7, 2021Publication date: February 9, 2023Inventors: Qijiang Wu, Jingkang Liu, Kehui He
-
Patent number: 11509859Abstract: The present invention provides a video decoding method and a camera. Said method comprises: loading a video, and decoding each frame from the video; calculating, for any two adjacent frames, a first optical flow field; calculating, according to the first optical flow field, a second optical flow field of a position where a frame is to be inserted, the position being located between two adjacent frames; using the second optical flow field to calculate a corresponding pixel position, in a previous frame of two adjacent frames, of each pixel of the frame to be inserted, and assigning the pixel value of the previous frame to the pixel of the frame to be inserted; and placing the inserted frame and the decoded original frame together according to a time sequence, so as to reconstitute a video having a high frame rate. The present invention eliminates or improves discrete motion, providing a more fluent viewing experience.Type: GrantFiled: November 16, 2018Date of Patent: November 22, 2022Assignee: ARASHI VISION INC.Inventors: Liang Xie, Jingkang Liu
-
Patent number: 11388339Abstract: The present invention provides an anti-shake method for a panoramic video, which comprises: obtaining, in real time, an output video frame, a fisheye image corresponding thereto, a pixel timestamp in the video frame, and a corresponding camera gyroscope timestamp; synchronizing the pixel timestamp in the video frame with the corresponding camera gyroscope timestamp, and calculating a rotation matrix of the camera movement in the camera gyroscope timestamp; smoothing the camera movement and establishing a coordinate system of a smooth trajectory; correcting the fisheye image distortion; and rendering the fisheye image by means of forward rendering to generate a stable video. According to the present invention, the rolling shutter distortion of a panoramic video sequence can be corrected, the image distortion caused by the rolling shutter of a CMOS can be corrected, and the rolling shutter is eliminated, thereby achieving a better anti-shake effect of a video image.Type: GrantFiled: March 15, 2019Date of Patent: July 12, 2022Assignee: ARASHI VISION INC.Inventors: Cong Chen, Jingkang Liu, Wenjie Jiang, Yibin Guo
-
Publication number: 20220199121Abstract: Provided are an automatic video editing method and a portable terminal, the method comprising: obtaining a video to be edited; extracting key frames of the video to be edited; inputting the key frames to a pre-trained scene classification method and a pre-trained target detection method, and respectively obtaining scene type markers and target object markers of the key frames; selecting multiple video segments from the video to be edited which satisfy preset editing criteria; respectively calculating average scores of the multiple video segments by means of a pre-trained image quality scoring method; respectively obtaining the video segment having the highest average score of each shot type for splicing.Type: ApplicationFiled: April 22, 2020Publication date: June 23, 2022Inventors: Wenjie JIANG, Jinlin CAI, Jingkang LIU
-
Publication number: 20220141387Abstract: A camera lens smoothing method includes: obtaining a current video frame of a camera video and gyroscope information of the current video frame, and calculating a current first rotation matrix; conducting smoothing on the first rotation matrix, and calculating a third rotation matrix; conducting viewpoint decomposition on the current video frame according to the third rotation matrix, and calculating a fourth rotation matrix; and conducting 3D rotation on the current video frame according to the fourth rotation matrix, and rebuilding an anti-shake video.Type: ApplicationFiled: January 20, 2022Publication date: May 5, 2022Inventors: Cong Chen, Zhuo Guo, Jingkang Liu
-
Patent number: 11233944Abstract: Provided in the present invention are a method for achieving a bullet time capturing effect and a panoramic camera. The method comprises: acquiring a panoramic video captured when a panoramic camera rotates around a capture target; acquiring from within the panoramic video hemispherical images close to the side of the capture target; splicing the hemispherical images to generate a spliced image; and fixing a viewpoint of the spliced image, thus achieving a bullet time capturing effect. According to the present invention, only one panoramic camera is needed to be able to capture the bullet time capturing effect, so that the capturing cost of the bullet time capturing effect in the present invention is low. Meanwhile, since the bullet time capturing effect is obtained by means of a panoramic video being captured when a panoramic camera rotates around a capture target and processing being carried out on the panoramic video, the precision is high.Type: GrantFiled: November 2, 2018Date of Patent: January 25, 2022Assignee: ARASHI VISION INC.Inventors: Cong Chen, Wenjie Jiang, Jingkang Liu
-
Patent number: 11055818Abstract: A panorama image alignment method method comprises: obtaining multipath spherical images; calculating rotation Euler angles between each spherical image and a middle portion, a left portion and a right portion of an adjacent spherical image according to a middle portion, a left portion and a right portion of each spherical image to obtain a first left portion rotation matrix and a second right portion rotation matrix; obtaining a first left panorama image, a first right panorama image, a second left panorama image and a second right panorama image; aligning the second left panorama image to the first left panorama image, obtaining a second left portion rotation matrix by means of calculation, and then obtaining a rotation matrix of a left panorama; aligning the second right panorama image to the first right panorama image, obtaining a second right portion rotation matrix by means of calculation, and obtaining a rotation matrix of a right panorama.Type: GrantFiled: April 26, 2018Date of Patent: July 6, 2021Assignee: ARASHI VISION INC.Inventors: Chenglong Yin, Wenjie Jiang, Jingkang Liu
-
Patent number: 11050985Abstract: Disclosed in the present invention are an image purple fringe eliminating system, method, a computer-readable storage medium, and a photographing device. The system traverses an image, calculates a hue of a pixel, counts a ratio of purple hue to adjacent purple hue pixels in the image, and calculates a dynamic purple fringe detection threshold; creates a mask with the same size as the image acquired by an image acquisition module, and detects the pixels that fall into a purple fringe area; corrects the detected pixel falling into the purple fringe area, correcting both a red channel intensity value and a blue channel intensity value of the pixels within the purple fringe region using a green channel intensity value. The invention can automatically correct the purple fringe of the image, improve the image shooting quality and the user experience.Type: GrantFiled: January 11, 2018Date of Patent: June 29, 2021Assignee: ARASHI VISION INC.Inventors: Jinlin Cai, Jingkang Liu
-
Publication number: 20210185274Abstract: The present invention provides a video decoding method and a camera. Said method comprises: loading a video, and decoding each frame from the video; calculating, for any two adjacent frames, a first optical flow field; calculating, according to the first optical flow field, a second optical flow field of a position where a frame is to be inserted, the position being located between two adjacent frames; using the second optical flow field to calculate a corresponding pixel position, in a previous frame of two adjacent frames, of each pixel of the frame to be inserted, and assigning the pixel value of the previous frame to the pixel of the frame to be inserted; and placing the inserted frame and the decoded original frame together according to a time sequence, so as to reconstitute a video having a high frame rate. The present invention eliminates or improves discrete motion, providing a more fluent viewing experience.Type: ApplicationFiled: November 16, 2018Publication date: June 17, 2021Inventors: LIANG XIE, JINGKANG LIU
-
Publication number: 20210006718Abstract: The present invention provides an anti-shake method for a panoramic video, which comprises: obtaining, in real time, an output video frame, a fisheye image corresponding thereto, a pixel timestamp in the video frame, and a corresponding camera gyroscope timestamp; synchronizing the pixel timestamp in the video frame with the corresponding camera gyroscope timestamp, and calculating a rotation matrix of the camera movement in the camera gyroscope timestamp; smoothing the camera movement and establishing a coordinate system of a smooth trajectory; correcting the fisheye image distortion; and rendering the fisheye image by means of forward rendering to generate a stable video. According to the present invention, the rolling shutter distortion of a panoramic video sequence can be corrected, the image distortion caused by the rolling shutter of a CMOS can be corrected, and the rolling shutter is eliminated, thereby achieving a better anti-shake effect of a video image.Type: ApplicationFiled: March 15, 2019Publication date: January 7, 2021Inventors: CONG CHEN, JINGKANG LIU, WENJIE JIANG, YIBIN GUO
-
Patent number: 10812718Abstract: The present application is applicable in the field of videos. Provided are a method and system for panoramic video stabilization, and a portable terminal. The method comprises: acquiring in real time the timestamp of a current state, an accelerometer count value, and an angular velocity value of a portable terminal; estimating the rotation vector of the current state by utilizing an Extended Kalman Filtering combined with the accelerometer count value and the angular velocity value; calculating a current rotation matrix via the Rodrigues' rotation formula on the basis of the rotation vector of the current state; and rotating a panoramic image on the basis of the current rotation matrix and producing a stabilized video frame. The present invention allows the stabilization of a jittering video frame and alleviates VR motion sickness.Type: GrantFiled: February 5, 2018Date of Patent: October 20, 2020Assignee: ARASHI VISION INC.Inventors: Jinlin Cai, Wenjie Jiang, Jingkang Liu
-
Patent number: D898802Type: GrantFiled: September 1, 2019Date of Patent: October 13, 2020Assignee: ARASHI VISION INC.Inventors: Jingkang Liu, Weibin Guo, Kehui He
-
Patent number: D939604Type: GrantFiled: June 1, 2020Date of Patent: December 28, 2021Assignee: ARASHI VISION INC.Inventors: Wen Su, Lei Zhang, Hui Xu, Jingkang Liu, Fei Gao
-
Patent number: D982644Type: GrantFiled: February 7, 2021Date of Patent: April 4, 2023Assignee: ARASHI VISION INC.Inventors: Wen Su, Kehui He, Jingkang Liu, Fei Gao, Zhuo Guo
-
Patent number: D998678Type: GrantFiled: September 29, 2022Date of Patent: September 12, 2023Assignee: ARASHI VISION INC.Inventors: Wen Su, Jingkang Liu, Fei Gao, Meihua Cao
-
Patent number: D1006863Type: GrantFiled: October 12, 2022Date of Patent: December 5, 2023Assignee: ARASHI VISION INC.Inventors: Limin Ma, Jingkang Liu, Fei Gao
-
Patent number: D1019730Type: GrantFiled: January 30, 2022Date of Patent: March 26, 2024Assignee: ARASHI VISION INC.Inventors: Jingkang Liu, Lingwu Huang
-
Patent number: D1025189Type: GrantFiled: June 14, 2023Date of Patent: April 30, 2024Assignee: ARASHI VISION INC.Inventors: Mingzhe Guo, Jingkang Liu, Fei Gao