Patents Assigned to ARASHI VISION INC.
  • Patent number: 11968449
    Abstract: A camera lens smoothing method includes: obtaining a current video frame of a camera video and gyroscope information of the current video frame, and calculating a current first rotation matrix; conducting smoothing on the first rotation matrix, and calculating a third rotation matrix; conducting viewpoint decomposition on the current video frame according to the third rotation matrix, and calculating a fourth rotation matrix; and conducting 3D rotation on the current video frame according to the fourth rotation matrix, and rebuilding an anti-shake video.
    Type: Grant
    Filed: January 20, 2022
    Date of Patent: April 23, 2024
    Assignee: ARASHI VISION INC.
    Inventors: Cong Chen, Zhuo Guo, Jingkang Liu
  • Patent number: 11967051
    Abstract: Provided are an image fusion method and apparatus, and a portable terminal. The method comprises: obtaining several aligned images; respectively calculating gradient information of each image; setting a mask image of each image, and generating a target gradient image; performing a gradient operation on the target gradient image, and obtaining a target Laplacian image; performing a deconvolution transform on the Laplacian image, and generating a fused panoramic image. The technical solution generates a Laplacian image by performing gradient information calculations on several images, and then performs a deconvolution transform to generate a fused panoramic image, thereby eliminating image stitching color differences, and implementing a better image fusion effect.
    Type: Grant
    Filed: May 9, 2020
    Date of Patent: April 23, 2024
    Assignee: ARASHI VISION INC.
    Inventors: Liang Xie, Chaoyi Xie
  • Patent number: 11955143
    Abstract: Provided are an automatic video editing method and a portable terminal, the method comprising: obtaining a video to be edited; extracting key frames of the video to be edited; inputting the key frames to a pre-trained scene classification method and a pre-trained target detection method, and respectively obtaining scene type markers and target object markers of the key frames; selecting multiple video segments from the video to be edited which satisfy preset editing criteria; respectively calculating average scores of the multiple video segments by means of a pre-trained image quality scoring method; respectively obtaining the video segment having the highest average score of each shot type for splicing.
    Type: Grant
    Filed: April 22, 2020
    Date of Patent: April 9, 2024
    Assignee: ARASHI VISION INC.
    Inventors: Wenjie Jiang, Jinlin Cai, Jingkang Liu
  • Patent number: 11948228
    Abstract: A color correction method for a panoramic image comprises: acquiring a first and second fisheye images; expanding the first fisheye image and the second fisheye image respectively to obtain a first image and a second image in an RGB color space; calculating overlapping areas between the images; converting the first image and the second image from the RGB color space to a Lab color space; in the Lab color space, adjusting the brightness value of the first image and the brightness value of the second image; converting the first image and the second image from the Lab color space to the RGB color space; according to the mean color values of a first and second overlapping areas, adjusting the color value of the second image by using the first image as a reference, or adjusting the color value of the first image by using the second image as a reference.
    Type: Grant
    Filed: March 6, 2019
    Date of Patent: April 2, 2024
    Assignee: ARASHI VISION INC.
    Inventor: Chenglong Yin
  • Patent number: 11887362
    Abstract: A sky filter method for panoramic images and a portable terminal is provided. The method comprises: obtaining several panoramic images containing sky regions as a data set, and marking a sky region and a ground region of each panoramic image to obtain a marked mask image and a panoramic template image of sky; extracting features of the sky region and the ground region of each panoramic image, and marking a positive sample and a negative sample; inputting the positive sample and the negative sample to SVM for training to obtain a model; extracting the features of the panoramic images, and inputting same to the model to obtain an initial mask image; removing a misclassified pixel and a misclassified region in the initial mask image to obtain an accurate mask image; and fuse the panoramic template image of sky and a test panoramic image to achieve a sky filter effect.
    Type: Grant
    Filed: July 2, 2019
    Date of Patent: January 30, 2024
    Assignee: ARASHI VISION INC.
    Inventors: Ruidong Gao, Ying Zhou
  • Patent number: 11758277
    Abstract: Disclosed are a method for determining semi-synchronous exposure parameters and an electronic device. The method in the embodiments of the present invention comprises: acquiring first exposure parameters corresponding to each lens; if it is determined that a preset EV limit value is not satisfied according to the first exposure parameters of each lens and adjacent lenses, respectively calculating exposure control parameters of each lens; calculating second exposure parameters corresponding to each lens according to the exposure control parameters of each lens and the first exposure parameters corresponding to each lens; if it is determined that the preset EV limit value is satisfied according to the second exposure parameters of each lens and adjacent lenses, determining the second exposure parameters corresponding to each lens to be semi-synchronized exposure parameters of each lens.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: September 12, 2023
    Assignee: ARASHI VISION INC.
    Inventors: Kun Tan, Yibin Guo
  • Patent number: 11509859
    Abstract: The present invention provides a video decoding method and a camera. Said method comprises: loading a video, and decoding each frame from the video; calculating, for any two adjacent frames, a first optical flow field; calculating, according to the first optical flow field, a second optical flow field of a position where a frame is to be inserted, the position being located between two adjacent frames; using the second optical flow field to calculate a corresponding pixel position, in a previous frame of two adjacent frames, of each pixel of the frame to be inserted, and assigning the pixel value of the previous frame to the pixel of the frame to be inserted; and placing the inserted frame and the decoded original frame together according to a time sequence, so as to reconstitute a video having a high frame rate. The present invention eliminates or improves discrete motion, providing a more fluent viewing experience.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: November 22, 2022
    Assignee: ARASHI VISION INC.
    Inventors: Liang Xie, Jingkang Liu
  • Patent number: 11509824
    Abstract: The present invention relates to the field of panoramic cameras, and provides a method for tracking a target in a panoramic video, and a panoramic camera. The method is used to track a target in a panoramic video on the basis of a multi-scale correlation filter, and employs automatic electronic pan-tilt-zoom technology. The present invention provides more robust tracking, faster processing speeds, a greater range of application in different tracking scenarios, and can be used to ensure that a tracked target is always at the center of the screen.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: November 22, 2022
    Assignee: ARASHI VISION INC.
    Inventors: Jinlin Cai, Wenjie Jiang, Cong Chen
  • Patent number: 11490010
    Abstract: The present invention is applicable to the field of videos. Provided are a panoramic video anti-shake method and a portable terminal. The method comprises: acquiring world coordinates of any reference point in a world coordinate system in real time, and also acquiring the corresponding camera coordinates of the reference point in the portable terminal and an angular velocity value of a gyroscope at a current state in the portable terminal; smoothing the motion of a camera by using an extended Kalman filter; decomposing the smoothed motion, synthesizing the motion into a virtual lens motion in an ePTZ mode, and calculating a rotation amount of the virtual lens; and re-projecting an original video according to the rotation amount of the virtual lens and a rotation matrix for converting from the camera coordinates to the world coordinates, so as to generate a stable video.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: November 1, 2022
    Assignee: ARASHI VISION INC.
    Inventor: Cong Chen
  • Patent number: 11483478
    Abstract: The present invention is applicable to the field of videos, and provides a panoramic video anti-shake method and a portable terminal. The method comprises: obtaining world coordinates of any reference point in a world coordinate system in real time, and simultaneously obtaining camera coordinates corresponding to the reference point in the portable terminal and an angular velocity value of a current state of a gyroscope in the portable terminal; smoothing the motion of a camera using an extended Kalman filter; decomposing the smoothed motion to synthesize virtual lens motion of a free lens mode, and calculating the rotation amount of the virtual lens; and re-projecting an original video to generate a stable video.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: October 25, 2022
    Assignee: ARASHI VISION INC.
    Inventor: Cong Chen
  • Patent number: 11388336
    Abstract: The present invention provides a horizontal calibration method and system for a panoramic image or video, and a portable terminal. The method comprises: receiving images or video frames of two circles after being imaged by two cameras having opposite photographing directions; obtaining a horizontal calibration matrix during photographing; and pasting, according to the horizontal calibration matrix, the images or video frames of the two circles to a left hemispherical curved surface and a right hemispherical curved surface of a spherical panoramic mathematical model in a UV mapping manner, respectively so that the panoramic images or video frames pasted in the spherical panoramic mathematical model are horizontal. According to the present invention, when an image or a video frame photographed by a panoramic camera is not horizontal, the panoramic image or the video frame pasted in a spherical panoramic mathematical model is still horizontal.
    Type: Grant
    Filed: March 2, 2017
    Date of Patent: July 12, 2022
    Assignee: ARASHI VISION INC.
    Inventors: Yuming Xie, Wenxue Peng
  • Patent number: 11388339
    Abstract: The present invention provides an anti-shake method for a panoramic video, which comprises: obtaining, in real time, an output video frame, a fisheye image corresponding thereto, a pixel timestamp in the video frame, and a corresponding camera gyroscope timestamp; synchronizing the pixel timestamp in the video frame with the corresponding camera gyroscope timestamp, and calculating a rotation matrix of the camera movement in the camera gyroscope timestamp; smoothing the camera movement and establishing a coordinate system of a smooth trajectory; correcting the fisheye image distortion; and rendering the fisheye image by means of forward rendering to generate a stable video. According to the present invention, the rolling shutter distortion of a panoramic video sequence can be corrected, the image distortion caused by the rolling shutter of a CMOS can be corrected, and the rolling shutter is eliminated, thereby achieving a better anti-shake effect of a video image.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: July 12, 2022
    Assignee: ARASHI VISION INC.
    Inventors: Cong Chen, Jingkang Liu, Wenjie Jiang, Yibin Guo
  • Patent number: 11233944
    Abstract: Provided in the present invention are a method for achieving a bullet time capturing effect and a panoramic camera. The method comprises: acquiring a panoramic video captured when a panoramic camera rotates around a capture target; acquiring from within the panoramic video hemispherical images close to the side of the capture target; splicing the hemispherical images to generate a spliced image; and fixing a viewpoint of the spliced image, thus achieving a bullet time capturing effect. According to the present invention, only one panoramic camera is needed to be able to capture the bullet time capturing effect, so that the capturing cost of the bullet time capturing effect in the present invention is low. Meanwhile, since the bullet time capturing effect is obtained by means of a panoramic video being captured when a panoramic camera rotates around a capture target and processing being carried out on the panoramic video, the precision is high.
    Type: Grant
    Filed: November 2, 2018
    Date of Patent: January 25, 2022
    Assignee: ARASHI VISION INC.
    Inventors: Cong Chen, Wenjie Jiang, Jingkang Liu
  • Patent number: 11190773
    Abstract: The invention is applicable to the field of videos and provides a video coder-based code rate control method and device, and a video server. The method comprises the following steps: in the video playback process, when a code rate needs to be switched, modifying time stamps of frames transmitted to the video coder in a switching process; transmitting, to the video coder, the frames having modified time stamps; and for each frame output by the video coder, restoring the time stamp of the output frame to be the original time stamp. The present invention avoids the stuttering resulted from interruption of coding, providing a very smooth switching process.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: November 30, 2021
    Assignee: ARASHI VISION INC.
    Inventor: Li Zhu
  • Patent number: D939604
    Type: Grant
    Filed: June 1, 2020
    Date of Patent: December 28, 2021
    Assignee: ARASHI VISION INC.
    Inventors: Wen Su, Lei Zhang, Hui Xu, Jingkang Liu, Fei Gao
  • Patent number: D982644
    Type: Grant
    Filed: February 7, 2021
    Date of Patent: April 4, 2023
    Assignee: ARASHI VISION INC.
    Inventors: Wen Su, Kehui He, Jingkang Liu, Fei Gao, Zhuo Guo
  • Patent number: D998678
    Type: Grant
    Filed: September 29, 2022
    Date of Patent: September 12, 2023
    Assignee: ARASHI VISION INC.
    Inventors: Wen Su, Jingkang Liu, Fei Gao, Meihua Cao
  • Patent number: D1006863
    Type: Grant
    Filed: October 12, 2022
    Date of Patent: December 5, 2023
    Assignee: ARASHI VISION INC.
    Inventors: Limin Ma, Jingkang Liu, Fei Gao
  • Patent number: D1019730
    Type: Grant
    Filed: January 30, 2022
    Date of Patent: March 26, 2024
    Assignee: ARASHI VISION INC.
    Inventors: Jingkang Liu, Lingwu Huang
  • Patent number: D1025189
    Type: Grant
    Filed: June 14, 2023
    Date of Patent: April 30, 2024
    Assignee: ARASHI VISION INC.
    Inventors: Mingzhe Guo, Jingkang Liu, Fei Gao