Patents Assigned to ShanghaiTech University
  • Publication number: 20240127466
    Abstract: An energy-efficient point cloud feature extraction method based on a field-programmable gate array (FPGA) is mapped onto the FPGA for running. The energy-efficient point cloud feature extraction method based on the FPGA is applied to point cloud feature extraction in unmanned driving; or an intelligent robot. Compared with an existing technical solution, the energy-efficient point cloud feature extraction method based on the FPGA has following innovative points: a low-complexity projection method for organizing unordered and sparse point clouds, a high-parallel method for extracting a coarse-grained feature point, and a high-parallel method for selecting a fine-grained feature point.
    Type: Application
    Filed: September 19, 2023
    Publication date: April 18, 2024
    Applicant: SHANGHAITECH UNIVERSITY
    Inventors: Hao SUN, Yajun HA
  • Patent number: 11955357
    Abstract: The present disclosure relates to an in-situ temperature control platform, including an independent sample holder, a sample holder fixing cartridge, a customized sample stage and an anode contact pin. The independent sample holder includes a sample loading spot and a sample holder grip. The sample holder fixing cartridge includes a fixing cartridge body, the fixing cartridge body is provided with a sample holder slot, the bottom surface of the sample holder slot is provided with a heating element slot, and the sample holder slot is aligned with the sample loading spot. The bottom surface of the heating element slot is provided with a heating element fixing pinhole. The customized sample stage includes a sample stage body, the sample stage body is provided with a heating element support, and the heating element support is provided with a heating element.
    Type: Grant
    Filed: July 5, 2021
    Date of Patent: April 9, 2024
    Assignee: SHANGHAITECH UNIVERSITY
    Inventors: Yong Yang, Xiaohong Zhou, Evgeny Vovk, Jiafeng Zhao
  • Publication number: 20240112443
    Abstract: A max-flow/min-cut solution algorithm for early terminating a push-relabel algorithm is provided. The max-flow/min-cut solution algorithm is used for an application that does not require an exact maximum flow, and includes: defining an early termination condition of the push-relabel algorithm by a separation condition and a stable condition; determining that the separation condition is satisfied if there is no source node s, s?S, in the set T at any time in an operation process of the push-relabel algorithm; determining that the stable condition is satisfied if there is no active node in the set T; and terminating the push-relabel algorithm if both the separation condition and the stability condition are satisfied. The early termination technique is proposed to greatly reduce redundant computations and ensure that the algorithm terminates correctly in all cases.
    Type: Application
    Filed: September 22, 2021
    Publication date: April 4, 2024
    Applicant: SHANGHAITECH UNIVERSITY
    Inventors: Xinzhe LIU, Guangyao YAN, Yajun HA
  • Publication number: 20240104822
    Abstract: An image rendering system comprising a preprocessing unit coupled to a feature extract unit and a color rendering unit over a data bus. The preprocessing unit generates vector representations of spatial coordinates of sample points along camera rays corresponding to pixels of an image to be rendered. The feature extract unit generates a feature map of the image based on the vector representations, color and intensity values of the sample point through a first machine learning model. The color rendering unit renders the image based on the feature map through a second machine learning model. The first machine learning model is different from the second machine learning model.
    Type: Application
    Filed: December 7, 2023
    Publication date: March 28, 2024
    Applicant: SHANGHAITECH UNIVERSITY
    Inventors: Chaolin RAO, Minye WU, Xin LOU, Pingqiang ZHOU, Jingyi YU
  • Patent number: 11934459
    Abstract: A ripple push method for a graph cut includes: obtaining an excess flow ef(v) of a current node v; traversing four edges connecting the current node v in top, bottom, left and right directions, and determining whether each of the four edges is a pushable edge; calculating, according to different weight functions, a maximum push value of each of the four edges by efw=ef(v)*W, where W denotes a weight function; and traversing the four edges, recording a pushable flow of each of the four edges, and pushing out a calculated flow. The ripple push method explores different push weight functions, and significantly improves the actual parallelism of the push-relabel algorithm.
    Type: Grant
    Filed: September 22, 2021
    Date of Patent: March 19, 2024
    Assignee: SHANGHAITECH UNIVERSITY
    Inventors: Guangyao Yan, Xinzhe Liu, Yajun Ha, Hui Wang
  • Patent number: 11934954
    Abstract: A pure integer quantization method for a lightweight neural network (LNN) is provided. The method includes the following steps: acquiring a maximum value of each pixel in each of the channels of the feature map of a current layer; dividing a value of each pixel in each of the channels of the feature map by a t-th power of the maximum value, t?[0,1]; multiplying a weight in each of the channels by the maximum value of each pixel in each of the channels of the corresponding feature map; and convolving the processed feature map with the processed weight to acquire the feature map of a next layer. The algorithm is verified on SkyNet and MobileNet respectively, and lossless INT8 quantization on SkyNet and maximum quantization accuracy so far on MobileNetv2 are achieved.
    Type: Grant
    Filed: September 22, 2021
    Date of Patent: March 19, 2024
    Assignee: SHANGHAITECH UNIVERSITY
    Inventors: Weixiong Jiang, Yajun Ha
  • Patent number: 11884947
    Abstract: Provided are fusion proteins that include an apolipoprotein B mRNA editing enzyme catalytic subunit 3A (APOBEC3A) and a clustered regularly interspaced short palindromic repeats (CRISPR)-associated (Cas) protein, optionally further with uracil glycosylase inhibitor (UGI). Such a fusion protein is able to conduct base editing in DNA by deaminating cytosine to uracil, even when the cytosine is in a GpC context or is methylated.
    Type: Grant
    Filed: February 22, 2019
    Date of Patent: January 30, 2024
    Assignee: ShanghaiTech University
    Inventors: Jia Chen, Li Yang, Xingxu Huang, Bei Yang, Xiao Wang, Jianan Li
  • Patent number: 11880935
    Abstract: An image-based method of modeling and rendering a three-dimensional model of an object is provided. The method comprises: obtaining a three-dimensional point cloud at each frame of a synchronized, multi-view video of an object, wherein the video comprises a plurality of frames; extracting a feature descriptor for each point in the point cloud for the plurality of frames without storing the feature descriptor for each frame; producing a two-dimensional feature map for a target camera; and using an anti-aliased convolutional neural network to decode the feature map into an image and a foreground mask.
    Type: Grant
    Filed: September 23, 2022
    Date of Patent: January 23, 2024
    Assignee: SHANGHAITECH UNIVERSITY
    Inventors: Minye Wu, Jingyi Yu
  • Patent number: 11880964
    Abstract: A method of processing light field images for separating a transmitted layer from a reflection layer. The method comprises capturing a plurality of views at a plurality of viewpoints with different polarization angles; obtaining an initial disparity estimation for a first view using SIFT-flow, and warping the first view to a reference view; optimizing an objective function comprising a transmitted layer and a secondary layer using an Augmented Lagrange Multiplier (ALM) with Alternating Direction Minimizing (ADM) strategy; updating the disparity estimation for the first view; repeating the steps of optimizing the objective function and updating the disparity estimation until the change in the objective function between two consecutive iterations is below a threshold; and separating the transmitted layer and the secondary layer using the disparity estimation for the first view.
    Type: Grant
    Filed: October 19, 2020
    Date of Patent: January 23, 2024
    Assignee: SHANGHAITECH UNIVERSITY
    Inventors: Minye Wu, Zhiru Shi, Jingyi Yu
  • Patent number: 11875523
    Abstract: The present disclosure provides an adaptive stereo matching optimization method, apparatus, and device, and a storage medium. The method includes: acquiring images of at least two perspectives of the same target scene, accordingly obtaining, through calculation, disparity value ranges corresponding to pixels in the target scene; and obtaining optimized depth value ranges by adjusting the disparity value ranges of the pixels in the target scene in real time through an adaptive stereo matching model; adjusting an execution cycle in the adaptive stereo matching model in real time through a DVFS algorithm according to a resource constraint condition of the processing system; and/or training on a plurality of scene image data sets through a convolutional neural network, so that the specific function parameters in the adaptive stereo matching model are correspondingly adjusted in real time according to the acquired different scene images.
    Type: Grant
    Filed: September 20, 2019
    Date of Patent: January 16, 2024
    Assignee: ShanghaiTech University
    Inventors: Fupeng Chen, Heng Yu, Yajun Ha
  • Patent number: 11875244
    Abstract: An enhanced dynamic random access memory (eDRAM)-based computing-in-memory (CIM) convolutional neural network (CNN) accelerator comprises four P2ARAM blocks, where each of the P2ARAM blocks includes a 5T1C ping-pong eDRAM bit cell array composed of 64×16 5T1C ping-pong eDRAM bit cells. In each of the P2ARAM blocks, 64×2 digital time converters convert a 4-bit activation value into different pulse widths from a row direction and input the pulse widths into the 5T1C ping-pong eDRAM bit cell array for calculation. A total of 16×2 convolution results are output in a column direction of the 5T1C ping-pong eDRAM bit cell array. The CNN accelerator uses the 5T1C ping-pong eDRAM bit cells to perform multi-bit storage and convolution in parallel. An S2M-ADC scheme is proposed to allot an area of an input sampling capacitor of an ABL to sign-numerical SAR ADC units of a C-DAC array without adding area overhead.
    Type: Grant
    Filed: August 5, 2022
    Date of Patent: January 16, 2024
    Assignee: SHANGHAITECH UNIVERSITY
    Inventors: Hongtu Zhang, Yuhao Shu, Yajun Ha
  • Publication number: 20240013479
    Abstract: A computer-implemented method includes encoding a radiance field of an object onto a machine learning model; conducting, based on a set of training images of the object, a training process on the machine learning model to obtain a trained machine learning model, wherein the training process includes a first training process using a plurality of first test sample points followed by a second training process using a plurality of second test sample points located within a threshold distance from a surface region of the object; obtaining target view parameters indicating a view direction of the object; obtaining a plurality of rays associated with a target image of the object; obtaining render sample points on the plurality of rays associated with the target image; and rendering, by inputting the render sample points to the trained machine learning model, colors associated with the pixels of the target image.
    Type: Application
    Filed: September 19, 2023
    Publication date: January 11, 2024
    Applicant: SHANGHAITECH UNIVERSITY
    Inventors: Minye WU, Chaolin RAO, Xin LOU, Pingqiang ZHOU, Jingyi YU
  • Patent number: 11861840
    Abstract: According to some embodiments, an imaging processing method for extracting a plurality of planar surfaces from a depth map includes computing a depth change indication map (DCI) from a depth map in accordance with a smoothness threshold. The imaging processing method further includes recursively extracting a plurality of planar region from the depth map, wherein the size of each planar region is dynamically adjusted according to the DCI. The imaging processing method further includes clustering the extracted planar regions into a plurality of groups in accordance with a distance function; and growing each group to generate pixel-wise segmentation results and inlier points statistics simultaneously.
    Type: Grant
    Filed: March 31, 2021
    Date of Patent: January 2, 2024
    Assignee: SHANGHAITECH UNIVERSITY
    Inventors: Ziran Xing, Zhiru Shi, Yi Ma, Jingyi Yu
  • Patent number: 11845466
    Abstract: A normal distributions transform (NDT) method for LiDAR point cloud localization in unmanned driving is provided. The method proposes a non-recursive, memory-efficient data structure occupation-aware-voxel-structure (OAVS), which speeds up each search operation. Compared with a tree-based structure, the proposed data structure OAVS is easy to parallelize and consumes only about 1/10 of memory. Based on the data structure OAVS, the method proposes a semantic-assisted OAVS-based (SEO)-NDT algorithm, which significantly reduces the number of search operations, redefines a parameter affecting the number of search operations, and removes a redundant search operation. In addition, the method proposes a streaming field-programmable gate array (FPGA) accelerator architecture, which further improves the real-time and energy-saving performance of the SEO-NDT algorithm. The method meets the real-time and high-precision requirements of smart vehicles for three-dimensional (3D) lidar localization.
    Type: Grant
    Filed: September 22, 2021
    Date of Patent: December 19, 2023
    Assignee: SHANGHAITECH UNIVERSITY
    Inventors: Qi Deng, Hao Sun, Yajun Ha, Hui Wang
  • Patent number: 11840685
    Abstract: Provided are fusion proteins and related molecules useful for conducting base editing with reduced or no off-target mutations. The fusion protein may include a first fragment comprising a nucleobase deaminase or a catalytic domain thereof, a second fragment comprising a nucleobase deaminase inhibitor, and a protease cleavage site between the first fragment and the second fragment. Also provided are improved prime editing systems, including prime editing guide RNA with improved stability.
    Type: Grant
    Filed: July 11, 2022
    Date of Patent: December 12, 2023
    Assignee: ShanghaiTech University
    Inventors: Jia Chen, Bei Yang, Li Yang, Xingxu Huang, Lijie Wang
  • Publication number: 20230360372
    Abstract: Systems, methods, and non-transitory computer-readable media are configured to obtain a set of content items to train a neural radiance field-based (NeRF-based) machine learning model for object recognition. Depth maps of objects depicted in the set of content items can be determined. A first set of training data comprising reconstructed content items depicting only the objects can be generated based on the depth maps. A second set of training data comprising one or more optimal training paths associated with the set of content items can be generated based on the depth maps. The one or more optimal training paths are generated based at least in part on a dissimilarity matrix associated with the set of content items. The NeRF-based machine learning model can be trained based on the first set of training data and the second set of training data.
    Type: Application
    Filed: July 19, 2023
    Publication date: November 9, 2023
    Applicant: SHANGHAITECH UNIVERSITY
    Inventors: Fuqiang ZHAO, Minye WU, Lan XU, Jingyi YU
  • Publication number: 20230313205
    Abstract: A fusion protein which may comprise a first nCas9 fragment, a chimeric insertion fragment, a second nCas9 fragment and two UGI fragments from N-terminus to C-terminus, wherein the chimeric insertion fragment is selected from APOBEC1 fragment or APOBEC3A fragment for cytosine deamination at the target site. The fusion protein may comprise a first nCas9 fragment, a chimeric insertion fragment and a second nCas9 fragment from N-terminus to C-terminus, wherein the chimeric insertion fragment is TadA-TadA* for cytosine deamination at the target site. The present disclosure provides a novel base editing tool that is compatible with insertion of various deaminases on the chimeric sites of nCas9. Compared with nCas9 terminal fusion base editor, the base editing tool of the present invention significantly reduce off-targeting on both DNA and RNA, while maintaining specific targeted base editing efficiency, with higher specificity and favorable industrialization prospects.
    Type: Application
    Filed: January 5, 2023
    Publication date: October 5, 2023
    Applicant: ShanghaiTech University
    Inventors: Yajing LIU, Shisheng HUANG, Xingxu HUANG
  • Publication number: 20230312358
    Abstract: A method for catalytic synthesis of ammonia under normal pressures, including: performing a reaction of hydrogen and nitrogen to synthesize ammonia under normal pressures by taking a liquid alloy as a catalyst in a reactor, where the reactor contains a molten salt, the density of the molten salt is smaller than that of the liquid alloy, and the molten salt is used for providing a reaction interface and isolating the liquid alloy from being introduced impurities. The first metal can react with the nitrogen to produce the metal nitride, and the molten salt can provide a new reaction interface for the metal nitride to react with the hydrogen to synthesize the ammonia, so that the metal nitride can continuously generate the ammonia, and the synthesis of the ammonia can be effectively catalyzed.
    Type: Application
    Filed: November 19, 2021
    Publication date: October 5, 2023
    Applicant: ShanghaiTech University
    Inventors: Xiaofei GUAN, Zujian TANG
  • Patent number: 11773145
    Abstract: Provided are chimeric polypeptides that include one or more zinc finger motifs fused to a therapeutic peptide such as botulinum neurotoxins (BoNTs). The zinc finger motif may be located at the C-terminal side of the BoNT and the chimeric polypeptide can optionally include two or more such zinc finger motifs. It said the disclosed chimeric polypeptides can be efficiently delivered to a subject transdermally.
    Type: Grant
    Filed: July 20, 2018
    Date of Patent: October 3, 2023
    Assignee: ShanghaiTech University
    Inventors: Jia Liu, Biao Jiang
  • Patent number: 11771709
    Abstract: A compound of formula (I) and its antitumor application are disclosed. The compounds of formula (I) have degradation and inhibitory effects on ALK target proteins. They are mainly composed of four parts: the first part, ALK-TKI, being compounds with ALK tyrosine kinase inhibitory activity; the second part, LIN, being different kinds of linker (Linker); the third part, the ULM, being a small molecule ligand (ULM, ubiquitin ligase binding moiety) with ubiquitination of VHL, CRBN or other proteases; and the fourth part, the group A, being a carbonyl group or absent, which covalently bond ALK-TKI to LIN, wherein LIN and ULM are covalently bonded. A series of compounds designed and synthesized by the present disclosure have wide pharmacological activities, have functions of degrading ALK protein and inhibiting ALK activity, and can be used for related tumor treatment.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: October 3, 2023
    Assignee: ShanghaiTech University
    Inventors: Xiaobao Yang, Biao Jiang, Xiaoling Song, Haifan Lin, Ning Sun, Jinju Chen, Xing Qiu, Chaowei Ren, Ying Kong