Patents by Inventor Sergey Ioffe

Sergey Ioffe has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210250267
    Abstract: The present disclosure relates to systems and methods for operating transceiver circuitry to transmit or receive signals on various frequency ranges. To do so, an electronic device may determine a receive delay between one or more messages received on different component carriers and may transmit the receive delay to a base station to update how communications are transmitted on one of the component carriers. The update made to at least one of the component carriers may compensate for the receive delay between the different component carriers. Compensating for the receive delay may improve operations that delay downlink communications to reduce a likelihood or stop simultaneous downlink and uplink communications by further adjusting for delays seen at an electronic device when communicating with base stations disposed at a different distances from the electronic device.
    Type: Application
    Filed: June 30, 2020
    Publication date: August 12, 2021
    Inventors: Anatoliy Sergey Ioffe, Elmar Wagner, Jan M. Zaleski, Jie Cui, Yang Tang, Andre Hanke
  • Publication number: 20210250833
    Abstract: The present disclosure relates to systems and methods for operating transceiver circuitry to communicate signals on various frequency ranges based on primary cell and/or secondary cell assignments. A controller associated with the transceiver circuitry may operate a receiver to receive a handover initiation packet using a first frequency range as a primary cell from a base station. The controller may adjust the receiver and a transmitter to use a second frequency range as the primary cell, to adjust the receiver and the transmitter to detach from the first frequency range as the primary cell, and to reset information corresponding to the first frequency range to enable attachment of the first frequency range to a secondary cell.
    Type: Application
    Filed: August 14, 2020
    Publication date: August 12, 2021
    Inventors: Anatoliy Sergey Ioffe, Alexander Sayenko, Jie Cui
  • Publication number: 20210224653
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing inputs using a neural network system that includes a batch normalization layer. One of the methods includes receiving a respective first layer output for each training example in the batch; computing a plurality of normalization statistics for the batch from the first layer outputs; normalizing each component of each first layer output using the normalization statistics to generate a respective normalized layer output for each training example in the batch; generating a respective batch normalization layer output for each of the training examples from the normalized layer outputs; and providing the batch normalization layer output as an input to the second neural network layer.
    Type: Application
    Filed: January 22, 2021
    Publication date: July 22, 2021
    Inventors: Sergey Ioffe, Corinna Cortes
  • Publication number: 20210216870
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing inputs using a neural network system that includes a batch normalization layer. One of the methods includes receiving a respective first layer output for each training example in the batch; computing a plurality of normalization statistics for the batch from the first layer outputs; normalizing each component of each first layer output using the normalization statistics to generate a respective normalized layer output for each training example in the batch; generating a respective batch normalization layer output for each of the training examples from the normalized layer outputs; and providing the batch normalization layer output as an input to the second neural network layer.
    Type: Application
    Filed: January 22, 2021
    Publication date: July 15, 2021
    Inventors: Sergey Ioffe, Corinna Cortes
  • Patent number: 11062181
    Abstract: A neural network system that includes: multiple subnetworks that includes: a first subnetwork including multiple first modules, each first module including: a pass-through convolutional layer configured to process the subnetwork input for the first subnetwork to generate a pass-through output; an average pooling stack of neural network layers that collectively processes the subnetwork input for the first subnetwork to generate an average pooling output; a first stack of convolutional neural network layers configured to collectively process the subnetwork input for the first subnetwork to generate a first stack output; a second stack of convolutional neural network layers that are configured to collectively process the subnetwork input for the first subnetwork to generate a second stack output; and a concatenation layer configured to concatenate the pass-through output, the average pooling output, the first stack output, and the second stack output to generate a first module output for the first module.
    Type: Grant
    Filed: August 26, 2019
    Date of Patent: July 13, 2021
    Assignee: Google LLC
    Inventors: Vincent O. Vanhoucke, Christian Szegedy, Sergey Ioffe
  • Publication number: 20210144706
    Abstract: Systems and methods are disclosed for coordinating transmission and reception of data according to multiple communication standards over a frequency band. In particular, one or more base stations/mobile electronic devices may determine a first data size of first data to be sent conforming to a first communication standard and a second data size of second data conforming to a second communication standard. A first time period may then be determined for which to send the first data based on the first data size, and a second time period may be determined for which to send the second data based on the second data size. In response to determining that the frequency channel is clear of other transmissions, the first data may be sent according to the first standard in the first time period, and the second data may be sent according to the second standard in the second time period.
    Type: Application
    Filed: July 3, 2020
    Publication date: May 13, 2021
    Inventors: Anatoliy Sergey Ioffe, Alexander Sayenko
  • Publication number: 20210136629
    Abstract: An electronic device discussed herein may include radio frequency communication circuitry for communication on a radio frequency network according to a communication configuration, a processor, and memory. The memory may store instructions that, when executed by the processor, cause the electronic device to perform operations including receiving, a first muting configuration indicating when the radio frequency communication circuitry is to communicate using a first type of communication on a first frequency band and when the radio frequency communication circuitry is to communicate using a second type of communication on a second frequency band, where the first frequency band may overlap with the second frequency band. The memory may store instructions that, when executed by the processor, cause the electronic device to perform operations including transmitting or receiving a data packet using the radio frequency communication circuitry according to the communication configuration.
    Type: Application
    Filed: October 27, 2020
    Publication date: May 6, 2021
    Inventors: Anatoliy Sergey Ioffe, Lydi Smaini, Rastislav Vazny, Ronald William Dimpflmaier, Alexander Sayenko
  • Publication number: 20210133565
    Abstract: Aspects of the present disclosure are directed to novel activation functions which enable improved reproducibility and accuracy tradeoffs in neural networks. In particular, the present disclosure provides a family of activation functions that, on one hand, are smooth with continuous gradient and optionally monotonic but, on the other hand, also mimic the mathematical behavior of a Rectified Linear Unit (ReLU). As examples, the activation functions described herein include a smooth rectified linear unit function and also a leaky version of such function. In various implementations, the proposed functions can provide both a complete stop region and a constant positive gradient (e.g., that can be 1) pass region like a ReLU, thereby matching accuracy performance of a ReLU. Additional implementations include a leaky version and/or functions that feature different constant gradients in the pass region.
    Type: Application
    Filed: June 16, 2020
    Publication date: May 6, 2021
    Inventors: Gil Shamir, Dong Lin, Sergey Ioffe
  • Publication number: 20210105607
    Abstract: An electronic device discussed herein may communicatively couple to a base station. The base station may receive a first paging cycle assignment corresponding to a first subscriber identification module (SIM) card and determine a second paging cycle assignment for use with a second SIM card. The second paging cycle assignment may be generated based on the first paging cycle assignment. The base station may communicate with the electronic device using the second paging cycle assignment. The second paging cycle assignment may guide the base station to transmit data to the electronic device without interrupting a transmission made according to the first paging cycle assignment.
    Type: Application
    Filed: July 3, 2020
    Publication date: April 8, 2021
    Inventors: Anatoliy Sergey Ioffe, Alexander Sayenko, Elmar Wagner
  • Patent number: 10956749
    Abstract: Methods, systems, and media for summarizing a video with video thumbnails are provided.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: March 23, 2021
    Assignee: Google LLC
    Inventors: Matthias Grundmann, Alexandra Ivanna Hawkins, Sergey Ioffe
  • Publication number: 20210076349
    Abstract: Systems and methods for using ranging signals with cellular devices. The ranging signals may utilize ranging slots and resources at least partially allocated by a cellular network. The resources may include frequencies used for uplink or downlink communications between the cellular network and the cellular devices. Alternatively, the resources may include frequencies outside of a spectrum used for communication between the cellular network and the cellular devices.
    Type: Application
    Filed: March 19, 2020
    Publication date: March 11, 2021
    Inventors: Anatoliy Sergey Ioffe, Rohit U. Nabar, Rastislav Vazny
  • Publication number: 20210051546
    Abstract: When user equipment (UE) is to be handed over, the network and/or the UE determines a best beam for the UE's interactions with the target cell before the handover is completed. One or more additional next best beams may also be determined. The network (e.g., the target cell) allocates one or more uplink (UL) grants that corresponds to the best beam. Via a current cell, the UE receives the one or more UL grants from the network pertaining to communications between the UE and the target cell. The UE determines whether any beams of the one or more UL grants satisfy beam criteria. The beam criteria may include 1) an allocated beam being the current best beam or 2) an allocated beam being within a strength threshold of the current best beam. If the criteria is not satisfied, the UE initiates another handover type (e.g., a RACH-based handover).
    Type: Application
    Filed: February 25, 2020
    Publication date: February 18, 2021
    Inventors: Alexander Sayenko, Anatoliy Sergey Ioffe
  • Patent number: 10902319
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing inputs using a neural network system that includes a batch normalization layer. One of the methods includes receiving a respective first layer output for each training example in the batch; computing a plurality of normalization statistics for the batch from the first layer outputs; normalizing each component of each first layer output using the normalization statistics to generate a respective normalized layer output for each training example in the batch; generating a respective batch normalization layer output for each of the training examples from the normalized layer outputs; and providing the batch normalization layer output as an input to the second neural network layer.
    Type: Grant
    Filed: September 16, 2019
    Date of Patent: January 26, 2021
    Assignee: Google LLC
    Inventors: Sergey Ioffe, Corinna Cortes
  • Publication number: 20200250543
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for implementing a neural network. In one aspect, the neural network includes a batch renormalization layer between a first neural network layer and a second neural network layer. The first neural network layer generates first layer outputs having multiple components. The batch renormalization layer is configured to, during training of the neural network on a current batch of training examples, obtain respective current moving normalization statistics for each of the multiple components and determine respective affine transform parameters for each of the multiple components from the current moving normalization statistics. The batch renormalization layer receives a respective first layer output for each training example in the current batch and applies the affine transform to each component of a normalized layer output to generate a renormalized layer output for the training example.
    Type: Application
    Filed: April 21, 2020
    Publication date: August 6, 2020
    Inventor: Sergey Ioffe
  • Publication number: 20200234127
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing images or features of images using an image classification system that includes a batch normalization layer. One of the systems includes a convolutional neural network configured to receive an input comprising an image or image features of the image and to generate a network output that includes respective scores for each object category in a set of object categories, the score for each object category representing a likelihood that that the image contains an image of an object belonging to the category, and the convolutional neural network comprising: a plurality of neural network layers, the plurality of neural network layers comprising a first convolutional neural network layer and a second neural network layer; and a batch normalization layer between the first convolutional neural network layer and the second neural network layer.
    Type: Application
    Filed: April 1, 2020
    Publication date: July 23, 2020
    Inventors: Sergey Ioffe, Corinna Cortes
  • Patent number: 10685278
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing long-short term memory cells with saturating gating functions. One of the systems includes a first Long Short-Term Memory (LSTM) cell, wherein the first LSTM cell is configured to, for each of the plurality of time steps, generate a new cell state and a new cell output by applying a plurality of gates to a current cell input, a current cell state, and a current cell output, each of the plurality of gates being configured to, for each of the plurality of time steps: receive a gate input vector, generate a respective intermediate gate output vector from the gate input, and apply a respective gating function to each component of the respective intermediate gate output vector, wherein the respective gating function for at least one of the plurality of gates is a saturating gating function.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: June 16, 2020
    Assignee: Google LLC
    Inventors: Sergey Ioffe, Raymond Wensley Smith
  • Patent number: 10671922
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for implementing a neural network. In one aspect, the neural network includes a batch renormalization layer between a first neural network layer and a second neural network layer. The first neural network layer generates first layer outputs having multiple components. The batch renormalization layer is configured to, during training of the neural network on a current batch of training examples, obtain respective current moving normalization statistics for each of the multiple components and determine respective affine transform parameters for each of the multiple components from the current moving normalization statistics. The batch renormalization layer receives a respective first layer output for each training example in the current batch and applies the affine transform to each component of a normalized layer output to generate a renormalized layer output for the training example.
    Type: Grant
    Filed: July 1, 2019
    Date of Patent: June 2, 2020
    Assignee: Google LLC
    Inventor: Sergey Ioffe
  • Patent number: 10628710
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing images or features of images using an image classification system that includes a batch normalization layer. One of the systems includes a convolutional neural network configured to receive an input comprising an image or image features of the image and to generate a network output that includes respective scores for each object category in a set of object categories, the score for each object category representing a likelihood that that the image contains an image of an object belonging to the category, and the convolutional neural network comprising: a plurality of neural network layers, the plurality of neural network layers comprising a first convolutional neural network layer and a second neural network layer; and a batch normalization layer between the first convolutional neural network layer and the second neural network layer.
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: April 21, 2020
    Assignee: Google LLC
    Inventors: Sergey Ioffe, Corinna Cortes
  • Publication number: 20200057924
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing images or features of images using an image classification system that includes a batch normalization layer. One of the systems includes a convolutional neural network configured to receive an input comprising an image or image features of the image and to generate a network output that includes respective scores for each object category in a set of object categories, the score for each object category representing a likelihood that that the image contains an image of an object belonging to the category, and the convolutional neural network comprising: a plurality of neural network layers, the plurality of neural network layers comprising a first convolutional neural network layer and a second neural network layer; and a batch normalization layer between the first convolutional neural network layer and the second neural network layer.
    Type: Application
    Filed: December 19, 2018
    Publication date: February 20, 2020
    Inventors: Sergey Ioffe, Corinna Cortes
  • Publication number: 20200012942
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing inputs using a neural network system that includes a batch normalization layer. One of the methods includes receiving a respective first layer output for each training example in the batch; computing a plurality of normalization statistics for the batch from the first layer outputs; normalizing each component of each first layer output using the normalization statistics to generate a respective normalized layer output for each training example in the batch; generating a respective batch normalization layer output for each of the training examples from the normalized layer outputs; and providing the batch normalization layer output as an input to the second neural network layer.
    Type: Application
    Filed: September 16, 2019
    Publication date: January 9, 2020
    Inventors: Sergey Ioffe, Corinna Cortes