Abstract: Provided are improved end-to-end self-supervised pre-training frameworks that leverage a combination of contrastive and masked modeling loss terms. In particular, the present disclosure provides framework that combines contrastive learning and masked modeling, where the former trains the model to discretize input data (e.g., continuous signals such as continuous speech signals) into a finite set of discriminative tokens, and the latter trains the model to learn contextualized representations via solving a masked prediction task consuming the discretized tokens. In contrast to certain existing masked modeling-based pre-training frameworks which rely on an iterative re-clustering and re-training process or other existing frameworks which concatenate two separately trained modules, the proposed framework can enable a model to be optimized in an end-to-end fashion by solving the two self-supervised tasks (the contrastive task and masked modeling) simultaneously.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-readable storage media, for speech recognition using attention-based sequence-to-sequence models. In some implementations, audio data indicating acoustic characteristics of an utterance is received. A sequence of feature vectors indicative of the acoustic characteristics of the utterance is generated. The sequence of feature vectors is processed using a speech recognition model that has been trained using a loss function that uses a set of speech recognition hypothesis samples, the speech recognition model including an encoder, an attention module, and a decoder. The encoder and decoder each include one or more recurrent neural network layers. A sequence of output vectors representing distributions over a predetermined set of linguistic units is obtained. A transcription for the utterance is obtained based on the sequence of output vectors. Data indicating the transcription of the utterance is provided.

Abstract: An integrated electronic switch includes an input unit and a circuit board. The input unit is configured to receive a drive signal output by a user. A sensing module for sensing the drive signal transmitted from the input unit, and a control module electrically connected to the sensing module are disposed on the circuit board, where the sensing module and the control module are disposed on a first side surface of the circuit board.

Abstract: A system and method for managing security credentials of a user are disclosed. The method includes establishing a connection with a local web browser hosted on a user device. The method also includes receiving a request for accessing a web application on the local web browser hosted on the user device. The method also includes determining whether current web page associated with the web application on the local web browser requires authentication of the user. Further, the method includes determining a password policy. Furthermore, the method includes authenticating the user on the web page using pre-stored user credentials based on the determined password policy. Additionally, the method includes routing the web page of the local web browser to the web application via an intermediate web browser. Also, the method includes providing access of the web application to the local web browser based on privileges associated with the user.

Abstract: A system and method for managing security credentials of a user are disclosed. The method includes establishing a connection with a local web browser hosted on a user device. The method also includes receiving a request for accessing a web application on the local web browser hosted on the user device. The method also includes determining whether current web page associated with the web application on the local web browser requires authentication of the user. Further, the method includes determining a password policy. Furthermore, the method includes authenticating the user on the web page using pre-stored user credentials based on the determined password policy. Additionally, the method includes routing the web page of the local web browser to the web application via an intermediate web browser. Also, the method includes providing access of the web application to the local web browser based on privileges associated with the user.

Abstract: An integrated electronic switch includes an input unit and a circuit board. The input unit is configured to receive a drive signal output by a user. A sensing module for sensing the drive signal transmitted from the input unit, and a control module electrically connected to the sensing module are disposed on the circuit board, where the sensing module and the control module are disposed on a first side surface of the circuit board.

Abstract: The invention provides an umbrella-shaped anchor for rapid reinforcement of rock mass. The umbrella-shaped anchor for rapid reinforcement of the rock mass comprises an umbrella-shaped anchor head and a connecting rod. The umbrella-shaped head comprises the sliding mechanism, bearing block, guide block and main rod of anchor head. The main rod of anchor head is connected with the sliding mechanism after passing through the through-hole located in the middle of the guide block The sliding mechanism is connected with the connecting rod through the main rod of the anchor head.

Abstract: The invention provides an umbrella-shaped anchor for rapid reinforcement of rock mass. The umbrella-shaped anchor for rapid reinforcement of the rock mass comprises an umbrella-shaped anchor head and a connecting rod. The umbrella-shaped head comprises the sliding mechanism, bearing block, guide block and main rod of anchor head. The main rod of anchor head is connected with the sliding mechanism after passing through the through-hole located in the middle of the guide block The sliding mechanism is connected with the connecting rod through the main rod of the anchor head.

Abstract: Enforcing a policy based at least in part on URL information is disclosed. A request to access a first uniform resource locator (URL) is received from a client device. A portion of the first URL, or a transformation thereof, is matched against a bloom filter. A first query is performed using the matched portion of the received first URL, and, in response to receiving a “no match” response to the first query, a second query that is different from the first query is performed. A policy is enforced based at least in part on a category received as a result of a second query.

Abstract: Enforcing a policy based at least in part on URL information is disclosed. A uniform resource locator (URL) is received. A portion of the URL, or a transformation thereof, is matched against a bloom filter. Based on a result of the match, a first query is performed. A policy is enforced based at least in part on a category received as a result of a second query. In some cases, the first and second query are the same.

Abstract: Methods, systems, and apparatus, including computer program products, featuring receiving at a network device a plurality of packets associated with a flow, one or more of the plurality of packets having associated header data and content. Based on the content of one or more first packets in the plurality of packets, the network device identifies an application associated with the flow, where none of the first packets is addressed to the network device. For one or more second packets associated with the flow, the network device determines a forwarding destination for the second packets based on the application associated with the flow and forwards the packet according to the determined forwarding destination.

Abstract: Methods, systems, and apparatus, including computer program products, featuring receiving at a network device a plurality of packets associated with a flow, one or more of the plurality of packets having associated header data and content. Based on the content of one or more first packets in the plurality of packets, the network device identifies an application associated with the flow, where none of the first packets is addressed to the network device. For one or more second packets associated with the flow, the network device determines a forwarding destination for the second packets based on the application associated with the flow and forwards the packet according to the determined forwarding destination.

Abstract: Methods, systems, and apparatus, including computer program products, featuring receiving at a network device a plurality of packets associated with a flow, one or more of the plurality of packets having associated header data and content. Based on the content of one or more first packets in the plurality of packets, the network device identifies an application associated with the flow, where none of the first packets is addressed to the network device. For one or more second packets associated with the flow, the network device determines a forwarding destination for the second packets based on the application associated with the flow and forwards the packet according to the determined forwarding destination.

Abstract: Methods, systems, and apparatus, including computer program products, featuring receiving at a network device a plurality of packets associated with a flow, one or more of the plurality of packets having associated header data and content. Based on the content of one or more first packets in the plurality of packets, the network device identifies an application associated with the flow, where none of the first packets is addressed to the network device. For one or more second packets associated with the flow, the network device determines a forwarding destination for the second packets based on the application associated with the flow and forwards the packet according to the determined forwarding destination.

Abstract: A network device implements congestion management of sessions of a network protocol. In one implementation, an incoming request component receives session requests for a negotiation session between the network device and a second network device. A capacity pool stores a value relating to capacity of the network device to continue to efficiently process the session requests. New sessions are initiated when the value stored in the capacity pool is less than an estimate of the capacity of the network device at which the network device maximizes processor usage while minimizing session timeouts.

Abstract: A system establishes a virtual private network (VPN) tunnel to a destination and determines a next hop for the VPN tunnel. The system inserts the next hop, and an address associated with the destination, into an entry of a first table. The system inserts the next hop, and a tunnel identifier corresponding to the established VPN tunnel, into an entry of a second table. The system associates one or more security parameters, used to encrypt traffic sent via the VPN tunnel, with the tunnel identifier.

Abstract: Methods of screening incoming packets are provided. A first firewall detects a tunnel formation. A second firewall maintains a list of open firewall sessions. Each tunnel has one or more associated firewall sessions. The first firewall detects variable situations, such as when the tunnel is torn down, and notifies the second firewall so that, for example, the second firewall can act to clear an associated firewall session from the firewall session list. Incoming packets that are associated with firewall sessions that have been cleared from the firewall session list may not be passed through the second firewall.

Abstract: A network device is described in which a dedicated resource scheduler monitors memory consumption to provide for improved processing of communication sessions. The scheduler maintains a dependency list of communication sessions, and reserves memory for communication sessions as requests for memory are received. The amount of memory reserved is determined based on the amount of memory currently reserved for the communication sessions in the dependency list. The network device may control ongoing communication sessions by way of window manipulation. Communication sessions are processed in a first mode when available memory has not reached a predetermined amount, while communication sessions are processed in a second mode when available memory reaches a predetermined amount.

Abstract: A system establishes a virtual private network (VPN) tunnel to a destination and determines a next hop for the VPN tunnel. The system inserts the next hop, and an address associated with the destination, into an entry of a first table. The system inserts the next hop, and a tunnel identifier corresponding to the established VPN tunnel, into an entry of a second table. The system associates one or more security parameters, used to encrypt traffic sent via the VPN tunnel, with the tunnel identifier.

Abstract: A network device is described in which a dedicated resource scheduler monitors memory consumption to provide for improved processing of communication sessions. The scheduler maintains a dependency list of communication sessions, and reserves memory for communication sessions as requests for memory are received. The amount of memory reserved is determined based on the amount of memory currently reserved for the communication sessions in the dependency list. The network device may control ongoing communication sessions by way of window manipulation. Communication sessions are processed in a first mode when available memory has not reached a predetermined amount, while communication sessions are processed in a second mode when available memory reaches a predetermined amount.