Abstract: An expression feedback method and a smart robot, belonging to smart devices. The method comprises: step S1, a smart robot using an image collection apparatus to collect image information; step S2, the smart robot detecting whether human face information representing a human face exists in the image information; if so, acquiring position information and size information associated with the human face information, and then turning to step S3; and if not, returning to step S1; step S3, according to the position information and the size information, obtaining, by prediction, a plurality of pieces of feature point information in the human face information and outputting same; and step S4, using a first identification model formed through pre-training, determining whether the human face information represents a smiling face according to the feature point information, and then exiting from this step; if so, the smart robot outputting preset expression feedback information; and if not, exiting from this step.

Abstract: Aspects for active alignment for assembling optical imaging systems are described herein. As an example, the aspects may include aligning an optical detector with an optical component. The optical component is configured to alter a direction of one or more light beams emitted from an image displayed by an optical engine. The aspects may further include detecting, by the optical detector, a virtual image generated by the one or more light beams emitted by the optical engine; and adjusting, by a multi-axis controller, an optical path of the one or more light beams based on one or more parameters of the virtual image collected by the optical detector.

Abstract: Aspects for active alignment for assembling optical imaging systems are described herein. As an example, the aspects may include aligning an optical detector with an optical component. The optical component is configured to alter a direction of one or more light beams emitted from an image displayed by an optical engine. The aspects may further include detecting, by the optical detector, a virtual image generated by the one or more light beams emitted by the optical engine; and adjusting, by a multi-axis controller, an optical path of the one or more light beams based on one or more parameters of the virtual image collected by the optical detector.

Abstract: The present invention relates to a device, method, and smart glasses for color vision deficiency correction. The method includes: adjusting a color of an image according to an environmental color temperature to obtain an adjusted image, and then adjusting a pixel level of the adjusted image to a preset pixel level according to image content, to obtain a to-be-processed image; determining an adjustment matrix based on an RGB value of the to-be-processed image and a preset RGB target value; comparing a color displayed on a display with a color of a standard colorimetric card for correction, to determine an adjustment mapping table; and generating a target image based on the to-be-processed image, the adjustment matrix, and the adjustment mapping table. The present invention increases the degree of color recognition and improves imaging effects, and can implement good color vision deficiency correction.

Abstract: Aspects for active alignment for assembling optical imaging systems are described herein. As an example, the aspects may include aligning an optical detector with an optical component. The optical component is configured to alter a direction of one or more light beams emitted from an image displayed by an optical engine. The aspects may further include detecting, by the optical detector, a virtual image generated by the one or more light beams emitted by the optical engine; and adjusting, by a multi-axis controller, an optical path of the one or more light beams based on one or more parameters of the virtual image collected by the optical detector.

Abstract: Aspects of a mobile device integrated visual enhancement system are described herein. The aspects may include a wearable display headset that includes one or more display modules and a mobile device communicatively connected with the wearable display headset. The mobile device may include a first screen, a display detection module configured to detect the one or more display modules and receive display parameters from the wearable display headset, and a content delivery module configured to deliver visual content on the one or more detected display modules in accordance with the display parameters.

Abstract: The present invention relates to an information display method and system, and a terminal. The method includes: collecting a visual signal in a target area of a display device by using an augmented reality device; judging a user reading scene according to the visual signal; generating a first signal according to the user reading scene; generating a second signal after processing the first signal; collecting a target parameter of the display device; generating a display signal after fusing the second signal with the target parameter; and performing information display on a display interface of the augmented reality device according to the display signal. By adopting the information display method and system, and the terminal of the present invention, the reading efficiency of the user may be improved.

Abstract: The present invention relates to a microphone array based pickup method, comprising: performing voice activation detection using one channel voice signal among multichannel voice signals picked up and output by a microphone array, and determining if a voice activation signal occurs; locating the voice source by using the multichannel voice signals output by the microphone array to obtain the voice source locating direction; enhancing a voice signal in the voice source locating direction to obtain an enhanced voice signal; conducting voice wakeup detection on the enhanced voice signal and determining if a voice wakeup is detected; picking up and outputting the multichannel voice signals by the microphone array; Step 6: processing the multichannel voice signals picked up by the microphone array into one channel enhanced voice, and outputting the one channel enhanced voice as a finally picked up voice.

Abstract: The present invention relates to a virtual image distance measurement method, apparatus and device. The method includes: disposing a light blocking element, a lens element and an imaging element along the optical axis of the lens element in sequence, wherein a light transmitting portion is formed on the light blocking element, and the virtual image position of a measured near-eye display does not coincide with the imaging position of the lens element; presenting, by a virtual image of the measured near-eye display, multiple images on the imaging element after passing through the light blocking element and the lens element; and determining a distance measurement parameter based on the multiple images, and substituting the distance measurement parameter into a preset distance calculation formula to obtain a virtual image distance.

Abstract: The invention discloses a multi-language mixed speech recognition method, which belongs to the technical field of speech recognition; the method comprises: step S1, configuring a multi-language mixed dictionary including a plurality of different languages; step S2, performing training according to the multi-language mixed dictionary and multi-language speech data including a plurality of different languages to form an acoustic recognition model; step S3, performing training according to multi-language text corpus including a plurality of different languages to form a language recognition model; step S4, forming the speech recognition system by using the multi-language mixed dictionary, the acoustic recognition model and the language recognition model; and subsequently, recognizing mixed speech by using the speech recognition system, and outputting a corresponding recognition result.

Abstract: An expression feedback method and a smart robot, belonging to smart devices. The method comprises: step S1, a smart robot using an image collection apparatus to collect image information; step S2, the smart robot detecting whether human face information representing a human face exists in the image information; if so, acquiring position information and size information associated with the human face information, and then turning to step S3; and if not, returning to step S1; step S3, according to the position information and the size information, obtaining, by prediction, a plurality of pieces of feature point information in the human face information and outputting same; and step S4, using a first identification model formed through pre-training, determining whether the human face information represents a smiling face according to the feature point information, and then exiting from this step; if so, the smart robot outputting preset expression feedback information; and if not, exiting from this step.

Abstract: An imaging display system in the field of augmented reality technology comprises a waveguide structure (14) disposed on an outer surface of an exit surface (7) of a polarization beam splitter (3) of an optical engine module (A). The waveguide structure is tubular. One end (15) of the waveguide structure is connected to the exit surface and together with the exit surface forms a preset angle (?). The other end of the waveguide structure is a free end. The imaging display system expands an eye motion box (EMB) by means of the waveguide structure. The preset angle formed between the waveguide structure and the exit surface causes light (22) incident on the waveguide structure to undergo total internal reflection inside the waveguide structure.

Abstract: The invention discloses a training method and a speech recognition method for a mixed frequency acoustic recognition model, which belongs to the technical field of speech recognition.

Abstract: A human face detection method, falling within the technical field of image detection. The method comprises: respectively determining a plurality of pieces of human face characteristic information in a plurality of pre-input human face training samples, and training and forming a characteristic prediction model according to all the pieces of human face characteristic information in each of the human face training samples.

Abstract: The present invention falls within the technical field of robots, and particularly relates to a robot monitoring system. The robot monitoring system based on human body information comprises an image collection unit for collecting an image; a human body detection unit for determining whether human body information matching a training sample exists in the image; a target acquisition unit for acquiring position information and size information about the human body information in the image; a target tracking unit for acquiring a current motion region according to a frame difference between the image and a predetermined image frame and acquiring a moving target from the motion region; and an adjustment unit for adjusting the orientation of the image collection unit such that the moving target is located in the centre of the image.

Abstract: Disclosed are a control information interaction method and a smart robot, falling within the technical field of smart devices. The method comprises: step S1, a user inputting control information to a user end; step S2, the user end forming alternative information having a preset form according to the control information and outputting same; step S3, the smart robot receiving the alternative information, and performing parsing according to the alternative information to obtain corresponding parsed information; and step S4, the smart robot performing restoration according to the parsed information to obtain the control information, and executing a corresponding operation according to the control information. The beneficial effects of the technical solution are: being capable of making human-machine interaction between a user and a smart robot more convenient and rapid, and ensuring the accuracy of information interaction.

Abstract: An imaging display system in the field of augmented reality technology comprises a waveguide structure (14) disposed on an outer surface of an exit surface (7) of a polarization beam splitter (3) of an optical engine module (A). The waveguide structure is tubular. One end (15) of the waveguide structure is connected to the exit surface and together with the exit surface forms a preset angle (a). The other end of the waveguide structure is a free end. The imaging display system expands an eye motion box (EMB) by means of the waveguide structure. The preset angle formed between the waveguide structure and the exit surface causes light (22) incident on the waveguide structure to undergo total internal reflection inside the waveguide structure.

Abstract: Aspects for a wearable augmented reality (AR) device are described herein. The aspects may include a light engine that includes a micro-display configured to emit light to form an image, a polarized beam splitter positioned horizontally adjacent to the micro-display and configured to receive the emitted light that passes through the polarized beam splitter, and one or more first imaging lenses positioned horizontally adjacent to the polarized beam splitter and configured to receive the diverged light. One of the first imaging lenses may include a reflection surface configured to reflect and converge the light. The polarized beam splitter may include a reflective coating configured to reflect the converged light. The aspects may further include an optical waveguide configured to guide the converged light to a predetermined position.