Abstract: Aspects of the present disclosure relates to user interface systems and methods for use in head-worn computing systems.

Abstract: In a virtual or augmented reality system, a module with multiple contact points may provide haptic output associated with a virtual object being held or manipulated by a user's hand. A drone-like airborne device may keep such a module hovering close to the user and provide just-in-time contact and other types of haptic feedback when needed. The user experiences virtual objects with a head-mounted display and such a module that delivers multidimensional haptic feedback, including but not limited to, contact, surface stiffness, surface texture, and thermal properties of the virtual object that is in contact with the user's hand and fingers. The propellers on the drone device provide full six-degrees-of-freedom (6-DOF) force and torque feedback to the user via such a module attached to the airborne system. In some implementation, the user wears a wrist band that docks with such a module via magnets on both the wrist band and the module.

Abstract: A toroidal actuator is responsive to a teleoperator for providing haptic feedback responsive to a curvature or articulated movement applied to a gripped object. The toroidal actuator surrounds an operator member such as a finger, and is responsive to pneumatic pressure for increasing telepresence force defined by resistance encounter against a teleoperated robotic claw. As the teleoperated claw grips an object, increased pneumatic pressure in the toroidal actuator tends to elongate the toroidal shape in a linear manner and oppose a curvature force applied by an inserted operator finger. Resistive force is based on soft sensing of the gripped object, thus the toroidal actuator applies an increasing resistive force to curvature as the robotic claw closes around a gripped object by solenoid regulated air pressure. A typical assembly includes at least 3 toroidal actuators for two digits and a thumb of an operator.

Abstract: A method and apparatus providing a haptic monitor system capable of generating haptic cues based on sensed information are disclosed. The haptic system includes a sensing device, a digital processing unit, and a haptic generator. The sensing device is configured to selectively sense an individual's or user vital information via one or more wearable sensors, and subsequently forwards the sensed vital information to the digital processing unit for data processing. Upon receipt of the vital information, the digital processing unit provides a haptic signal in response to the vital information. The haptic generator, subsequently, generates haptic feedback in accordance with the haptic signal.

Abstract: A touch-enabled device can simulate one or more features in a touch area. Features may include, but are not limited to, changes in texture and/or simulation of boundaries, obstacles, or other discontinuities in the touch surface that can be perceived through use of an object in contact with the surface. Systems include a sensor configured to detect a touch in a touch area when an object contacts a touch surface, an actuator, and one or more processors. The processor can determine a position of the touch using the sensor and select a haptic effect to generate based at least in part on the position, the haptic effect selected to simulate the presence of a feature at or near the determined position. Some features are simulated by varying the coefficient of friction of the touch surface.

Abstract: Methods, systems and media are provided for hands-free operation of an appliance. For example, the appliance may detect input from a hands-free user, where the detected input is voice or gesticular. The appliance may compare the detected input to known inputs and retrieving the user's profile based on the detected input corresponding to a known input. Based upon retrieval of the user's profile, the appliance may output recognition of the user input and modify operation of a burner according to both the user input and the retrieved user profile. Based upon the detected input being unrecognized, the appliance may create a new user profile associated with the detected input and modify operation of a burner according to the detected input.

Abstract: In one example, a system may include a display including a display screen; a display controller configured to display visual information on the display screen of the display screen, control at least portions of one or more pixels corresponding to the display screen to render the display screen transparent; and a depth camera, positioned behind the display screen, that is configured to obtain depth image information of one or more objects in front of the display screen when at least portions of the one or more pixels are rendered transparent.

Abstract: A modular display monitor system includes an interchangeable display panel with a panel interface and an interchangeable connector module that has a connecting dock and a connector for interfacing with the panel interface. A user-configurable key comprising a key support mechanical linkage having at least one hinge mounted to a key support surface, a rocker panel operatively coupled to the key support mechanical linkage and including a ferromagnetic portion, a magnet and a magnet holding plate slidably disposed along the key support surface. The magnet holding plate is adjusted via a magnet holding plate position adjuster for sliding the magnet holding plate to move the magnet with respect to a pivot of the rocker panel.

Abstract: An image display apparatus includes a display configured to display a first image corresponding to a region of a 360-degree image, and to display an indicator in a three-dimensional (3D) shape including a pointer pointing to a location of the region, a sensor configured to sense an input for moving the region, and a controller configured to control movement of the region and to display a second image corresponding to a region to which the region has been moved, and to move the pointer within the indicator based on the movement of the region. The pointer is movable in an altitudinal direction and an azimuthal direction within the indicator.

Abstract: A display device including an image input unit that receives image data from an image supply device, a display unit that displays a display image on a display surface based on image data, a location detection unit that detects a pointed location with respect to the display image on the display surface, a coordinate calculation unit that calculates first coordinates as coordinates of the pointed location in a displayable area on the display surface, a drawing unit that draws an image based on the first coordinates calculated by the coordinate calculation unit, and an output unit that outputs the coordinates to the image supply device based on the first coordinates.

Abstract: Disclosed is a mouse action capture and replay method, including the following steps: reading, by a capture and replay verification module, a mouse movement signal in a mouse action event file; transmitting, by the capture and replay verification module, the mouse movement signal to a system under test to which replay is applied; regularly sending, by the capture and replay verification module, an image capture signal to an image capture module, capturing, by the image capture module, a screenshot from the system under test to which replay is applied, and converting the screenshot to a screenshot image file to be transmitted to the capture and replay verification module; comparing, by the capture and replay verification module, an earlier captured screenshot image file with a later captured screenshot image file, so as to acquire a position of a cursor on a screen of the system under test to which replay is applied; and determining, by the capture and replay verification module according to the acquired posit

Abstract: A contact unit includes a plurality of areas capable of exciting a surface of a touch panel individually. A control unit controls a state of the plurality of areas individually based on a pre-stored excitation pattern when a user control unit is used. The excitation pattern describes a state transition pattern of the plurality of areas corresponding to a track of a multi-touch gesture such as a pinch-out gesture and a pinch-in gesture.

Abstract: To provide a technology capable of calculating a position of an image displayed on a screen more flexibly. Provided is an information processing device including: a first reception unit configured to receive a first signal from a first input device; a second reception unit configured to receive a second signal different from the first signal from a second input device; a calculation unit configured to calculate a position of an image to be displayed on a screen on the basis of the first or second signal; and a display control unit configured to display the image at the position. The calculation unit has a first mode in which the position of the image is calculated on the basis of the first signal and a second mode in which the position of the image is calculated on the basis of the second signal, and switches a mode from the first mode to the second mode when a user manipulation event is detected in the first mode.

Abstract: A pointing system including: a pointing device including an operation portion and a light-emitting portion that emits light according to an operation to the operation portion; and a control device including an image pickup portion that picks up light from the light-emitting portion when the light-emitting portion emits light and outputs an image including information on a light spot of the light, a display portion that includes a screen and displays a pointer on the screen, and a control portion that judges, as well as judge a movement of the light spot based on the information on the light spot in the image and move the pointer on the screen based on the movement of the light spot, whether the light spot is turned off based on the information on the light spot in the image and executes processing related to a click when the light spot is turned off.

Abstract: Aspects of the present disclosure relates to user interface systems and methods for use in head-worn computing systems.

Abstract: Disclosed are a mobile device and a method of operating the mobile device. A mobile device according to an embodiment includes a sensing unit configured to determine whether a stylus pen is separated from the mobile device, a communication unit configured to receive a control signal from the stylus pen separated from the mobile device, and a controller configured to operate in a first control mode for performing at least one operation of an application being executed on the mobile device, in response to the control signal.

Abstract: Various embodiments provide an electronic pen that ensures security of information, avoids of unnecessary transmission of information, and protects a core body. In one embodiment, the electronic pen includes a core body, a signal transmitter that transmits a signal to a sensor of a position detecting device, a protector that sets at least a tip of the core body to the state of being not exposed to an external environment, and a detector that detects whether or not at least the tip of the core body is in the state of being protected by the protector. A signal including information is allowed to be transmitted from the signal transmitter when at least the tip of the core body is not protected by the protector, and is precluded from being transmitted when at least the tip of the core body is protected by the protector.

Abstract: A stylus device for interacting with a computer is disclosed. The stylus device can comprise an operational circuit, an operational switch for activating and deactivating the operational circuit, and a driving and sensing circuit configured for driving a voltage supply to the operational circuit and sensing a state of the operational switch, wherein the driving and the sensing are executed intermittently on an electrical conductor.

Abstract: Embodiments of a circuit and a stylus for interacting with a capacitive sensor are disclosed. The stylus includes a stylus body, a circuit disposed within the stylus body, a tip, and a power source. The circuit includes an input terminal, an amplifier, and an output terminal. The tip includes a sensing electrode and an emitting electrode, and the tip is disposed on a proximal end of the stylus body. The power source is electrically coupled to the circuit. The input terminal of the circuit is electrically coupled to the sensing electrode of the tip, and the output terminal of the circuit is electrically coupled to the emitting electrode of the tip. The circuit receives a signal through the sensing electrode, amplifies and inverts the signal, and outputs the signal through the emitting electrode. The amplifier of the circuit amplifies only a portion of the signal that exceeds a threshold voltage.

Abstract: A method includes generating a first signal type and a second signal type in a handheld device and transmitting both the first signal type and the second signal type in a transmission cycle of the handheld device. The first signal type and the second signal type are different in at least one of frequency or modulation and are defined to include a same information related to the handheld device.

Abstract: An input apparatus includes a conductive layer having flexibility, a plurality of structures, a reaction force of which is non-linearly changed with respect to a pressing amount, a capacitance-type sensor layer, and an intermediate layer disposed between the plurality of structures and the sensor layer. The intermediate layer has a plurality of hole portions into which the plurality of structures is pressed, respectively.

Abstract: An electronic device including a plurality of the microphones and operating method thereof are disclosed. The present invention includes obtaining an audio according to a touch input of touching at least one of a plurality of the microphones, determining at least one selected from the group consisting of a location, a touch pattern, a touch strength, a touch duration time and a touch periodicity of the touch input based on the obtained audio, and performing an operation corresponding to the touch input based on a result of the determination.

Abstract: A method is disclosed for determining detecting a conductive object and determining the type of object and the type of contact that object has with a touch sensitive surface, the method comprising measuring capacitance on a plurality of mutual capacitance sensors, each mutual capacitance sensor corresponding to a unit cell in an array of unit cells. After mutual capacitance is measured a peak unit cell is identified based on the measured capacitances and a matrix sum of a plurality of unit cells surround the peak unit cell is calculated. The value of the peak unit cell and the matrix sum are then compared to a range and a contact type determined based on the comparison.

Abstract: A touch display panel, methods for manufacturing and driving the touch display panel and a display device are provided. The touch display panel includes an array substrate including matrix-arranged touch electrodes and matrix-arranged pixel units. Each touch electrode includes multiple common electrodes. One touch lead is arranged between every two adjacent columns of pixel units. Each touch electrode is connected to a pin of the touch chip via a corresponding touch lead. The common electrodes further function as the touch electrodes in a touch phase.

Abstract: Provided is an optically transparent conductive material which does not cause moire even when placed over a liquid crystal display, and has a favorable optical transparency and a high reliability. The optically transparent conductive material has, on an optically transparent support, an optically transparent conductive layer having a sensor part electrically connected to a terminal part and a dummy part not electrically connected to the terminal part, and the sensor part and/or the dummy part is formed of a metal pattern having a mesh shape obtained by enlarging or reducing a Voronoi diagram in an arbitrary direction.

Abstract: To reduce disturbances in display of images due to static electricity without deteriorating optical properties in a display. The display includes a conductive pattern provided on the upper surface of the substrate, a protection layer provided on the upper surface of the substrate to cover the conductive pattern, and a conductive layer provided on the protection layer. The sheet resistance of the conductive pattern is not more than 8Q/square. A ratio of the total sum of areas of portions of the plurality of sub-pixels that overlap the conductive pattern in a plan view to the total sum of the areas of the plurality of sub-pixels is 1 to 22%. A sheet resistance of the conductive layer is higher than the sheet resistance of the conductive pattern.

Abstract: Disclosed embodiments relate to a force detection system that detects force exerted on a flexible display based upon changes in resistance and/or capacitance. In one embodiment, a method includes measuring a baseline comprising a baseline resistance or a baseline capacitance or both of a force measurement layer disposed within or overlaid on the display panel. The method further includes detecting a change in the baseline resistance or the baseline capacitance or both and calculating a change location where the change in the baseline resistance or the baseline capacitance or both occurred. The method also includes calculating a magnitude of the change in the baseline resistance or the baseline capacitance or both.

Abstract: A TouchPhrase interface environment captures and stores complex and variable data from a user in a rapid, robust, adaptable, and structured manner. The TouchPhrase interface environment includes a display of a document, and the document includes one or more contextual objects. Each contextual object is responsive to an input of a user changing the content of the contextual object, and adds or removes from the document one or more contextual objects. The one or more contextual objects are added or removed in accordance with the content of the contextual object mapped to a definition in a domain specific knowledge for the document and in response to external applications monitoring the contextual objects. The TouchPhrase interface environment is applicable to all types of domains including healthcare, point-of-sale, legal, financial, and other services. The document and the contextual objects are saved to a database and accessible by other external applications.

Abstract: Systems and methods for providing feedback to a user are described. One of the methods includes sending interactive data for rendering on a head mounted display (HMD). The HMD is configured for attachment to a head of a user for playing a game. The method further includes receiving image data associated with a body part of the user while the HMD is worn by the user and the HMD renders interactive content. The method includes tracking a spatial position associated with the body part of the user from the image data of the user. In the method, physical placement of a remote-controlled device at the spatial position associated with the body part of the user is rendered in the HMD as virtual contact with an object in the interactive content.

Abstract: A field computer for use in an agricultural vehicle is provided. The field computer includes a housing, a processor disposed within the housing, a touchscreen display operatively connected to the housing and the processor and forming an outer surface of the field computer, and a light bar comprising a plurality of lighting elements arranged in a line on the field computer. The lighting elements of the light bar are positioned such that the lighting elements remain hidden when not in use. The field computer is configured to provide feedback associated with operation of the agricultural vehicle by lighting one or more of the lighting elements in the light bar.

Abstract: The present disclosure provides a touch display having a force touch function. The touch display includes a backlight module, a liquid display panel and a force touch sensing circuit. The backlight module is configured to output light and includes a metal layer and a sensing layer. The liquid display panel includes a plurality of data lines and a plurality of gate lines. The force touch sensing circuit is electrically connected to a plurality of first sensing lines to sense a force of the touch of the user through the sensing layer, in which the first sensing lines are the data lines or the gate lines. In some cases, the sensing layer can be omitted, and the metal layer is used to replace the sensing layer.

Abstract: An electronic device includes a touch sensitive display, and a processor electrically connected with the touch sensitive display. The processor is configured to sense a first touch and a second touch on the touch sensitive display, to display a first region expanding with respect to a location at which the first touch is made, on the touch sensitive display, to display a second region expanding with respect to a location at which the second touch is made, on the touch sensitive display, and to display a specified screen in the touch sensitive display if a sum of an area of the first region and an area of the second region exceeds a specified value.

Abstract: A touch-sensitive control device is controlled by a control chip to conduct press sensing and/or touch sensing. The touch-sensitive control device includes: a cover; a circuit board disposed at a side of the cover, having a first surface disposed opposite to the cover, and having a second surface facing the cover; a first electrode disposed on the first surface of the circuit board and electrically connected to a control chip; a socket having a conductor; and a spacer disposed between the socket and the first surface of the circuit board, and deformable to change a distance between the first electrode and the conductor, wherein a capacitance change between the first electrode and the conductor of the socket correlates to the distance change between the first electrode and the conductor resulting from a pressing operation onto the cover.

Abstract: In various implementations, a sensor operates in a force sensing mode by determining an applied force based on a first change in capacitance between first and second electrodes related to compression of a compressible material positioned between while the third electrode functions as a shield and in a proximity sensing mode by sensing proximity of an object based on a second change in capacitance of the third electrode while the first and/or second electrodes function as a shield. In some implementations, a device has a cover glass including a surface having a display area, an edge surface, and a cavity; a touch sensing electrode oriented toward the surface; an electrode positioned in the cavity oriented toward the edge surface; and a processing unit operable to detect touch or proximity of an object to the edge surface based on a change in capacitance between the electrode and the object.

Abstract: Detecting a tool used on a touch screen. In accordance with a method embodiment of the present invention, a cell value is accessed for each cell of a touch sensing device. The cell value indicates a force applied to the cell. A touch area sample count is determined as a count of how many of the cells have a cell value above a noise floor. A touch area weight is determined as a sum of all cell values for the cells having a cell value above the noise floor. An object touching the touch sensing device is identified based on the touch area sample count and the touch area weight. The object's touch indication may be rejected if the object is not identified. The identity of the object may be reported to a software application.

Abstract: A display apparatus with touch sensing and force sensing functions includes a display panel, a first touch device, a conductive layer and a dielectric layer. The first touch device includes multiple touch sensing pads. The conductive layer includes multiple force sensing pads electrically connected to each other, where the touch sensing pads separately overlap the corresponding force sensing pads in a vertical projection direction. The dielectric layer is disposed between the conductive layer and the first touch device. The touch sensing pads, the dielectric layer and the force sensing pads form a force sensing device.

Abstract: According to an aspect of present invention provides electronic device having a multi-functional human interface, device comprising, first to fifth multi-functional input buttons, wherein each of multi-functional input buttons includes an electrode unit including a transmitter unit and a receiver unit, transmitter unit has first and second transmitters having driver signal periods different from each other, and receiver unit has first to fourth receivers having at least two scan signal periods different from each other, first receiver of fourth multi-functional input button has a scan signal period same as a scan signal period of fourth receiver of second multi-functional input button, second receiver of fourth multi-functional input button has a scan signal period same as a scan signal period of first receiver of first multi-functional input button, third receiver of fourth multi-functional input button has a scan signal period same as a scan signal period of second receiver of first multi-functional input b

Abstract: An apparatus for recognizing a touch input includes: a touch input detector detecting a touch input signal depending on a force-based touch input on a touch pad; a vehicle movement detector sensing movement of a vehicle; and a processor configured to detect an abnormal signal generated by the movement of the vehicle in the touch input signal and to recognize the touch input by performing signal interpolation on an abnormal signal generation section in which the abnormal signal is generated.

Abstract: A mobile terminal including a touch screen; a stylus pen including a pressure sensor and an optical sensor; a wireless communication unit configured to wirelessly communicate with the stylus pen; and a controller configured to drive the stylus pen in a first operation mode in which the pressure sensor provided in the stylus pen is activated and the optical sensor is deactivated, when sensing information sensed by the pressure sensor indicates the stylus pen is in contact with the touch screen, and drive the stylus pen in a second operation mode in which both the pressure sensor and the optical sensor provided in the stylus pen are activated, when the sensing information sensed by the pressure sensor indicates the stylus pen is not in contact with the touch screen.

Abstract: A displaying method of a touch input device including a touch screen, a touch screen controller which detects a magnitude of a pressure of a touch input to a surface of the touch screen, and a controller which controls the touch screen on the basis of information detected by the touch screen controller, the displaying method including: detecting, by the touch screen controller, a magnitude of the pressure of the touch which is input to a first region when an object touches the first region of the surface of the touch screen in a state where a display of the touch screen is turned off, and displaying by controlling, by the controller, the touch screen such that, when the detected magnitude of the pressure is greater than that of a first reference pressure, a second region of the display of the touch screen is displayed.

Abstract: A touch sensor includes a driving electrode which includes at least two divided areas electrically separated from each other, wherein each divided area includes first patterns connected to each other in a first direction and second patterns extending from the first pattern in a second direction, and a receiving electrode which is formed on the same plane as the driving electrode in the second direction, wherein the driving electrodes are respectively connected to separate driving channels by driving electrode wirings for each divided area, such that it is possible to sense touch positions over the entire area only by a smaller number of channels. Thereby, it is possible to significantly reduce the bezel width, and may maintain excellent touch sensitivity while significantly shortening the touch recognition time.

Abstract: A display device with a touch sensor having a display function and a touch sensor function is provided. The display device includes a first substrate including a pixel electrode; a first electrode along a first direction; and a second substrate including a second electrode that includes patterns of electrodes along a second direction crossing the first direction and that faces the first electrode and the pixel electrode, wherein upon the display function being activated, the pixel electrode is supplied with a pixel signal, and the second electrode is supplied with common voltage, and upon the touch sensor function being activated, the first electrode is applied with a first signal and the second electrode is configured to receive the first signal to be a second signal as a touch detecting signal.

Abstract: A multi-stimulus controller for a multi-touch sensor is formed on a single integrated circuit (single-chip). The multi-stimulus controller includes a transmit oscillator, a transmit signal section that generates a plurality of drive signals based on a frequency of the transmit oscillator, a plurality of transmit channels that transmit the drive signals simultaneously to drive the multi-touch sensor, a receive channel that receives a sense signal resulting from the driving of the multi-touch sensor, a receive oscillator, and a demodulation section that demodulates the received sense signal based on a frequency of the receive oscillator to obtain sensing results, the demodulation section including a demodulator and a vector operator.

Abstract: A metal mesh structure capable of reducing breakpoint short circuits, including a plurality of first main channel wires, a plurality of second main channel wires, a plurality of first virtual wires and a plurality of second virtual wires. The first main channel wires are spaced apart and aligned in a first direction. The second main channel wires are spaced apart and aligned in a second direction. The second main channel wires cross the first main channel wires to form a plurality of main channel meshes. A method of manufacturing a metal mesh structure capable of reducing breakpoint short circuits is further provided. Given the aforesaid structure and method, the metal mesh is effective in reducing breakpoint short circuits.

Abstract: A force based touch interface device comprising a touch substrate, a torsion preventing structure for preventing torsion of the touch substrate by an externally-applied force touch, a plurality of sensors for measuring the force touch applied to the touch substrate at different positions, an input device for applying the force touch onto the touch substrate, and a controller for measuring force data using the plurality of sensors when the force touch is applied onto the touch substrate, for estimating force data for symmetrical points for touch points to which the force touch is applied using the measured force data, and for comparing the measured force data and the estimated force data with ideal force data to generate a calibration matrix for correcting a process error.

Abstract: An operation target device projects a display video onto a projection surface, which is captured by a camera. An operation detectable region specifying unit specifies respective regions where an operation is detectable and is undetectable based on image data captured by the camera. Finger and pen contact position detection units detect the operation to the operation object based on the image data captured by the camera. The operation target device displays the display video so that the region where the operation to the operation object is detectable, which is specified by the operation detectable region specifying unit, is distinguished from the region where the operation to the operation object is undetectable. In addition, the operation target device changes a display position of the operation object so that the operation object is displayed within a range of the region where the operation to the operation object is detectable.

Abstract: A system (1) detects an object (100) approaching and touching a capacitive touch device (10). The system includes the capacitive touch device (10), a processor, an optical system connected to the processor and arranged to collect information on the object (100). The processor is arranged so as to classify the object (100) as a triggering object or as a non-triggering object based on this information. If the object is classified as a non-triggering object, the processor disables the execution of touch functions of the capacitive touch device (10) at the latest when at least a part of the object (100) touches the capacitive touch device (10). If the object is classified as a triggering object, at the latest when at least a part of the object touches the capacitive touch device (10), the processor executes a predetermined function on the capacitive touch device (10).

Abstract: A touch sensor detector system and method incorporating an interpolated sensor array is disclosed. The system and method utilize a touch sensor array (TSA) configured to detect proximity/contact/pressure (PCP) via a variable impedance array (VIA) electrically coupling interlinked impedance columns (IIC) coupled to an array column driver (ACD), and interlinked impedance rows (IIR) coupled to an array row sensor (ARS). The ACD is configured to select the IIC based on a column switching register (CSR) and electrically drive the IIC using a column driving source (CDS). The VIA conveys current from the driven IIC to the IIC sensed by the ARS. The ARS selects the IIR within the TSA and electrically senses the IIR state based on a row switching register (RSR). Interpolation of ARS sensed current/voltage allows accurate detection of TSA PCP and/or spatial location.

Abstract: A touch control detecting method applied to an electronic apparatus comprising an image sensor. The touch control detecting method comprises: (a) capturing a plurality of sensing images via the image sensor; and (b) determining if an object performs a predetermined touch control operation to the electronic apparatus, according to a brightness variation tendency of the sensing images.

Abstract: A motion sensing method is applied in a motion sensing device to imitate or repeat movement of human body or parts using a camera and a sensor. The method comprises detecting human body and adjusting rotation angle of an infrared sensor to track parts of the human body having acquired human body temperature distribution image from the camera. Human body contour image is analyzed and distances between a moving part of the human body and the motion sensing device are acquired. Determining a target contour image by reference to stored human body contour images and determining a corresponding two-dimensional motion. A target control signal is determined according to the determined operation and a relationship table defining a relationship between the number of operations and the number of control signals. The motion sensing device is controlled to act according to the determined target control signal.