Abstract: Systems, methods, apparatuses, and computer-readable media for creating an observation video are described. The observation video may comprise a viewport that moves in coordination with motion of an HMD user's head and that shows portions of VR content being output to the HMD user at different times. For each of those times, motion data from the HMD may be used to determine a position, orientation, and/or shape of the viewport. The observation video may also include an element that represents the HMD user, which element may comprise a video element video isolated from video of the user captured by a camera, and/or which may comprise an animated avatar.

Abstract: A user profile generating system for generating a user profile for use with a processing device operable to display content includes: a head motion tracking unit operable to identify head motion of the user, an eye motion tracking unit operable to identify eye motion of the user, and a profile generating unit operable to generate a user profile comprising head tracking and eye tracking information for the user, where the generated user profile is used to modify interactions between the user and a processing device.

Abstract: An information processing device configured to present a virtual space at a display mounted on the head of a user, the information processing device inputs detection information from a sensor that detects movement of the head of the user. The information processing device generates the virtual space including a body image representing at least a part of a body of the user in response to the detection information. The information processing device inputs correction information from a device operated to perform correction of an angle in a pitch direction of the head of the user. The information processing device corrects a pitch direction angle employed when presenting the virtual space at the display based on the correction information. The information processing device presents the virtual space at the display with the corrected pitch direction angle.

Abstract: A system and method for predicting an estimated head pose solution of a head worn display (HWD) at a future time selects or determines, for each HWD rotational axis, a relative angular rate of a head reference frame relative to a body reference frame. By sampling the relative angular rate, a relative angular acceleration is determined. Based on a projection time associated with estimated display latency, angular increment vectors for each rotational axis are determined for relative angular rate and relative angular acceleration. The current head pose solution is adjusted with respect to one or more axes based on the angular increment vectors to project the head pose estimate ahead based on the projection time, the resulting projected head pose solution corresponding to a predicted orientation of the head frame relative to the body frame at the future time.

Abstract: A system including a display, an eye tracker, and a processor that executes the following: operate the display to present multiple objects to a user; operate the eye tracker to track an eye gaze of the user during the presentation of the multiple objects; calculate an estimated user preference of each of the multiple objects, by performing at least one of: (a) calculating a measure of central tendency of distances from a center of the respective object to points of the eye gaze on the respective object, wherein a higher measure of central tendency of the distances indicates a stronger user preference and vice versa, and (b) calculating a measure of central tendency of speeds of transition between temporally-consecutive ones of the points of the eye gaze, wherein a higher measure of central tendency of the speeds indicates a stronger user preference and vice versa.

Abstract: A method for modulating a position of a movable command input image displayed on a graphical user interface (GUI) based on a user viewing direction relative to graphical user interface comprises capturing real time images of the user's face, eyes and irises. The general eye orientation of the user is determined based on the real time images. A first position of the movable command input image displayed on the GUI is determined. The GUI is separated into portions. A real-time correlation between the general eye orientation and one or more of the interface portions is determined thereby determining a viewing direction of the user and one or more real-time viewed interface portions. The movable command input image is moved from the first position to a second position on the GUI. The second position is at the one or more real-time viewed interface portions.

Abstract: One variation of a keyboard system includes: a substrate including an array of inductors; a tactile layer arranged over the substrate defining an array of key locations over the array of inductors; an array of magnetic elements, each arranged within the tactile layer at a key location configured to inductively couple to an adjacent inductor and configured to move relative to the adjacent inductor responsive to application of a force on the tactile layer at the key location; and a controller configured to read electrical values from the inductors. In response to detecting a change in electrical value at a first inductor, the controller also configured to: register a first keystroke of a first key type associated with a first key location defined over the first inductor; and drive an oscillating voltage across the first inductor to oscillate the tactile layer over the substrate during a haptic feedback cycle.

Abstract: Techniques are described for automated musical-score-referenced evaluation of haptic-based rhythmic performance. An audiovisual representation of real-time progress through a musical score is output to a user. The output corresponds to progress through a sequence of score-notated rhythm (SNR) events at a tempo. During the outputting, haptic performance (HP) events are received from a user via a haptic interface as the user's rhythmic performance of the SNR events at the tempo. Automated techniques evaluate the user's performance to determine a rhythmic compatibility between the received HP events and evaluation data for the SNR events. Visual feedback is provided to the user to graphically map the evaluated performance to the SNR events on the musical score.

Abstract: An eyeglasses-type wearable device of an embodiment can handle various data inputs. The device includes right and left eye frames corresponding to positions of right and left eyes and nose pads corresponding to a position of a nose. Eye motion detection electrodes (sightline detection sensor electrodes) are provided with the nose pads to detect the eye motion of a user. Transmitter/receiver electrodes (capacitance sensor electrodes) of a gesture detector are provided with a part of the right and left eye frames to detect a gesture of the user. Various data inputs are achieved by a combination of input A corresponding to a gesture of the user detected by the gesture detector and input B corresponding to the eye motion of the user detected by the eye motion detector.

Abstract: Systems and methods herein describe using a neural network to identify a first set of joint location coordinates and a second set of joint location coordinates and identifying a three-dimensional hand pose based on both the first and second sets of joint location coordinates.

Abstract: A wireless keyboard and mouse combo includes a wireless keyboard including a first switching switch, and a keyboard Bluetooth/transceiver chip electrically connected to the first switching switch, and a wireless mouse including a second switching switch, and a mouse Bluetooth/transceiver chip electrically connected to the second switching switch and having a direct communication connection with the keyboard Bluetooth/transceiver chip.

Abstract: A method and a device for automatically convert input typed using a multi layout physical or virtual keyboard to the correct layout. Some implementations also fix spelling mistakes and set the active layout to the desired layout. When a key such as the space bar is triggered, the implementation may feed the gestures into a machine learning model, the model then may output the estimated correct layout, and followingly cause replacing the characters, symbols or letters, corresponding to the typed keys in displayed words. Based on the estimated or detected language, the software of the implementation may check for spelling mistakes and will correct them.

Abstract: Computer peripheral devices designed and configured to generate and send peripheral device command signals for controlling software applications. In some examples the peripheral device command signals are designed to be the same as command signals generated by a keyboard in response to pressing one or more keyboard keys corresponding to a keyboard shortcut for a software application control function. The peripheral devices may be selectively configured into one of a plurality of configurations for selectively generating peripheral device command signals by selecting a position of at least one command signal group selector switch operably coupled to the peripheral device.

Abstract: Systems and methods for motion mode management include a computer-assisted device having an input control, a repositionable structure, and a controller coupled to the input control and the repositionable structure. The controller is configured to detect motion of the input control for controlling motion of the repositionable structure and in response to determining that the motion of the input control is likely to be confused with a first portion of a motion of the input control for indicating that a mode of operation of the computer-assisted device is to be changed, temporarily disable mode switching in response to motion of the input control.

Abstract: Provided is an electronic pen that includes a body portion housing of an electronic pen body portion has housed therein a refill body and a circuit board having a side switch formed by a push button switch mounted thereon, and has a pen-point opening portion through which a pen point of the refill body protrudes. A pressing member is provided in a side opening portion of the body portion housing such that the pressing member is disposed on the side switch in such a manner as to be prevented by an engagement portion from protruding outwardly from a side surface of the body portion housing. The side switch of the circuit board is operated through the pressing member of the electronic pen body portion when an operation unit of the outer housing having the electronic pen body portion installed therein is pressed.

Abstract: A touch pad structure including a carrier, a frame, a touch pad, a switch and four first springs is provided. The frame is disposed above the carrier. The touch pad is disposed on the frame, and the frame is located between the carrier and the touch pad. The switch is disposed on the touch pad and penetrates through the frame and thus faces the carrier. The first springs are distributed at a peripheral of the touch pad. Two opposite ends of each of the first springs respectively contact the carrier and the frame. Two longest connecting lines between the first springs are defined as a first connecting line and a second connecting line. The switch is seated on an intersection point of the first connecting line and the second connecting line. An electronic device is also provided.

Abstract: The present invention discloses a rolling mechanism and a mouse device using the same. The rolling mechanism comprises a base, a circuit module, a roller module, an encoding element and an elastic element. The circuit module is disposed on the base. The roller module is disposed on the circuit module and movable on the base. The encoding element is disposed on the circuit module and electrically connected with the circuit module, and further connected to the roller module. The elastic element is disposed between the roller module and the encoding element, and the elastic element is propped against the roller module. The mouse device comprises a mouse body and a rolling mechanism disposed in the mouse body.

Abstract: A position detection device includes a main body with a housing that encloses an electronic pen while the electronic pen is accommodated in an accommodation portion included in the housing, and a planar coil having a rectangular cross-sectional area and disposed adjacent to the accommodation portion at a position at which a direction perpendicular to the rectangular cross-sectional area of the planar coil crosses an axial direction of the electronic pen while the electronic pen is accommodated in the accommodation portion.

Abstract: Certain exemplary embodiments relate to entertainment systems and, more particularly, to systems that incorporate digital downloading jukebox features and improved user interfaces. For instance, a smart search may be provided, e.g., where search results vary based on the popularity of songs within the venue, in dependence on songs being promoted, etc. As another example, a tile-based approach to organizing groupings of songs is provided. Groupings may involve self-populating collections of songs that combine centrally-promoted songs, songs in a given genre that are popular across an audiovisual distribution network, and songs that are locally popular and match up with the given genre (e.g., because of shared attributes such as same or similar genre, artist, etc.). Different tile visual presentations also are contemplated, as are different physical jukebox designs. In certain example embodiments, a sealed core unit with the “brains” of the jukebox is insertable into a docking station.

Abstract: A display module includes a display area and a non-display area disposed outside the display area on a plane. The display module includes a base layer, a circuit device layer, a display device layer, a thin film encapsulation layer, and a touch sensing layer. An inorganic layer of the touch sensing layer contacts an inorganic layer of the circuit device layer exposed by an organic layer of the circuit device layer. An inorganic layer of the thin film encapsulation layer is disposed between the inorganic layer of the touch sensing layer and the inorganic layer of the circuit device layer to block a moisture penetration path which causes delamination of the thin film encapsulation layer.

Abstract: A touch member for a display device includes first and second touch signal lines and an insulating layer between first and second conductive layers. The first touch signal line includes a first sub-touch signal line corresponding to the first conductive layer, and a second sub-touch signal line corresponding to the second conductive layer and connected to the first sub-touch signal line through first and second contact holes penetrating the insulating layer. The second touch signal line includes a third sub-touch signal line corresponding to the first conductive layer, and a fourth sub-touch signal line corresponding to the second conductive layer and connected to the third sub-touch signal line through third and fourth contact holes penetrating the insulating layer. The first and second contact holes are spaced by a first distance, and the third and fourth contact holes are spaced by a second distance less than the first distance.

Abstract: An electronic device includes an outer housing, a touch display module, and at least one optical assembly. The outer housing has an accommodating portion and an engaging portion. The touch display module is disposed in the accommodating portion and engaged with the engaging portion. The touch display module includes a thin-film transistor substrate, a color filter substrate, and a touch electrode layer. The color filter substrate is disposed on a side of the thin-film transistor substrate facing the outer housing. The touch electrode layer is disposed between the thin-film transistor substrate and the color filter substrate. The optical assembly is disposed on a side of the color filter substrate away from the thin-film transistor substrate.

Abstract: The present disclosure provides a touch display panel, including a display region and a non-display region surrounding the display region. The non-display region includes a bonding region arranged at one side of the display region along a first direction. The touch display panel further includes a display signal line and a touch signal line. The bonding region includes a first pad and a second pad, the display signal line is coupled to a flexible printed circuit via the first pad, the touch signal line is coupled to the flexible printed circuit via the second pad, and the second pad is arranged at one side of the first pad along a second direction.

Abstract: Embodiments of the present disclosure relate to a touch display apparatus and a gate driving circuit, and more particularly, provide a touch display apparatus including: two or more signal lines that transmit clock signals having the same frequency and different phases; and a multiplexer including input nodes through which clock signals transmitted through the two or more signal lines are input and an output node outputting any one of clock signals input to the input nodes. According to the embodiments of the present disclosure, touch sensing accuracy and display quality are possible to be improved.

Abstract: The present disclosure provides a display touch device and a control method. The display touch device includes a display panel, a display touch driving circuit and a touch operation processing circuit, wherein the display panel includes a plurality of gate lines; the touch operation processing circuit is configured to provide a first touch enable signal to the display touch driving circuit when it is detected that the display touch device is in a touch-only detection state, to control the display touch driving circuit to perform touch detection. The present disclosure can conveniently perform touch detection when the display touch device is in the touch-only detection state.

Abstract: A method and device for selecting input fields displayed on a screen and/or for activating input content displayed in a selected input field on the screen by manual inputs into an input area of an input interface. The input interface is designed for the haptic input of gestures into the input area, in order to control the selection of an input field, and for the activation of input content of a selected input field by triggering an electrical switching function of the input interface by means of exerting a predefined minimum force on the input area. A displacement vector V(POS(t1),POS(t2)) is determined from determined input positions POS(t1),POS(t2) of a manual, continuous input of gestures into the input area at a first point in time t1 and a second point in time t2, where t:=time and t1<t2. An absolute value |F(t)| of a surface area F(t), with which the manual gesture input acts on the input area is determined.

Abstract: A method of maintaining a pressure input path in a sensing array is described. The sensing array comprises a plurality of sensing elements, and the method involves activating a first sensing element to determine a first location data point and activating a second sensing element to determine a second location data point. The state location (x,y) and state velocity (Vx, Vy) are calculated based on the first and second location data points to create a state vector. A predicted path of further location data points is determined from the state vector to avoid drop out problems with pressure inputs.

Abstract: A device to enable touchless operation of an instrument is disclosed. The device includes an actuator configured to vibrate the instrument, a controller configured to control the actuator, and an interval detector configured to detect an interval between the instrument and an object to operate the instrument. The controller is configured to start vibrating the actuator having been still after the interval detected by the interval detector reaches a first threshold, keep vibrating the actuator until the interval detected by the interval detector reaches a second threshold larger than the first threshold after the interval reaches the first threshold, and stop vibrating the actuator after the interval detected by the interval detector reaches the second threshold.

Abstract: A stimulus transmission device suppresses power consumption, and effectively transmits a physical stimulus to a user. The stimulus transmission device has a pressure receiving portion which receives pressure from part of a human body, an actuator which drives the pressure receiving portion, and a supporting portion which supports the actuator. The actuator does not move in conjunction with the supporting portion.

Abstract: An display device, includes: an input sensor including: a sensor controller configured to operate in a first mode, in which the first electrode and the second electrode are operated as different groups, or in a second mode, in which the first electrode and the second electrode are operated as a same group, wherein the sensor controller is configured to have an operation time of the first mode, which is longer than an operation time of the second mode, in response to the input sensor operating in the first driving mode during successive sensing periods of a first group, and the sensor controller is configured to have the operation time of the second mode, which is longer than the operation time of the first mode, in response to the input sensor operating in the second driving mode during successive sensing periods of a second group.

Abstract: The present disclosure provides a chip-on-film, a display substrate, a display device and a driving method. The display substrate includes a plurality of scanning lines and a plurality of cascaded shift register units coupled to the scanning lines. The display substrate further includes an output control signal line electrically coupled to each shift register unit for providing an enable signal for the shift register unit. The output control signal lines include at least two output control signal lines for providing different enable signals, and two adjacent cascaded shift register units are coupled to different output control signal lines.

Abstract: A display device with a touch sensor having a display function and a touch sensor function is provided. The display device includes a first substrate including a pixel electrode; a first electrode along a first direction; and a second substrate including a second electrode that includes patterns of electrodes along a second direction crossing the first direction and that faces the first electrode and the pixel electrode, wherein upon the display function being activated, the pixel electrode is supplied with a pixel signal, and the second electrode is supplied with common voltage, and upon the touch sensor function being activated, the first electrode is applied with a first signal and the second electrode is configured to receive the first signal to be a second signal as a touch detecting signal.

Abstract: In an electronic apparatus, a touch sensor has a first area and a second area not overlapping with the first area. The controller performs a first calibration process to define a first coordinate range of the first area by correcting a coordinate deviation of the first area on the basis of detection of a touch operation to touch a predetermined first target portion in the first area. The controller performs a second calibration process to define a second coordinate range of the second area on the basis of the first coordinate range defined in the first calibration process and relative position information stored in a memory. When the second coordinate range defined in the second calibration process meets a predetermined condition, the controller performs a third calibration process to correct the second coordinate range to achieve that the corrected second coordinate range does not meet the predetermined condition.

Abstract: A power management circuit can comprise a direct-current-to-direct-current (DC-DC) converter and a guard buffer. The guard buffer can be referenced to a system ground and configured to generate a guard ground. The power management circuit can comprise a supply capacitor coupled to the DC-DC converter that can be referenced to system ground in a first mode and referenced to the guard ground in a second mode. A regulator can be coupled to the DC-DC converter and referred to system ground in the first mode, and decoupled and referred to guard ground in the second mode. The DC-DC converter can generate a first voltage in the first mode and a second voltage in the second mode, the second voltage greater than the first.

Abstract: A touch sensitive processing method, comprising: performing mutual capacitance detection via a touch panel to retrieve an image which including two-dimension sensing information; calculating one or more touching or approximating event corresponding to externally conductive object according to the image; determining whether an area surrounding a position corresponding to the touching or approximating event is normal; and reporting the touching or approximating event in response to the area is determined normal.

Abstract: A proximity sensor is arranged with a first electrode input with a first signal, a second electrode input with a second signal different from the first signal, a third electrode arranged closer to the first electrode than the second electrode, and the second signal has a reverse phase of the first signal.

Abstract: The present application discloses a touch panel and a mobile terminal; a touch layer of the touch panel includes a plurality of third electrode groups, a plurality of first electrode groups arranged in parallel, and a plurality of second electrode groups arranged in parallel and intersecting the plurality of first electrode groups, which all three are insulated from each other. The plurality of first electrode groups, the plurality of second electrode groups, and the plurality of third electrode groups are electrically connected to a functional chip, the plurality of third electrode groups are connected to each other and electrically connected to a third peripheral wire, or are insulated from each other.

Abstract: A device including a memory and a processor. The processor receives electronic information. The processor analyzes the electronic information. The processor displays, based on analyzing the electronic information, the electronic information on a graphical user interface. The displayed electronic information is shown as a first electronic formation, and the graphical user interface is controlled by the processor. The device receives an electronic communication and changes the displayed electronic information to a second electronic formation displayed on the graphical user interface. The change from the first electronic formation to the second electronic formation occurs instantaneously.

Abstract: Systems and methods are disclosed that can selectively route actions, such as notifications, to cause activations of one or more applications based on data associated with the actions and based on activation conditions specified at a scene level by each of the applications.

Abstract: Provided are systems and methods directed to a pop-up visualization that provides a view of data values currently hidden on a display screen. In one example, the method may include displaying data values from a subset of columns of a database table via a user interface, displaying a plurality of pop-up indicators via the user interface, where each pop-up indicator is displayed within a different row of the displayed data values, detecting a selection of a pop-up indicator from among the plurality of pop-up indicators corresponding to a row of displayed data values, and in response to the detecting, initializing a display of a pop-up visualization which includes one or more additional data values from a second subset of columns of the database table that are not included in the row of displayed data values.

Abstract: Examples disclosed herein relate to digital mark-up in a three dimensional (3D) environment. An example device for digital mark-up in a 3D environment includes a processor, a display for showing a view of the 3D environment, and a memory including instructions on the processor. When the memory stored instructions are executed on the processor, they cause the processor to generate an anchor point in response to an author input, wherein the anchor point includes a virtual location. When the memory stored instructions are executed on the processor, they cause the processor to generate a mark-up object associated with the anchor point, wherein the mark-up object includes mark-up dimensions, a virtual authoring location, and a selectable association that, in response to being selected, instructs the processor to adjust the view shown in the display to be a view from the virtual authoring location at the time the mark-up object was authored.

Abstract: Methods, systems, computer-readable media, and apparatuses for generating an Augmented Reality (AR) object are presented. The apparatus can include memory and one or more processors coupled to the memory. The one or more processors can be configured to receive an image of at least a portion of a real-world scene including a target object. The one or more processors can also be configured to generate an AR object corresponding to the target object and including a plurality of parts. The one or more processors can further be configured to receive a user input associated with a designated part of the plurality of parts and manipulate the designated part based on the received user input.

Abstract: Disclosed is a method of receiving and processing content-sending inputs received by a head-worn device system including one or more display devices, one or more cameras and a vertically-arranged touchpad. The method includes displaying a content item on the one or more display devices, receiving a touch input on the touchpad corresponding to a send instruction, displaying a carousel of potential recipients, receiving a horizontal touch input on the touchpad, scrolling the carousel left or right on the one or more display devices in response to the horizontal touch input, receiving a tap touch input on the touchpad to select a particular recipient, receiving a further touch input, and in response to the further touch input, transmitting the content item to the selected recipient.

Abstract: An orthogonal or multi-dimensional fabric user interface is described herein. A remote server executes an operating system that provides a multi-dimensional fabric user interface for storing content for a particular user. The user can access select content by manipulating the multi-dimensional fabric user interface through a graphical user interface displayed on a personal mobile computing device. In this way, the user experiences and manipulates various data dimensions around the specific content they are accessing, rather than selecting a particular file structure location. The remote server also enables the user to enter a first location side of a portal and travel to a virtual representation a second actual physical location in the multi-dimensional fabric user interface from a virtual representation of a first actual physical location in the multi-dimensional fabric user interface.

Abstract: Technologies for accurate asset delivery using geospatial information are provided. Upon receiving location information related to an asset delivery, geospatial image data is retrieved for an area based on the location information. The geospatial image data comprises aerial imagery correlated with geographic coordinate information. The geospatial image data can be displayed at graphical user interface. Responsive to receiving an asset request, a virtual asset object is generated. The virtual asset object corresponds to a physical asset, wherein the virtual asset object has a plurality of dimensional parameters associated with the physical asset. The virtual asset object is displayed at the graphical user interface (GUI), and the virtual asset object is overlaid on top of the geospatial image data. Responsive to receiving user input related to a position of the virtual asset object with respect to the geospatial image data an asset delivery report is generated based on the position of the virtual asset object.

Abstract: Systems and methods disclosed herein relate to assigning dynamic eye-gaze dwell-times. Dynamic dwell-times may be tailored to the individual user. For example, a dynamic dwell-time system may be configured to receive data from the user, such as the duration of time the user takes to execute certain actions within applications (e.g., read a word suggestion before actually selecting it). The dynamic dwell-time system may also prevent users from making unintended selections by providing different dwell times for different buttons. Specifically, on a user interface, longer dwell times may be established for the critical keys (e.g., “close” program key, “send” key, word suggestions, and the like) and shorter dwell times may be established for the less critical keys (e.g., individual character keys on a virtual keyboard, spacebar, backspace, and the like).

Abstract: In some implementations, a system may transmit a first set of user interface (UI) data indicating a UI having a first interaction element. The system may receive interaction data indicating a user interaction with the first interaction element. The system may determine one or more suggestions to provide based on one or more factors related to account information associated with a user account. The system may transmit a second set of UI data associated with a UI element and that may indicate a first portion, extending downward from a top of a display of the user device, that may include one or more second interaction elements corresponding to the suggestions, and a second portion extending upward from a bottom of the display and including a virtual keyboard. An intermediate portion of the UI may be exposed through a gap between the first and second portions of the UI element.

Abstract: An apparatus (10) for navigating a hierarchical electronic questionnaire (12) includes at least one electronic processor (20) programmed to: provide (102) a user interface (UI) (27) via which: at least a portion of the hierarchical electronic questionnaire is presented on a display device (24) represented as a tree-based questionnaire map (30) with a plurality of nodes (32) connected by a plurality of branches (34), the nodes of the plurality of nodes corresponding to questions; a user input is received, via at least one user input device (22), indicative of a selection of at least one of the nodes; and the question corresponding to the selected node is displayed and a user input indicative of an answer to the question corresponding to the selected node is received via the at least one user input device; and populate (104) one or more nodes other than the selected node based on the selected node and/or the answer to the question corresponding to the selected node.

Abstract: An arrangement section arranges a plurality of display elements including a first display element and a second display element. A reception section receives an operation for selecting a display element. A display processing section displays the selected display element in such a predetermined manner as to indicate that the display element is selected. When the reception section receives an operation for selecting the second display element while the first display element is in the selected state, the display processing section performs presentation display indicating that a state in which the first display element is selected is to be changed to a state in which the second display element is selected, and then displays the second display element in a predetermined manner.

Abstract: An electronic device includes a hinge configured to foldably connect a first housing to a second housing; a display including a first display area disposed on the first housing, and a second display area and a third display area arranged on the second housing; and at least one processor configured to: in a first state in which the hinge is unfolded, display a first application in the first display area and the second display area, and display, in the third display area, at least one default button, in a second state in which the hinge is folded, control the display to display a panel button, in the third display area, and based on a selection of the panel button in the second state, display the first application in the first display area, and display, in the second display area, a first panel including at least one control button and at least one system button.