AN APPARATUS AND ASSOCIATED METHODS FOR CONTROLLING CONTENT ON A DISPLAY USER INTERFACE
An apparatus comprising: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: based on a detected inclination of a hand gesture relative to a display screen displaying content, split the display screen into a first portion displaying the content and a second portion.
The present disclosure relates to the field of (input and/or output) user interfaces, associated methods, computer programs and apparatus. Certain disclosed aspects/examples relate to portable electronic devices, in particular, so-called hand-portable electronic devices which may be hand-held in use (although they may be placed in a cradle in use). Such hand-portable electronic devices include so-called Personal Digital Assistants (PDAs), mobile telephones, smartphones and other smart devices, smartwatches and tablet PCs.
The portable electronic devices/apparatus according to one or more disclosed aspects/embodiments may provide one or more audio/text/video communication functions (e.g. tele-communication, video-communication, and/or text transmission (Short Message Service (SMS)/Multimedia Message Service (MMS)/e-mailing) functions), interactive/non-interactive viewing functions (e.g. web-browsing, navigation, TV/program viewing functions), music recording/playing functions (e.g. MP3 or other format and/or (FM/AM) radio broadcast recording/playing), downloading/sending of data functions, image capture functions (e.g. using a (e.g. in-built) digital camera), and gaming functions.
BACKGROUNDAn electronic device may have a user interface which allows a user to interact with the device. For example, a device may comprise a touch-sensitive display which a user can touch to provide inputs to the device.
The listing or discussion of a prior-published document or any background in this specification should not necessarily be taken as an acknowledgement that the document or background is part of the state of the art or is common general knowledge. One or more aspects/examples of the present disclosure may or may not address one or more of the background issues.
SUMMARYIn a first aspect there is provided an apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following, based on a detected inclination of a hand gesture relative to a display screen displaying content, split the display screen into a first portion displaying the content and a second portion.
The inclination may be with respect to a particular side of the display screen, wherein the particular side may be one of a left-hand side, right-hand side, top side, bottom side, top-left-hand corner, top-right-hand corner, bottom-left-hand-corner, and bottom-right-hand corner.
In this context, although the particular side may be with respect to the display screen, it will be appreciated that this could also be considered with respect to a side of a user interface used to detect the inclination. In advantageous embodiments, the particular side of the user interface would have a direct correspondence with the display screen, for example the left-hand-side of the user interface would correspond to the left hand side of the display screen.
The apparatus may be configured such that an inclination towards a particular side of the display screen splits the display screen with the first portion being displayed on that particular side of the display screen.
The apparatus may be configured such that an inclination towards a particular side of the display screen splits the display screen with the first portion being displayed on an opposing side to that particular side of the display screen.
It will be appreciated that the inclination towards one side can be considered to be an inclination away from an opposing side.
The apparatus may be configured such that the second portion is displayed on an opposing side of the display to the first portion.
The apparatus may be configured such that the first portion displays one of all of the content and part of the content.
The apparatus may be configured to enable scrolling through content in the first or second portion, which is not obscured by the detected inclination of the hand gesture, based on a particular degree of inclination of the hand gesture.
The apparatus may be configured such that the delineation of the first portion and the second portion is based on the location of the hand gesture relative to the display screen.
The apparatus may be configured to size the split of the display screen into respective first portions and second portions based on a particular degree of inclination of the hand gesture.
The content of the first portion may be associated with a first application and the apparatus may be further configured to enable display of new content, associated with a second application, in the second portion.
The apparatus may be configured to enable one or more of: presentation to a user of an option to select new content to be displayed in the second portion; presentation to a user of a plurality of icons associated with a plurality of content items, wherein selection of a particular icon enables display of the associated particular content in the second portion; and presentation to a user of a plurality of icons associated with a plurality of content items, wherein selection of a particular icon is based on a particular degree of inclination of the hand gesture and enables display of the associated particular content in the second portion.
The apparatus may be configured to, based on a selected at least part of the content, provided for further content in respect of the selected part in the second portion. The selected part may be used as a search entry for searching for further data to be provided in the second portion.
The second portion may comprise a new viewing pane with second content from a background application.
The apparatus may be configured such that the second portion is available for displaying one of second content different to the content displayed in the first portion and new content associated with the first portion.
The apparatus may be configured to enable display of second content in the second portion such that the second content is one of the content of the first portion displayed in a different manner to the display in the first portion and based on different content than the content in the first portion.
The apparatus may be configured to enable display of second content in the second portion such that the second content is displayed at a different scale than the first content displayed in the first portion.
The content of the first portion may comprise one or more of an application screen, data presented within an application screen, and a desktop and second content displayed in the second portion may comprise one or more of an application screen, data presented within an application screen, and a desktop.
The detected hand gesture may be one or more of a hover hand gesture and a touch hand gesture.
The detection of the inclination of the hand gesture may be based on one or more of the detection of a shadow cast by the hand gesture and a three-dimensional shape recognition of the hand gesture.
The apparatus may be configured to one or more of perform the detection of the inclination of a hand gesture and receive an indication of the detected inclination of a hand gesture from another apparatus.
The apparatus may be a portable electronic device, a laptop computer, a mobile phone, a smartphone, a tablet computer, a smart television, a personal digital assistant, a navigation device, a watch, a digital camera, a non-portable electronic device, a server, a desktop computer, a monitor/display, or a module/circuitry for one or more of the same.
In a further aspect there is provided a method comprising, based on a detected inclination of a hand gesture relative to a display screen displaying content, splitting the display screen into a first portion displaying the content and a second portion.
The inclination may be with respect to a particular side of the display screen and wherein the particular side may be one of a left-hand side, right-hand side, top side, bottom side, top-left-hand corner, top-right-hand corner, bottom-left-hand-corner, and bottom-right-hand corner.
The method may comprise splitting the display screen with the first portion being displayed on a particular side of the display screen based on the inclination being towards the particular side of the display screen.
The method may comprise splitting the display screen with the first portion being displayed on an opposing side to a particular side of the display screen based on the inclination being towards the particular side of the display screen.
The second portion may be displayed on an opposing side of the display to the first portion.
The first portion may display one of all of the content and part of the content.
The method may enable scrolling through content in the first or second portion, which is not obscured by the detected inclination of the hand gesture, based on a particular degree of inclination of the hand gesture.
The delineation of the first portion and the second portion may be based on the location of the hand gesture relative to the display screen.
The size of the split of the display screen into respective first portions and second portions may be based on a particular degree of inclination of the hand gesture.
The content of the first portion may be associated with a first application and the apparatus may be further configured to enable display of new content, associated with a second application, in the second portion.
The method may enable one or more of: presentation to a user of an option to select new content to be displayed in the second portion; presentation to a user of a plurality of icons associated with a plurality of content items, wherein selection of a particular icon enables display of the associated particular content in the second portion; and presentation to a user of a plurality of icons associated with a plurality of content items, wherein selection of a particular icon is based on a particular degree of inclination of the hand gesture and enables display of the associated particular content in the second portion.
The method may, based on a selected at least part of the content, provided for further content, in respect of the selected part, in the second portion.
The second portion may comprise a new viewing pane with second content from a background application.
The second portion may be available for displaying one of second content different to the content displayed in the first portion and new content associated with the first portion.
Second content may be displayed in the second portion such that the second content is one of the content of the first portion displayed in a different manner to the display in the first portion and based on different content than the content in the first portion.
The second content may be displayed in the second portion such that the second content is displayed at a different scale than the first content displayed in the first portion.
The content of the first portion may comprise one or more of an application screen, data presented within an application screen, and a desktop and second content displayed in the second portion may comprise one or more of an application screen, data presented within an application screen, and a desktop.
The detected hand gesture may be one or more of a hover hand gesture and a touch hand gesture.
The detection of the inclination of the hand gesture may be based on one or more of the detection of a shadow cast by the hand gesture and a three-dimensional shape recognition of the hand gesture.
The method may perform one or more of the detection of the inclination of a hand gesture and receive an indication of the detected inclination of a hand gesture from another method.
In a further aspect there is provided a computer readable medium comprising computer program code stored thereon, the computer readable medium and computer program code being configured to, when run on at least one processor, perform at least the following, based on a detected inclination of a hand gesture relative to a display screen displaying content, split the display screen into a first portion displaying the content and a second portion.
Corresponding computer programs for implementing one or more of the methods disclosed are also within the present disclosure and encompassed by one or more of the described examples.
In a further aspect there is provided an apparatus, the apparatus comprising means for splitting a display screen displaying content, based on a detected inclination of a hand gesture, into a first portion displaying the content and a second portion.
In a further aspect, there is disclosed an apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following, based on one or more of a detected degree of and direction of inclination of a hand gesture relative to a display screen displaying content, split the display screen into a first portion displaying the content and a second portion.
In a further aspect, there is provided an apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following, based on the location of a hand gesture relative to a display screen displaying content, split the display screen into a first portion displaying the content and a second portion.
Corresponding methods and computer programs for these aspects are also disclosed, including in appropriate combination with the aforementioned specific embodiments.
The present disclosure includes one or more corresponding aspects, examples or features in isolation or in various combinations whether or not specifically stated (including claimed) in that combination or in isolation. Corresponding means and corresponding functional units (e.g. display screen splitter, inclination detector, content displayer) or performing one or more of the discussed functions are also within the present disclosure.
The above summary is intended to be merely exemplary and non-limiting.
A description is now given, by way of example only, with reference to the accompanying drawings, in which:
Certain embodiments disclosed herein may be considered to provide an apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following, based on a detected inclination of a hand gesture relative to a display screen displaying content, split the display screen into a first portion displaying the content and a second portion.
For example, a user may position their hand over a portion of a display screen (an input and output user interface) that is displaying content. The display may detect the hand gesture and split the screen into a first portion that is not underneath the user's hand and then display the content in the first portion. In this case, the user interface used to detect the hand is part of the display screen such that the hand gesture over the display is detected. In other examples the user interface used to detect the hand gesture may be separate and not be part of the display screen. In some examples, an appropriate relationship between the hand gesture detector and the display screen is included to ensure performance of embodiments according to the present disclosure.
In this embodiment the apparatus 100 is an Application Specific Integrated Circuit (ASIC) for a portable electronic device with a touch sensitive display. In other embodiments the apparatus 100 can be a module for such a device, or may be the device itself, wherein the processor 108 is a general purpose Central Processing Unit (CPU) of the device and the memory 107 is general purpose memory comprised by the device.
The input I allows for receipt of signalling to the apparatus 100 from further components, such as components of a portable electronic device (like a touch-sensitive or hover-sensitive display) or the like. The output O allows for onward provision of signalling from within the apparatus 100 to further components such as a display screen, speaker, or vibration module. In this embodiment the input I and output O are part of a connection bus that allows for connection of the apparatus 100 to further components.
The processor 108 is a general purpose processor dedicated to executing/processing information received via the input I in accordance with instructions stored in the form of computer program code on the memory 107. The output signalling generated by such operations from the processor 108 is provided onwards to further components via the output O.
The memory 107 (not necessarily a single memory unit) is a computer readable medium (solid state memory in this example, but may be other types of memory such as a hard drive, ROM, RAM, Flash or the like) that stores computer program code. This computer program code stores instructions that are executable by the processor 108, when the program code is run on the processor 108. The internal connections between the memory 107 and the processor 108 can be understood to, in one or more example embodiments, provide an active coupling between the processor 108 and the memory 107 to allow the processor 108 to access the computer program code stored on the memory 107.
In this example the input I, output O, processor 108 and memory 107 are all electrically connected to one another internally to allow for electrical communication between the respective components I, O, 107, 108. In this example the components are all located proximate to one another so as to be formed together as an ASIC, in other words, so as to be integrated together as a single chip/circuit that can be installed into an electronic device. In other examples one or more or all of the components may be located separately from one another.
The example embodiment of
The apparatus 100 in
The storage medium 307 is configured to store computer code configured to perform, control or enable the operation of the apparatus 100. The storage medium 307 may be configured to store settings for the other device components. The processor 308 may access the storage medium 307 to retrieve the component settings in order to manage the operation of the other device components. The storage medium 307 may be a temporary storage medium such as a volatile random access memory. The storage medium 307 may also be a permanent storage medium such as a hard disk drive, a flash memory, a remote server (such as cloud storage) or a non-volatile random access memory. The storage medium 307 could be composed of different combinations of the same or different memory types.
In the example shown in
In some examples, the apparatus may be configured such that the second portion is displayed on an opposing side of the display to the first portion, as in
In some examples, the apparatus may be configured such that the first portion displays one of all of the content and part of the content. For example,
It will be appreciated that the boundary 408 between the first portion 404 and the second portion 406 of the display screen 400 need not be a straight line as illustrated in
It will be appreciated that whereas
In some examples, the apparatus may be configured to enable scrolling through content in the first or second portion, which is not obscured by the detected inclination of the hand gesture, based on a particular degree of inclination of the hand gesture. It will be appreciated that since the hand gesture is performed proximal to the display screen, in certain embodiments, a part of the display screen may be obscured by the user's hand. In some examples the first portion may be selected to occupy a part of the screen that is not obscured by the user's hand. Equally, the second portion may be selected to occupy a part of the screen that is not obscured by the user's hand.
If the apparatus is configured to scroll or slide the content displayed, based on a detected inclination of the hand gesture, then the apparatus may be configured to scroll or slide the content to a particular point. For example, a particular degree of inclination may scroll the content comprising lines of text down by a particular number of lines of text. In some examples, the content may scroll or slide at a particular speed based on the detected degree of inclination of the hand gesture. For example, a greater degree of inclination may result in a faster rate of scrolling or sliding. Similarly, if the user reduces the degree of inclination of their hand gesture the apparatus may be configured to slow down the rate of scrolling or sliding, and for a particular degree of inclination the apparatus may be configured to stop scrolling or sliding the content.
The apparatus may display an indication of the location of the boundary to the user, which would move with lateral (e.g. up/down/left/right) movement of the hand gesture. This may be more important where the hand gesture detector is located remote from the display screen so as to provide a visual clue to the user as to where the screen is to be split.
In some examples, the apparatus may be configured to size the split of the display screen into respective first portions and second portions based on a particular degree of inclination of the hand gesture. For example, the user may rotate their hand about an axis approximately parallel to the surface of the display screen, or more generally the gesture detector, and the apparatus may be configured to increase the size of the first portion, or the size of the second portion, based on the detected degree of the rotation of the user's hand. Similarly, the degree of inclination of the hand gesture may be used to control the degree of zooming of content in the first and/or second portion, for example see
In some examples, the apparatus may be configured such that the second portion is available for displaying one of second content different to the content displayed in the first portion and new content associated with the first portion. For example, the second content may be derived from a second application that is unrelated to the application that provides the content. In some examples, the second content displayed in the second portion may be derived from the content prior to the splitting.
In some examples, the apparatus may be configured to enable display of second content in the second portion such that the second content is one of the content of the first portion displayed in a different manner to the display in the first portion, and based on different content than the content in the first portion. For example, in the former case, if the content consists of a colour picture, the second content may consist of a black and white version of the picture. Similarly, the font could be changed. In the latter case, the different content may be the provision of a web-browser or a search field which would allow browsing/searching of content different (although in some cases related) to the first portion content.
In the case of searching/browsing of related content, the browser address field or search entry field could automatically be filled in using content selected from the first portion, for example by specific user selection of the content or by automatic recognition of content from the first portion, for example auto-highlighting of text which the user can vary by changing the degree of inclination. Thus, for example, a higher inclination in one direction would move the auto-highlighting, or previous selection, to the next text in the same direction, and vice versa. This can be seen in the context of
In some examples, the apparatus is configured to enable one of display of second content in the second portion such that the second content is displayed at a different scale than the first content displayed in the first portion and display of second content in the second portion such that the second content is based on a background application.
In some examples, the content of the first portion may be associated with a first application and the apparatus may be further configured to enable display of new content, associated with a second application, in the second portion. For example, the content may be text provided by a word processor application and the second portion may display a picture provided by a photo-editor application. The opening of specific applications may be based on defaults, which can be pre-set prior to the splitting or by user selection upon splitting.
In some examples, the apparatus may be configured to enable one of: presentation to a user of an option to select new content to be displayed in the second portion; presentation to a user of a plurality of icons associated with a plurality of content items, wherein selection of a particular icon enables display of the associated particular content in the second portion; and presentation to a user of a plurality of icons associated with a plurality of content items, wherein selection of a particular icon is based on a particular degree of inclination of the hand gesture and enables display of the associated particular content in the second portion.
In some examples, the content of the first portion may comprise one or more of an application screen, data presented within an application screen, and a desktop and second content displayed in the second portion may comprise one or more of an application screen, data presented within an application screen, and a desktop. It will be appreciated that the application, data or desktop of the second portion may or may not be associated with the content of the first portion. For example, the first portion may comprise the desktop of the apparatus while the second portion may comprise the desktop of a second apparatus that is in data communication with the apparatus. This may, for example, enable transfer of data from the apparatus, which may be a laptop computer, to the desktop of the second apparatus, which may be a smartphone linked to the laptop computer.
In some examples, the detected hand gesture may be one or more of a hover hand gesture and a touch hand gesture. A hover hand gesture may comprise a user holding their hand at a particular distance away from the display screen. A touch hand gesture may comprise the user bringing some part or parts of their hand into physical contact with the display screen. For example, a user might touch the display screen, or other gesture detector, with the edge of their hand or with the palm of their hand or the back of their hand or with one or more of their fingers.
In some examples, the detection of the inclination of the hand gesture may be based on one or more of the detection of a shadow cast by the hand gesture and a three-dimensional shape recognition of the hand gesture. In certain optional cases, the detection of the inclination may be confirmed by the hand gesture being completed by touching the user interface with the hand gesture at the end of the hand gesture.
For example, detection of a shadow cast by the hand gesture may comprise detecting a projection of the hand gesture using a camera. For example, the camera may detect a particular (or any) reduction in light and/or increase in darkness caused by the shadow. This may be detected by the apparatus, or another apparatus separate from the apparatus but which provides the appropriate detection information to the apparatus. In the case of the confirmation by completing the hand gesture by touching the user interface, the touching of the user interface at the completion of the hand gesture would confirm that the increasing darkness/reducing light was due to a hand gesture inclination detection.
Recognition of a three-dimensional shape of the hand gesture may comprise determining the particular configuration of the user's hand, both in its location relative to the display screen and in the location of different parts of the anatomy of the hand in relation to each other. Similarly, this three-dimensional shape may be detected by the apparatus, or another apparatus separate from the apparatus but which provides the appropriate detection information to the apparatus. For example, the apparatus may be configured to split the screen in a particular way, or to provide the first portion, or the second portion, at a particular location of the display screen based on recognition of a particular three-dimensional shape of hand gesture. Examples may include providing, in the second portion, a magnified image of a portion of picture content where the particular portion of the picture content is selected based on recognition of a three-dimensional pointing gesture where the user points a finger or fingers at the particular portion of the picture content. In the case of the confirmation by completing the hand gesture by touching the user interface, the touching of the user interface at the completion of the hand gesture would confirm that the hand gesture has been completed.
In some examples, the apparatus may be configured to one or more of perform the detection of the inclination of a hand gesture and receive an indication of the detected inclination of a hand gesture from another apparatus. For example, the systems required to perform the detection of the inclination of a hand gesture may be included within the apparatus. In other examples, a second apparatus may perform the detection of the inclination of the hand gesture and then provide data representative of the detected inclination of the hand gesture to the apparatus.
In the above disclosure, examples have been provided in which the apparatus may detect an inclination of a hand gesture made by only one of a user's hands. It will be appreciated that in other examples, the apparatus may detect inclinations of both a user's left hand and the user's right hand. Detection of gestures made with both of a user's hands simultaneously may provide a greater number of different gestures that may provide a greater flexibility in controlling the apparatus.
The 3-D hover-sensitive layer may be able to detect hovering objects 706, such as a hand, or hands, within the virtual mesh 704. In some examples the layer may also be configured to detect touch inputs (wherein the user's finger or pen, for example, make physical contact with the layer). The virtual mesh 704 may extend past the edges of the display screen 702 in the plane of the display screen 702. The virtual mesh 704 may be able to determine the shape, location, movements and speed of movement of the object 706 based on objects detected within the virtual mesh 704. Thus, for example, the virtual mesh 704 may be able to discriminate between different inclinations of a hand gesture user input as described herein, and may be able to determine the position and location of the user's hand(s) relative to the display screen 702.
In other examples, an inclination of a hand gesture may be detected and/or confirmed by one or more of: a camera, an infra-red camera, a heat sensor and a light sensor.
The apparatus shown in the above examples may be a portable electronic device, a laptop computer, a mobile phone, a smartphone, a tablet computer, a smart television, a personal digital assistant, a navigation device, a watch, a digital camera, a non-portable electronic device, a server, a desktop computer, a monitor/display, or a module/circuitry for one or more of the same.
Any mentioned apparatus/device/server and/or other features of particular mentioned apparatus/device/server may be provided by apparatus arranged such that they become configured to carry out the desired operations only when enabled, e.g. switched on, or the like. In such cases, they may not necessarily have the appropriate software loaded into the active memory in the non-enabled (e.g. switched off state) and only load the appropriate software in the enabled (e.g. on state). The apparatus may comprise hardware circuitry and/or firmware. The apparatus may comprise software loaded onto memory. Such software/computer programs may be recorded on the same memory/processor/functional units and/or on one or more memories/processors/functional units.
In some examples, a particular mentioned apparatus/device/server may be pre-programmed with the appropriate software to carry out desired operations, and wherein the appropriate software can be enabled for use by a user downloading a “key”, for example, to unlock/enable the software and its associated functionality. Advantages associated with such examples can include a reduced requirement to download data when further functionality is required for a device, and this can be useful in examples where a device is perceived to have sufficient capacity to store such pre-programmed software for functionality that may not be enabled by a user.
Any mentioned apparatus/circuitry/elements/processor may have other functions in addition to the mentioned functions, and that these functions may be performed by the same apparatus/circuitry/elements/processor. One or more disclosed aspects may encompass the electronic distribution of associated computer programs and computer programs (which may be source/transport encoded) recorded on an appropriate carrier (e.g. memory, signal).
Any “computer” described herein can comprise a collection of one or more individual processors/processing elements that may or may not be located on the same circuit board, or the same region/position of a circuit board or even the same device. In some examples one or more of any mentioned processors may be distributed over a plurality of devices. The same or different processor/processing elements may perform one or more functions described herein.
The term “signalling” may refer to one or more signals transmitted as a series of transmitted and/or received electrical/optical signals. The series of signals may comprise one, two, three, four or even more individual signal components or distinct signals to make up said signalling. Some or all of these individual signals may be transmitted/received by wireless or wired communication simultaneously, in sequence, and/or such that they temporally overlap one another.
With reference to any discussion of any mentioned computer and/or processor and memory (e.g. including ROM, CD-ROM etc.), these may comprise a computer processor, Application Specific Integrated Circuit (ASIC), field-programmable gate array (FPGA), and/or other hardware components that have been programmed in such a way to carry out the inventive function.
The applicant hereby discloses in isolation each individual feature described herein and any combination of two or more such features, to the extent that such features or combinations are capable of being carried out based on the present specification as a whole, in the light of the common general knowledge of a person skilled in the art, irrespective of whether such features or combinations of features solve any problems disclosed herein, and without limitation to the scope of the claims. The applicant indicates that the disclosed aspects/examples may consist of any such individual feature or combination of features. In view of the foregoing description it will be evident to a person skilled in the art that various modifications may be made within the scope of the disclosure.
While there have been shown and described and pointed out fundamental novel features as applied to examples thereof, it will be understood that various omissions and substitutions and changes in the form and details of the devices and methods described may be made by those skilled in the art without departing from the scope of the disclosure. For example, it is expressly intended that all combinations of those elements and/or method steps which perform substantially the same function in substantially the same way to achieve the same results are within the scope of the disclosure. Moreover, it should be recognized that structures and/or elements and/or method steps shown and/or described in connection with any disclosed form or examples may be incorporated in any other disclosed or described or suggested form or example as a general matter of design choice. Furthermore, in the claims means-plus-function clauses are intended to cover the structures described herein as performing the recited function and not only structural equivalents, but also equivalent structures. Thus although a nail and a screw may not be structural equivalents in that a nail employs a cylindrical surface to secure wooden parts together, whereas a screw employs a helical surface, in the environment of fastening wooden parts, a nail and a screw may be equivalent structures.
Claims
1-29. (canceled)
30. An apparatus comprising:
- at least one processor; and
- at least one memory including computer program code,
- the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:
- based on a detected inclination of a hand gesture relative to a display screen displaying content, split the display screen into a first portion displaying the content and a second portion.
31. The apparatus of claim 30, wherein the inclination is with respect to a particular side of the display screen and wherein the particular side is one of a left-hand side, right-hand side, top side, bottom side, top-left-hand corner, top-right-hand corner, bottom-left-hand-corner, and bottom-right-hand corner.
32. The apparatus of claim 30, wherein the apparatus is configured such that an inclination towards a particular side of the display screen splits the display screen with the first portion being displayed on that particular side of the display screen.
33. The apparatus of claim 30, wherein the apparatus is configured such that an inclination towards a particular side of the display screen splits the display screen with the first portion being displayed on an opposing side to that particular side of the display screen.
34. The apparatus of claim 30, wherein the apparatus is configured such that the second portion is displayed on an opposing side of the display to the first portion.
35. The apparatus of claim 30, wherein the apparatus is configured to enable scrolling through content in the first or second portion, which is not obscured by the detected inclination of the hand gesture, based on a particular degree of inclination of the hand gesture.
36. The apparatus of claim 30, wherein the apparatus is configured to size the split of the display screen into respective first portions and second portions based on a particular degree of inclination of the hand gesture.
37. The apparatus of claim 30, wherein, based on a selected at least part of the content, provide for further content in respect of the selected part in the second portion.
38. The apparatus of claim 37, wherein the selected at least part of the content is used as a search entry for searching for further data to be provided in the second portion.
39. The apparatus of claim 38, wherein the search entry is automatically filled based on user selection of content from the first portion or by automatic recognition of content from the first portion.
40. The apparatus of claim 39, wherein the automatic recognition includes auto-highlighting of text which the user can vary by changing the degree of inclination or auto-highlighting one or more nouns from the first portion content.
41. The apparatus of claim 30, wherein the second portion comprises a new viewing pane with second content from a background application.
42. The apparatus of claim 30, wherein the apparatus is configured to enable display of second content in the second portion such that the second content is one of the content of the first portion displayed in a different manner to the display in the first portion and based on different content than the content in the first portion.
43. The apparatus of claim 30, wherein the apparatus is configured to enable display of second content in the second portion such that the second content is displayed at a different scale than the first content displayed in the first portion.
44. The apparatus of claim 30, wherein the second portion provides a web-browser or search field which allows for browsing/searching of content different to the first portion content.
45. The apparatus of claim 30, wherein the detection of the inclination of the hand gesture is based on one or more of the detection of a shadow cast by the hand gesture and a three-dimensional shape recognition of the hand gesture.
46. A method comprising, based on a detected inclination of a hand gesture relative to a display screen displaying content, splitting the display screen into a first portion displaying the content and a second portion.
47. A computer readable medium comprising computer program code stored thereon, the computer readable medium and computer program code being configured to, when run on at least one processor, perform at least the following:
- based on a detected inclination of a hand gesture relative to a display screen displaying content, split the display screen into a first portion displaying the content and a second portion.
Type: Application
Filed: Feb 5, 2015
Publication Date: Dec 1, 2016
Inventors: Peter Eskolin (Pirkkala), Lauri Jaaskela (Tampere)
Application Number: 15/116,640