CUSTOMIZATION OF AN IMMERSIVE ENVIRONMENT
A computing device includes an immersive environment module for facilitating simultaneous display of a plurality of applications on a display device without relying on system chrome. At least a first of the applications is displayed in a primary region of the display. The computing device also includes a UI management component for enabling a user selection of an application for simultaneous display on the display device with at least one other application. Processing logic is configured to determine a size in at least one direction of content of a user-selected application as it is displayed on a non-primary region of the display device simultaneous with display of content of the first application on the primary region of the display device. The determination is based at least in part on one or more pre-defined size requirements specified by the selected application.
Latest Microsoft Patents:
- Systems and methods for electromagnetic shielding of thermal fin packs
- Application programming interface proxy with behavior simulation
- Artificial intelligence workload migration for planet-scale artificial intelligence infrastructure service
- Machine learning driven teleprompter
- Efficient electro-optical transfer function (EOTF) curve for standard dynamic range (SDR) content
Managing applications and corresponding running items (e.g., open windows) on a computer has become increasingly difficult and burdensome, as computers are more heavily relied upon now than in the past. The availability of computers having increased computer speed and memory, in addition to improved overall computer performance over the last several years has provided users with the capability to efficiently run multiple applications at the same time, which was not practical in the past. Users can run a large variety of applications, and frequently run more than one application at a time.
Conventional operating systems permit users to view and interact with multiple computing applications through windows. Each of these windows generally includes a frame having controls for interacting with the computing application as well as controls for moving, sizing, or otherwise managing the layout of the window. These window frames, however, occupy portions of a display that might otherwise be dedicated to an application's content. Furthermore, managing the layouts of these windows through these controls can be time-consuming, annoying and distracting to users,
SUMMARYThis document describes techniques and apparatuses for creating an immersive environment. The immersive environment described herein can present multiple applications without dedicating significant amounts of a display to window frames for the applications. These techniques and/or apparatuses enable a user to view and interact with the content of a single application that is presented full screen (i.e., without system chrome) on a display while maintaining much of the power and flexibility that is available when multiple window frames are available. System chronic refers to the user-interactive graphical elements provided by the system for identifying and managing the regions or windows In some implementations the amount of space allocated to the applications when they are presented in a non-primary region of the display may be determined at least in part on minimum and/or maximum sizes that are specified by the applications themselves. This capability allows application developers to effectively participate in the process used by the computing device when determining how the content of their applications will be presented on the display. For example, different content from different applications may require different amounts of screen space in order to be useful. Accordingly, different applications may specify different minimum sizes below which they should not be presented on the display. Likewise, there may be a maximum size above which content may no longer be useful in practice, because of content limitations or other reasons.
This summary is provided to introduce simplified concepts for managing an immersive environment that are further described below in the Detailed. Description. This summary is not intended to identify essential features of the claimed subject matter, nor is it intended for use in determining the scope of the claimed subject matter. Techniques and/or apparatuses for managing an immersive environment are also referred to herein separately or in conjunction as the “techniques” as permitted by the context.
Embodiments for managing an immersive environment are described with reference to the following drawings. The same numbers are used throughout the drawings to reference like features and components:
Some operating systems permit users to view and interact with a single computing application with little or no window frame, generally by presenting content of an application on all or nearly all of a computer's display. While this technique permits more of an application's content to be viewed, it lacks much of the flexibility permitted by the window-based techniques
This document describes techniques and apparatuses for creating an immersive environment in which a user can view and interact with the content of a single application that is presented full screen (i.e., without system chrome) on a display while maintaining much of the power and flexibility that is available when multiple window frames are available. In particular, the immersive environment can present multiple applications without dedicating significant portions of the display to window frames for the applications.
Example EnvironmentComputing device 102 includes computer processor(s) 116 and computer-readable storage media 118 (media 118). Media 118 includes an operating system 120, immersive environment module 122, manager module 124, and applications 126, each of which may provide content 128. Computing device 102 also includes or has access to one or more displays 130, four examples of which are illustrated in
Immersive environment module 122 provides an environment by which a user may view and interact with one or more of applications 126 and corresponding content 128. In some embodiments, this environment presents content of, and enables interaction with, applications with little or no window frame and/or without a need for a user to manually size or position content. This environment can be, but is not required to be, hosted and/or surfaced without use of a windows-based desktop environment. Thus, in sonic cases immersive environment module 122 presents an immersive environment that is not a window (even one without a substantial frame) and precludes usage of desktop-like displays (e.g., a taskbar). Further still, in some embodiments this immersive environment is similar to an operating system in that it is not closeable or capable of being un-installed. Examples of immersive environments are provided below as part of describing the techniques, though they are not exhaustive or intended to limit the techniques.
Manager module 124 enables a user to manage an immersive environment and applications 126 presented in the environment. Manager 124 and/or module 122 can be separate from each other and/or operating system 120, or may be combined or integrated in some form. Thus, in some cases operating system 120 includes immersive environment module 122 and manager 124.
The applications that present content in the primary region 304 and the non-primary region 306 are not limited to the aforementioned web browser and document-viewing applications. Other illustrative examples of applications that may be presented in the immersive environment 302 include, without limitation, spreadsheet applications, word processing applications, email applications, photo editing applications and the like. Moreover, it should be emphasized that while the content of two applications is shown in the non-primary region 306, the non-primary region 306 more generally may present the content of any number of applications, including the content of only a single application.
In a preferred implementation, the immersive environment 302 in the application work area 300 does not include any system chrome. System chrome refers to the user-interactive graphical elements provided by the system for identifying and managing the regions or windows (e,g., primary and non-primary regions 304 and 306). For example, in the case of Microsoft Windows®, system chrome includes the start button, maximize and minimize buttons, taskbars, title bar labels, and so on. System chrome does not include, however, non-user interactive graphical elements such as visible lines and blank areas that may be provided to visually separate the content of different applications but which do not allow the user to manage the applications.
In some implementations the primary region 304 occupies a substantially larger portion of the work area 300 than the non-primary region 306. This allows the user to interact with applications that present content in the primary region 304 which is currently the principal focus of the user's attention. Content presented by other applications which is of lesser immediate importance or less demanding of the user's attention may then be presented in the smaller non-primary region 306 of the work area 300. In this way the user can focus on his or her most important tasks, while still having immediately access to the content provided by other applications.
The non-primary region 306 may be presented anywhere within the work area 300. Its location may he fixed or variable. For instance, in the case of a variable location, the location of the non-primary region may be user-selectable and/or selected by immersive environment module 124 based, for example, on the capabilities of the display device. On the other hand, if the location of the non-primary region 306 is fixed, it may be docked to one side of the work area 300. Such an arrangement, which is shown in the example of
Block 202 presents an immersive environment on a display. The immersive environment does not include system chrome. At block 204 a first region and a second region are defined within the immersive environment. The first and second regions do not overlap with one another and therefore are visible to a user at the same time. The first region may be a primary region that is larger in size than the second region. The second region may then serve as :non-primary region that is docked to one side of the display.
At block 206 the content of a first executing user-interactive application is presented in the first region. Likewise, at block 208 the content of one or more other executing user-interactive applications are presented in the second region. The content respectively presented in the first and second regions is presented simultaneously with one another. When two or more applications are presented in the non-primary region, they may be arranged so that they do not overlap one another.
In some cases the non-primary region may be fixed in size. Accordingly, to ensure that content presented by different applications do not overlap with one another, as additional content from additional applications is presented in the non-primary region, the amount of space allocated to each application decreases. For instance,
The content displayed in the primary region may be replaced with the content of another application. For instance, if the user opens a new application that is to be presented in the primary region, the content that is currently being presented may be removed from the immersive environment or, alternatively, it may be moved into the non-primary region.
In some cases the content of one or more applications can be maintained (“pinned”) on the display by the user. When an application is pinned, the application remains in either the primary region or the non-primary region, and is movable from one region to the other. For instance, if the user pins the content 312, 314 and 320 in
In general, the content of a given applications may be able to be presented in both the primary region 304 and the non-primary region 306. In some cases, however, an application may be configured so that it can only be presented in one of the regions.
In some implementations the user may be able to remove the non-primary region 306 so that the content in the primary region 304 can occupy the entire work area. At a later time the user can also restore the non-primary region 306. In addition, under certain circumstances the manager 124 may automatically remove the non-primary region. For instance, if the display is rotated into portrait mode the non-primary region may be removed. Likewise, when it is rotated back to landscape mode the manager 124 may restore the non-primary region.
Any of a wide variety of techniques and apparatuses may be provided for allowing users to manage the immersive environment. Such user interface techniques enable a user to select when, where, and/or under what conditions to present applications in this immersive environment. For instance, the manager module 124 of
Regardless of the particular user interface that is employed, the techniques for creating an immersive environment discussed herein allow users to simultaneously manage multiple applications. Assume, for example, that a user wishes to select a music application that he used yesterday while maintaining an immersive presentation of work-related memos that are currently in a primary area of an immersive environment. These techniques can provide a user interface that presents recently-used applications, such as the music application, and enables the user to quickly and easily present the music application in the primary area while automatically moving the work-related memos into the non-primary area of the immersive environment.
Also by way of example, assume that a user wishes to begin his immersive session each day with the same three applications—a sports website, a business-news website, and work-related memos. These techniques permit the user to select these three applications to be automatically presented and maintained in the immersive environment. The user may simply open the immersive environment or logon to his computing device to have these three applications presented in the environment
In some implementations the amount of space allocated to the applications when they are presented in the non-primary region of the display may be determined at least in part on minimum maximum sizes that are specified by the applications themselves. This capability allows application developers to effectively participate in the process used by the immersive environment module 122 and/or the manager module 124 when determining how the content of their applications will be presented on the display. For example, different content from different applications may require different amount of screen space in order to be useful. Accordingly, different applications may specify different minimum sizes below which they should no longer be presented in the non-primary region of the display. Likewise, there may be a maximum size above which content may no longer be useful in practice, either because of resolution limitations or for other reasons.
To address these issues applications may specify the size or sizes at which they may be presented on a display device. The allowable size or sizes of an application may be specified in any suitable manner. For instance, an application may specify size requirements such as maximum and/or minimum size limits, a series (i.e., two or more) of different sizes at which the application's content may be presented, a single fixed size, and so on.
The applications may be configured in a well-known manner to expose one or more APIs (application programming interfaces) to enable the immersive environment module 122 and/or the manager module 124 to present the content of the applications in the non-primary region of a display in accordance with the applications' size requirements.
The manager module 124 will attempt to simultaneously present the content from all currently-executing applications while accommodating or satisfying the size requirements specified by each of those applications. To accomplish this the manager module 124 can be provisioned with display space allocation rules, which may include tie-breaking rules in the event that the size specifications of two or more applications cannot be satisfied. If it is not possible to satisfy the size requirements of any given application, the user will simply not be able to DOCK it in the non-primary region. To the extent that the immersive environment module. 122 and/or the manager module 124 can present the content of an application in multiple sizes supported by the application while accommodating any other currently-executing applications, the user may be given the opportunity to choose the size that is actually used.
As previously mentioned, in some implementations the non-primary region 306 shown in
The height specifications exposed by an application to the manager module 124 may include one or mandatory specifications that are required by the manager module 124. In addition, the manager module 124 may also recognize optional specifications. In some cases a minimum height may be a mandatory specification required by the manager module 124. The manager module 124 may require the minimum height to be no less than some specified value (e.g., between 48 and 240 pixels). If the application specifies an invalid value for the minimum height (i.e., a value outside of the minimum range required by the manager module 124), the application's content will be presented in the non-primary region with a height corresponding to some default value.
It should be noted that reference to height, height requirements, and the like is by way of illustration only. More generally, size requirements may refer to a size in any direction and not simply height. That is, a size requirement may specify the length in one direction of the area occupied by the content of an application in the non-primary region of the display. The direction may be along a vertical axis, a horizontal axis, or any axis therebetween.
The specification of a maximum height may be mandatory or optional. If it is specified it should be greater than the minimum specified height. In some cases it may have a default value, which, for example, may be set to infinity, in which case the content of the application will fill whatever portion of the non-primary region is unoccupied.
In some implementations the manager module 124 may also require applications to specify their fill capabilities, which may be specified by selecting among three options: fill, no fill, and fill to maximum size. If the fill option is selected, the application will fill whatever space (e.g., height) is available in the non-primary region down to its minimum size (e.g., height). If the no fill option is selected, the application will only be presented at its minimum size regardless of how much space is available in the non-primary region. Finally, if the fill to maximum size option is selected, the application will fill whatever space (e.g., height) is available in the non-primary region up to its maximum size.
The preceding discussion describes methods in which the techniques may operate to provide an immersive environment in the work area of a display. These methods are shown as sets of blocks that specify operations performed but are not necessarily limited to the order shown for performing the operations by the respective blocks.
Aspects of these methods may he implemented in hardware (e.g., fixed logic circuitry), firmware, software, manual processing, or any combination thereof. A software implementation represents program code that performs specified tasks when executed by a computer processor, such as software, applications, routines, programs, objects, components, data structures, procedures, modules, functions, and the like. The program code can be stored in one or more computer-readable memory devices, both local and/or remote to a computer processor. The methods may also be practiced in a distributed computing environment by multiple computing devices.
Example DeviceDevice 1100 includes communication devices 1102 that enable wired and/or wireless communication of device data 1104 (e.g., received data, data that is being received, data scheduled for broadcast, data packets of the data, etc.). Device data 1104 or other device content can include configuration settings of the device, media content stored on the device, and/or information associated with a user of the device. Media content stored on device 1100 can include any type of audio, video, and/or image data. Device 1100 includes one or more data inputs 1106 via which any type of data, media content, and/or inputs can be received, such as user-selectable inputs, messages, music, television media content, recorded video content, and any other type of audio, video, and/or image data received from any content and/or data source.
Device 1100 also includes communication interfaces 1108, which can be implemented as any one or more of a serial and/or parallel interface, a wireless interface, any type of network interface, a modem, and as any other type of communication interface. Communication interfaces 1108 provide a connection and/or communication links between device 1100 and a communication network by which other electronic, computing, and communication devices communicate data with device 1100.
Device 1100 includes one or more processors 1110 (e.g., any of microprocessors, controllers, and the like), which process various computer-executable instructions to control the operation of device 1100 and to implement embodiments for managing an immersive environment. Alternatively or in addition, device 1100 can be implemented with any one or combination of hardware, firmware, or fixed logic circuitry that is implemented in connection with processing and control circuits that are generally identified at 1112. Although not shown, device 1100 can include a system bus or data transfer system that couples the various components within the device. A system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures.
Device 1100 also includes computer-readable storage media 1114, such as one or more memory devices that enable persistent and/or non-transitory data storage (in contrast to mere signal transmission), examples of which include random access memory (RAM), non-volatile memory (e.g., any one or more of a read-only memory (ROM), flash memory, EPROM, EEPROM, etc.), and a disk storage device. A disk storage device may be implemented as any type of magnetic or optical storage device, such as a hard disk drive, a recordable and/or rewriteable compact disc (CD), any type of a digital versatile disc (DVD), and the like. Device 1100 can also include a mass storage media device 1116.
Computer-readable storage media 1114 provides data storage mechanisms to store device data 1104, as well as various device applications 1118 and any other types of information and/or data related to operational aspects of device 1100. For example, device operating system 1120 can be maintained as a computer application with computer-readable storage media 1114 and executed on processors 1110. Device applications 1118 may include a device manager, such as any form of a control application, software application, signal-processing and control module, code that is native to a particular device, a hardware abstraction layer for a particular device, and so on.
Device applications 1118 also include any system components or modules to implement techniques for managing an immersive environment. In this example, device applications 1118 can include video content applications 1122, such as when device 1100 is implemented as a client device. Alternatively or in addition, device applications 1118 can include a video content service 1124, such as when device 1100 is implemented as a media content service. Video content applications 1122 and video content service 1124 are shown as software modules and/or computer applications. Alternatively or in addition, video content applications 1122 and/or video content service 1124 can be implemented as hardware, software, firmware, or any combination thereof,
Device 1100 also includes an audio and/or video rendering system 1126 that generates and provides audio data to an audio system 1128 and/or generates and provides display data to a display system 1130. Audio system 1128 and/or display system 1130 can include any devices that process, display, and/or otherwise render audio, display, and image data. Display data and audio signals can be communicated from device 1100 to an audio device and/or to a display device via an RE (radio frequency) link, S-video link, composite video link, component video link, DVI (digital video interface), analog audio connection, or other similar communication link. In an embodiment, audio system 1128 and/or display system 1130 are implemented as external components to device 1100. Alternatively, audio system 1128 and/or display system 1130 are implemented as integrated components of device 1100.
Techniques for providing an immersive environment, of which the above-described methods are examples, may be embodied on one or more of the entities shown in system 100 of
Although embodiments of techniques and apparatuses for managing an immersive environment have been described in language specific to features and/or methods, it is to be understood that the subject of the appended claims is not necessarily limited to the specific features or methods described. Rather, the specific features and methods are disclosed as example implementations for managing an immersive environment.
Claims
1. A computer-implemented method comprising:
- enabling selection of an application for parallel presentation in an immersive environment on one or more displays associated with a computing device;
- responsive to selection, causing content of the selected application to be displayed in a non-primary region of the immersive environment and in parallel with a display of content of a different application presented in a primary region of the immersive environment; and
- determining a size in at least one direction of the content of the selected application as it is displayed in the non-primary region based at least in part on one or more pre-defined size requirements specified by the selected application.
2. The computer-implemented method of claim 1 wherein determining the size of the content of the selected application in the at least one direction is further based at least in part on predefined size requirements in the at least one direction which are specified by content of any additional applications that are displayed or are to be displayed in the non-primary region.
3. The computer-implemented method of claim 1 wherein the predefined size requirements include a minimum size in the at least one direction.
4. The computer-implemented method of claim 3 wherein the predefined size requirements include a maximum size in the at least one direction.
5. The computer-implemented method of claim 4 wherein the maximum size is infinite.
6. The computer-implemented method of claim 1 wherein the predefined size requirements specify whether the content of the selected application is to be presented at its minimum size or a size that fills any unoccupied space in the non-primary region down to the minimum size or up to its maximum size.
7. The computer-implemented method of claim 1 wherein the predefined size requirement is a fixed size in the at least one direction.
8. The computer-implemented method of claim 2 further comprising resizing content of at least one of the additional applications displayed in the non-primary region so that the predefined size requirements of the additional applications and the selected application are satisfied.
9. The computer-implemented method of claim 1 wherein determining the size of the content of the selected application in the at least one direction includes maximizing the size of the content of the selected application in the at least one direction while satisfying other predefined size requirements in the at least one direction which are specified by any additional applications having content that is displayed or is to be displayed in the non-primary region, wherein the maximized size of the content of the selected application does not exceed a maximum size specified in the predefined size requirements for the selected application.
10. The computer-implemented method of claim 3 further comprising, in response to a second selection to minimize content of the selected application, reducing the content of the selected application in size in the at least one direction to the minimum size specified by the one or more pre-defined size requirements.
11. A computing device, comprising:
- immersive environment module for facilitating simultaneous display of a plurality of applications on a display device without system chrome, at least a first of the applications being displayed in a primary region of the display;
- a UI management component arranged for enabling a user selection of an application for simultaneous display on the display device with at least one other application; and
- processing logic configured to determine a size in at least one direction of content of a user-selected application as it is displayed on a non-primary region of the display device simultaneous with display of content of the first application on the primary region of the display device, said determination being based at least in part on one or more pre-defined size requirements specified by the selected application.
12. The computing device of claim 11 wherein the processing logic is further configured to determine the size of the selected application in the at least one direction based at least in part on predefined size requirements in the at least one direction which are specified by any additional applications that are displayed or are to be displayed in the non-primary region.
13. The computing device of claims 12 wherein the predefined size requirements include a minimum and maximum size in the at least one direction.
14. The computing device of claim 13 wherein the predefined size requirements specify whether the content of the selected application is to be presented at its minimum size or a size that fills any unoccupied space in the non-primary region down to the minimum size or up to its maximum size.
15. The computing device of claim 12 wherein the predefined size requirement is a fixed size in the at least one direction.
16. The computing device of claim 15 wherein the processing logic is further configured to resize content of at least one of the additional applications displayed in the non-primary region so that the predefined size requirements of the additional applications and the selected application are satisfied.
17. A method for simultaneously displaying content of a plurality of applications on a display device, comprising:
- receiving user input specifying that content of a first of the applications is to be displayed in a primary region of a display;
- receiving user input specifying that content of a second of the applications is to replace the content of the first application in the primary region of a display;
- causing the content of the first application to be moved to a non-primary region of the display;
- causing a size of content of the first application in the non-primary region of the display to be adjusted in accordance with instructions specified by the first application; and
- causing the content of the second application to be displayed in the primary region of the display.
18. The method of claim 17 wherein the instructions are specified through a set of APIs exposed by the first application.
19. The method of claim 17 wherein the instructions include pre-defined size requirements specified by the selected application.
20. The method of claim 17 wherein causing the content of the first application to be moved to the non-primary region of the display comprises causing the content of the first application to be moved to the non-primary region of the display by ensuring that the non-primary region has a sufficiently large size available to display the selected application with at least a minimum size specified in the instructions.
Type: Application
Filed: Dec 20, 2010
Publication Date: Jun 21, 2012
Applicant: Microsoft Corporation (Redmond, WA)
Inventors: David Matthews (Seattle, WA), Matthew Worley (Bellevue, WA), Nils Sundelin (Bothell, WA), Tsz Yan Wong (Seattle, WA)
Application Number: 12/972,611
International Classification: G06F 3/048 (20060101);