Abstract: Virtual game worlds for computer games can be provided using machine learning. The use of machine learning enables the virtual game worlds to be generated at run time by standard consumer hardware devices. Machine learning agents are trained in advance to the characteristics of the particular game world. In doing so, ground coverage of the virtual game world can be determined. In one implementation, the ground coverage is determined using at least one ground coverage agent, which is a trained machine learning agent to provide appropriate ground coverage for the terrain of the virtual game world. Advantageously, the virtual game world can be provided in high resolution and is able to cover a substantially larger region than conventional practical.

Abstract: A read-only-memory (ROM) medium in which a file constituting application software and an additional content file are recorded is mounted to a media drive. A recording processing section copies the file recorded in the ROM medium to an auxiliary storage device. After copying the additional content file to the auxiliary storage device, the recording processing section copies the file constituting the application software to the auxiliary storage device. In the case where the additional content file downloaded from a content server is stored in the auxiliary storage device, the application software can utilize both the additional content file copied from the ROM medium to the auxiliary storage device and the additional content file downloaded from the content server into the auxiliary storage device.

Abstract: A display device having a high display quality is provided. The display device is formed such that for each target block that is to be displayed, different super-resolution processing are applied. Specifically, an image analysis unit analyzes image data that is input, and a target block within an image to be displayed is specified. In the image analysis unit, data of the target block is analyzed using a learned neural network, and an image dividing unit is controlled to divide the image data according to the analysis results. In the image analysis unit, in order to perform different super processing that applies to each image data that has been divided according to the analysis results, an image calculation processing unit including a plurality of super-resolution processing circuits is controlled.

Abstract: Methods and systems are provided for accurately filling holes, regions, and/or portions of images using iterative image inpainting. In particular, iterative inpainting utilize a confidence analysis of predicted pixels determined during the iterations of inpainting. For instance, a confidence analysis can provide information that can be used as feedback to progressively fill undefined pixels that comprise the holes, regions, and/or portions of an image where information for those respective pixels is not known. To allow for accurate image inpainting, one or more neural networks can be used. For instance, a coarse result neural network (e.g., a GAN comprised of a generator and a discriminator) and a fine result neural network (e.g., a GAN comprised of a generator and two discriminators).

Abstract: Improved texturing processes utilizing smart materials are provided to increase developer productivity when texturing objects within multi-dimensional environments, and particularly, 3D environments. A developer may generate an object, select a smart material to apply, and manipulate the dimensions of the object to cause an aspect ratio of at least one surface having a material applied to change without altering an aspect ratio of a texture tile of the material as rendered on the surface of the object. Texturing of object surfaces from a selected smart material is determined in a shared material space based on a mapping of object vertices that maintain original material qualities (e.g., a defined aspect ratio of the texture) and mitigate discontinuities in a material applied to adjacent surfaces, including those of different objects and when those objects are repositioned.

Abstract: A system for evaluating digital user experience in a user session includes a server communicatively coupled to user devices. The server acquires usage information of different applications of service providers associated with common service from user devices and analyses the usage information to determine a set of scores for each of the different applications. The analysis of usage information includes detecting and discarding a portion of the usage information for one or more first user interfaces of each application that do not require any user input. The server further determines a friction score for a given journey for each of the different applications and generates first visual representation. The server further controls display of generated first visual representation such that a ranking of the different applications of different service providers is indicated in accordance with the determined friction score.

Abstract: Methods, systems, and apparatus, including medium-encoded computer program products, for computer aided design of physical structures include, in one aspect, a method for increasing smoothness between a set of adjoining surface patches includes: identifying surface patches corresponding to a portion of a modeled surface to be smoothed, where the surface patches are defined by control vertices from a control mesh; smoothing the portion of the modeled surface based on continuity, where the smoothing includes determining a continuity measure at an interface between each pair of adjoining surface patches, and modifying positions of a subset of the control vertices, thereby modifying the surface patches, by targeting an overall improvement in the continuity measures for the interfaces, while also targeting an overall minimum of modification of positions of the control vertices; and processing the modified positions of the subset of the control vertices within the modelled surface for output.

Abstract: The present invention relates generally to the field of computer vision and computer graphics to produce full body renderings of a person for varying person pose and camera positions and, in particular, to a system and method for synthesizing 2-D image of a person.

Abstract: A processor implemented method includes: calculating edge direction information of edge component pixels extracted from an input image; determining an inlier pixel among the edge component pixels based on the edge direction information and virtual horizontal line information; estimating a rotation reference point based on the inlier pixel; and correcting localization information of the apparatus based on the estimated rotation reference point.

Abstract: Techniques associated with adaptive sampling are disclosed. In some embodiments, in response to receiving a specification of a scene to render, a sampling of each portion of the scene is determined based at least in part on the specification of the scene such that the scene is not uniformly sampled, and the scene is rendered according to the determined sampling of each portion of the scene.

Abstract: The present disclosure relates to a dynamic vision sensor. The dynamic vision sensor comprises a pixel array, address event representations, and a control logic. The pixel array includes a plurality of dynamic vision sensor (DVS) pixels connected to a plurality of row lines and a plurality of column lines. Each of the DVS pixels is configured to output an event signal in response to a change in light. The address event representations are configured to select one of the plurality of column lines and obtain an event signal output from DVS pixels connected to the selected column line. The control logic is configured to generate image data, including an object capable of generating a movement using an event signal output from each of the plurality of DVS pixels. The control logic divides the plurality of DVS pixels into a plurality of groups and allocates different readout times to each of the plurality of groups.

Abstract: A method of calculating feedback parameters for presentation images presented to spectators, comprising obtaining a presentation stream comprising a sequence of a plurality of presentation images, analyzing the presentation stream to identify a plurality of presentation periods of a presentation session, during each presentation period an associated one of the plurality of presentation images is presented to one or more spectators, receiving a plurality of feedback messages transmitted by client device(s) used by the spectator(s) to provide feedback to one or more of the presentation images, correlating each feedback message with one of the presentation images according to a presentation period during which the feedback message is received and transmitting the correlated feedback messages to feedback analysis system(s) adapted to calculate one or more feedback parameters for one or more presentation images based on the feedback extracted from the feedback messages correlated with one or more of the presentati

Abstract: A magnified portion and an unmagnified portion of a computer-generated reality (CGR) environment are displayed from a first position. In response to receiving an input, a magnified portion of the CGR environment from a second position is displayed with a magnification less than that of the magnified portion of the CGR environment from the first position and a field of view greater than that of the magnified portion of the CGR environment from the first position. A first unmagnified portion of the CGR environment from a third position is displayed with a field of view greater than that of the magnified portion of the CGR environment from the second position. Then, a second unmagnified portion of the CGR environment from the third position is displayed with a field of view greater than that of the first unmagnified portion of the CGR environment from the third position.

Abstract: A conference recording method is provided. The method includes obtaining a multimedia file corresponding to a conference, the multimedia file includes video data and audio data. Posture language of each person is recognized from the video data. Facial features and voice features of each person are extracted from the multimedia file. Personal identity information of each person is identified according to the facial features and the voice features of each person. Once the audio data corresponding to each person is converted into text information, the posture language, the personal identity information, and the text information corresponding to each person are output.

Abstract: A method and system provide the ability to design a surface. An existing triangular surface mesh representative of an existing surface is obtained. A modification to the mesh in compliance with design constraints is received. A volume level set or a volume minimization set, for the modified mesh, is obtained in Euclidean space. A volume subgradient set based on the volume level set, is obtained. A scalar is determined and used to scale heights between vertices of a triangle. A projection is computed and may be scaled. The projection may then be removed from the triangle's vertices. The removing changes the triangular surface mesh into a converged triangular surface mesh that minimizes an objective function. The objective function computes an absolute earthwork volume and/or an absolute value of a net volume representing the difference between a fill and cut of earthwork material.

Abstract: Disclosed in some examples are methods, systems, devices, and machine-readable media for 3D radar weather data rendering techniques. A computer-implemented method for 3D radar weather data rendering includes retrieving weather data from a weather radar. Gridded data is generated based on the weather data. The gridded data includes a uniform grid of cubes, where each of the cubes is associated with at least one weather parameter value of a plurality of weather parameter values corresponding to the weather data. A triangular mesh for a data grouping within the gridded data is extracted. An object file including vertices and faces associated with the triangular mesh is generated. The object file is communicated to a three-dimensional (3D) visualization system to present a 3D rendering of the object file.

Abstract: Embodiments of the disclosure provide an image rendering method, an image rendering apparatus, an image processing device, and a computer-readable storage medium. In one embodiment, the method, apparatus, device, and medium involve obtaining an initial image of a current scene, and determining a first area and a second area on the initial image; rendering image data of the first area based on a first rendering rule, to obtain a first sub-image; rendering image data of the second area based on a second rendering rule, to obtain a second sub-image; and generating a target display image based on the first sub-image and the second sub-image, the first rendering rule being different from the second rendering rule.

Abstract: Techniques are provided for receiving a request to generate a video of a specified resolution based on a plurality of images, and generating, via a file engine, a plurality of transfer units comprising the plurality of images, wherein each of the plurality of transfer units has a size based on the specified resolution and at least one of: (i) a count of the plurality of images or (ii) a size of the plurality of images. The file engine then assigns the plurality of transfer units for parallel processing by a plurality of image processing applications.

Abstract: An extended reality (XR) system includes an extended reality application executing on a processor within the XR system. The XR system receives, via a client device, a selection of a first extended reality (XR) object located within an XR environment. The XR system receives, via the client device, a request to move the selected first XR object within the XR environment. The XR system calculates a distance between a first feature of the first XR object and a first plane associated with a second XR object within the XR environment. The XR system determines that the distance is within a particular distance. In response to determining that the distance is within the particular distance, the XR system positions the first feature within the XR environment such that the first feature is coplanar with the first plane.

Abstract: Disclosed is a method, an apparatus, an electronic device and a computer readable storage medium for generating a three-dimensional effect based on a face. In an embodiment of the method, a standard face image is displayed, a three-dimensional effect which located on the standard face image is created at least by configuring a three-dimensional model and configuring a material of the three-dimensional model, effect parameters are generated according to the three-dimensional effect, a first face image recognized from an image sensor is obtained, and the three-dimensional effect is generated on the first face image according to the effect parameters. Through the above method, the three-dimensional effect can be easily configured and edited, and the three-dimensional effect generation algorithm can generate three-dimensional effects on the face images acquired in real time using three-dimensional effects parameters.

Abstract: The present disclosure is directed to a computing device including one or more processors and a foldable display. A non-transitory computer-readable medium stores a set of instructions that when executed by at least one processor of the one more processors cause the at least one processor to detect a usage mode of the foldable electronic device, detect user input to the foldable electronic device, and control a brightness of an active area on the display based on the detected usage mode and detected user input.

Abstract: Systems and methods of shareable virtual objects and virtual objects as message objects to facilitate communications sessions in an augmented reality environment are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, to facilitate sharing of an object in an augmented reality environment of a real world environment. The method can further include world-locking the object or user-locking the object in accordance with a request of the object to be posted in the augmented reality environment for a given user. In world-locking the object, the object is enabled to be interacted with by the given user if and when the given user is at or in the vicinity of the given location. In user-locking the object, the object is enabled to be interacted with by the given user regardless of where the given user is physically located in the real world environment.

Abstract: According to certain embodiments, an image system comprises a display and a controller. A portion of the display is capable of a first visual fidelity level which is the highest visual fidelity capability of the display. The controller is configured to determine a first location of a point on the display where the center of gaze of a user intersects the display and determine a plurality of concentric regions on the display sharing a common center determined at least in part on the first location of the point. The controller is further configured to communicate a command to the display to reduce the angular and spatial resolution of selected regions below the first visual fidelity level, the reduction in visual fidelity of each region determined at least in part on a proximity of each region from the first location of the point, such that the regions farther from the point have greater levels of reduction in visual fidelity.

Abstract: Various implementations disclosed herein adjust the luminance values of an image to improve the appearance of the image on an augmented reality device. In some implementations, the luminance values of an image are adjusted so that the image can be displayed on an augmented reality device (e.g., with background luminance) such that the image will be perceived more similarly to how the image would be perceived otherwise (e.g., on a device without background luminance). In some implementations, an image is adjusted based on an estimate of human perception of luminance that is not linear.

Abstract: An electronic device is disclosed. The electronic device of the present disclosure comprises a communication unit, and a processor for: when receiving measurement information including color coordinate values of a display through the communication unit, calculating an average adjustment value for color coordinate values of a first region among multiple regions constituting the display by using the received measurement information; if color coordinate values at a boundary between the first region and a second region adjacent to the first region are continuous, adjusting, for each pixel, an adjustment value so that an adjustment amount of color coordinate values of the first region decreases as the adjustment amount gets closer to the boundary with reference to the average adjustment value; and if color coordinate values at the boundary between the first region and the second region are discontinuous, maintaining the adjustment amount at the average adjustment value.

Abstract: Disclosed herein are dual stereoscopic image display apparatus and method. The dual stereoscopic image display method is performed by a dual stereoscopic image display apparatus, and includes separating a background image including a background and a foreground object image including a foreground object from multi-view stereoscopic image data, setting the background image so that the background image is output via a first display at a first resolution, and setting the foreground object image so that the foreground object image is output via a second display at a second resolution, and synchronizing the background image and the foreground object image into a single stereoscopic image via the first display and the second display, and outputting the stereoscopic image.

Abstract: Generating a data model may include receiving a raw data set and generating a first repository based on a first set of features of the raw data set, a second repository having a second set of features based on an aggregation of features of the first repository, and a third repository having a third set of features based on the first and second features sets. The data model may be generated based on a tradeoff between accuracy and provenance of the model.

Abstract: An electronic device is provided. The electronic device includes a plurality of displays, a memory configured to store applications and parameters associated with execution screens of the applications, and a processor which is electrically connected with the plurality of displays and the memory. The processor is configured to, when at least one application of the applications is executed, obtain a first parameter associated with a first execution screen of the at least one application and a second parameter associated with a second execution screen of the at least one application from the memory, and to output the first execution screen in one of the plurality of displays based on the first parameter and output the second execution screen in another of the plurality of displays based on the second parameter.

Abstract: A display device capable of automatically adjusting displayed image comprises a display device, a camera assembly, an image recognition device and a signal processor. The display device including a shell and a display panel partially exposed from the shell, wherein the display panel faces a first direction. The camera assembly obtains a first image with a first visual angle and obtain a second image with a second visual angle. The image recognition device generates a first instruction when the first image meets a first condition and generates a second instruction when the second image meets a second condition. The signal processor adjusts the display signal to conceal the displayed image according to the first instruction and to adjust the display signal to generate a reminder message on the displayed image according to the second instruction.

Abstract: A transfer source action information acquisition unit acquires first action information of the transfer source robot. A transfer destination action information acquisition unit acquires second action information of the transfer destination robot. A correction unit corrects the action information of the transfer source robot by using the second action information and in accordance with a predetermined update formula and thereby generates third action information of the transfer destination robot. The pieces of the second action information of the transfer destination robot are less than the pieces of the first action information of the transfer source robot. The first to third action information includes a set of data indicative of one or more robot joint values and a set of data indicative of a coordinate value of a robot specific part.

Abstract: The present disclosure generally relates to user interface for capturing and managing media (e.g., photo media, video media). In some examples, user interfaces for capturing media (e.g., photo media, video media) are described. In some examples, user interfaces for displaying camera controls and indicators are described. In some examples, user interfaces for adjusting media (e.g., photo media (e.g., a sequence of images, a single image), video media) are described. In some examples, user interfaces for managing the file format of media (e.g., photo, video media) are described. In some examples, user interfaces for storing media (photo media (e.g., a sequences of image, a single still image), video media) are described.

Abstract: A method and system for providing shareable and cross-application non-destructive content processing pipelines. A set of non-destructive edits for a content item is received via a first content processing application, wherein the set of non-destructive edits includes a series of operations performed by a user on the content item. The set of non-destructive edits is stored in a shareable format. The set of non-destructive edits is exported in the shareable format, wherein the set of non-destructive edits is importable by a second content processing application different from the first content processing application.

Abstract: Systems and methods for storing and retrieving geospatial data in a geographic information system are provided. Geospatial data can be spatially partitioned along axes of a spherical coordinate system associated with a virtual globe or other spheroid into a plurality of discrete geospatial volumes pursuant to a hierarchical spatial partitioning scheme. For instance, geospatial data can be spatially partitioned into geospatial volumes along surfaces of constant latitude, longitude, and altitude defined by the spherical coordinate system. The discrete geospatial volumes can be stored as nodes in a hierarchical tree data structure. Additional methods are provided for portioning geospatial objects, such as tiles or discrete geospatial volumes, in tritree to reduce polar distortions.

Abstract: An information processing apparatus includes a first chassis, a second chassis which is coupled to the first chassis to be openable and closable, a first display which is disposed on a first surface of the second chassis which faces the first chassis, a second display which is disposed on a second surface of the second chassis which is opposite to the first surface and a processing circuitry, in which the processing circuitry detects a lid close action that a user is about to close the first chassis or lid close, and in a case where the lid close action or the lid close is detected, displays a selection menu which is used for selecting a mode to be executed in a lid closed state and includes a plurality of modes on the first display or the second display.

Abstract: A “Concurrent Projector-Camera” uses an image projection device in combination with one or more cameras to enable various techniques that provide visually flicker-free projection of images or video, while real-time image or video capture is occurring in that same space. The Concurrent Projector-Camera provides this projection in a manner that eliminates video feedback into the real-time image or video capture. More specifically, the Concurrent Projector-Camera dynamically synchronizes a combination of projector lighting (or light-control points) on-state temporal compression in combination with on-state temporal shifting during each image frame projection to open a “capture time slot” for image capture during which no image is being projected. This capture time slot represents a tradeoff between image capture time and decreased brightness of the projected image.

Abstract: The system generates real-time augmented reality video for TV broadcast, cinema or video games. The system includes a monoscopic video camera including a body, a stereoscopic video camera, and a processor. The system includes sensors, including multiple non-optical sensors, which provide real-time positioning data defining the 3D position and 3D orientation of the monoscopic video camera, or enable the 3D position and 3D orientation of the monoscopic video camera to be calculated. The processor is configured to use the real-time positioning data automatically to create, recall, render or modify computer generated 3D objects. The processor is configured to determine the 3D position and orientation of the monoscopic video camera with reference to a 3D map of the real-world generated whilst the camera is being used to capture video. The processor is configured to track the scene without a requirement for an initial or prior survey of the scene.

Abstract: One factor in limiting the speed of conventional implementations of mixture models is that the algorithm involves many decisions where different operations are fetched and performed depending on the outcome of the decisions. These decisions cause flushing of the pipeline, and thus prevent the realization of a highly parallel pipeline in a processor. Without parallelism, the throughput of the pipeline in the processor, i.e., the ability to process many samples of the digital input at a time, is limited. To alleviate this issue, implementation of the mixture model is reformulated, among other things, by embedding decisions into the process flow as multiplicative factors. The resulting implementation alleviates the need to use if-else statements for the decisions and reduces the number of times the pipeline has to be flushed. The implementation enables a pipeline with a higher degree of parallelism and thereby increases throughput and speed of the implementation.

Abstract: A cube map is used for determining the appearance of a surface by means of a precomputed texture image. Embodiments of the present invention are drawn computer systems and methods for rendering a spherical projection as a cube map that mitigates non-uniform pixel density near the edges of the cube map to avoid artifacts and increase rendering performance.

Abstract: A computer-implemented method, computing system and non-transitory computer readable medium having computer readable code thereon for processing a dataset of multidimensional signals captured from points in a physical space. The computer-implemented method includes using a computing system, determining, for each of the points, a plurality of spatially neighbouring points in the physical space; and using the computing system, creating a modified signal for each point based on the signals of its respective spatially neighbouring points.

Abstract: In general, techniques are described regarding selective allocation of processing resources for processing image data. Processing circuitry may warp a frame of image data around variously indicated areas of the frame to create a warped frame of image data. The processing circuitry may allocate more pixels to the indicated areas by virtue of the frame warping operation. The warped frame may then be output for further processing in accordance with proportions of the warped frame resulting in better image or video quality in the indicated areas.

Abstract: In some aspects, a method of authoring an interactive presentation includes defining a sequence of two or more primary content items within a presentation, and associating a link to additional content with a primary content item of the sequence in a non-transitory computer-readable medium. In additional aspects, a method of delivering an interactive presentation includes accessing the sequence of two or more primary content items, delivering the primary content items to a presentation device, and delivering, to applications operating on mobile devices of audience members, the primary content items with the additional content and/or one or more links thereto. In further aspects, a method of interacting with an interactive presentation includes receiving, by a mobile device of an audience member, a sequence of primary content items with additional content and/or one or more links thereto, and displaying the received primary content items and the additional content.

Abstract: The present technology relates to a receiving device, a transmitting device, and a data processing method, in which seamless reproduction can be performed at the time of switching a broadcast signal. A receiving device receives a plurality of broadcast signals, and selects a broadcast signal of a target from the plurality of broadcast signals, on the basis of a result of processing with respect to the broadcast signal, and thus, it is possible to perform seamless reproduction at the time of switching the broadcast signal. The present technology, for example, can be applied to a receiver which is capable of receiving digital television broadcast.

Abstract: A texture filtering unit and a method are disclosed that provide multiple variants of an approximate trilinear filtering operation. A texture sampling and filtering unit may be configured to determine a level-of-detail (LOD) value for a sample point in texture space, and select, based on the LOD value, a fine mip-level and a coarse mip-level from the mip-map. The closer of the two selected mip-levels to the sample point is determined, and farther of the two selected mip-levels from the sample point is determined. A first quad of texels in the closer mip-level and a second quad of texels in the farther mip-level are then determined. A total of five or fewer texels are selected from the first quad of texels and from the second quad of texels. A filtered value for the sample point is determined based on an approximate trilinear filtering operation on the selected texels.

Abstract: Systems and methods are disclosed for sampling a set of data using inverted indexes in response to a user interaction with a user interface. Based on the user interaction with a displayed grouping of a summarization of a set of data, the system uses filter criteria corresponding to the grouping to review one or more inverted indexes and identify a sample of events for analysis. The system then accesses the sample of events and provides the results for display to a user.

Abstract: Method and apparatus for mode switching are provided in the disclosure. Aspects of the disclosure provide a method for switching a display mode of a device. The method includes receiving an intensity value of ambient light when the device is in a first control mode in which backlights of a liquid crystal display screen are controlled in order to control a display brightness of the liquid crystal display screen, determining whether the intensity value is less than a predetermined threshold, and when the intensity value is less than the predetermined threshold, controlling the device to enter a second control mode in which voltages provided to data lines of the liquid crystal display screen are scaled according to a ratio in order to control the display brightness of the liquid crystal display screen.

Abstract: A computer program product for providing a graphical user interface for displaying of and enabling cooperative use of resources on a display of a computing device includes computer readable code means, the computer readable code means when executed by a processor device, being configured to provide an environment, the environment being configured to represent the resources on the display of the computing device, provide a first viewport to at least a portion of the environment on the display of the computing device, enable a resource to be added to the environment and be viewed within the first viewport and enable the resource to be acted upon within the first viewport.

Abstract: Devices, methods and computer program products that facilitate automated adjustment of size or configuration of head up display image in a vehicle. A device can include a memory and a processor that executes computer executable modules. The computer executable modules can include: a head up display that generates an image visible to a driver of a vehicle within an eye box, a detection module that determines position of the driver's eyes or head relative to position of the eye box, and an adjustment module that adjusts size or configuration of the image within the eye box in response to the determined driver's eye or head position.

Abstract: A method can include powering circuitry via a lithium ion battery; during the powering, determining a discharge rate of the lithium ion battery; and, based at least in part on the determined discharge rate, adjusting a cut-off voltage for the lithium ion battery.

Abstract: A method of adapting content responsive to a well-being of a user wearing a head mountable display (HMD) includes detecting, by one or more sensors, one or more parameters indicating one or more current properties of the user wearing the HMD, generating information indicating the well-being of the user based on the one or more parameters, and adapting an output of the HMD responsive to the generated information, the output comprising at least one of an image and an audio signal.

Abstract: In an embodiment, a method for representing a surrounding environment of an ego autonomous driving vehicle (ADV) is described. The method represents the surrounding environment using a first set of features from a definition (HD) map and a second set of features from a target object in the surrounding environment. The first set of features are extracted from the high definition map using a convolutional neural network (CNN), and the second set of features are handcrafted features from the target object during a predetermined number of past driving cycles of the ego ADV. The first set of features and the second set of features are concatenated and provided to a number of fully connected layers of the CNN to predict behaviors of the target object. In one embodiment, the operations in the method can be repeated for each driving cycle of the ego ADV.