Virtual 3d Environment Patents (Class 715/757)
  • Patent number: 12213796
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for implementing an olfaction training program by an online service executing on a server. A first object and an aroma of the first object is transmitted to the client device of a user that presents the first object in a virtual reality environment and disperses the first aroma. In response, the user interacts with the vital reality environment. The user response is transmitted back to the online service. The user response is stored in a database along with the first data and the first aroma. The online service determines a second object and an aroma of the second object based on the user response. The second object and the aroma of the second object is transmitted to the client device.
    Type: Grant
    Filed: June 17, 2022
    Date of Patent: February 4, 2025
    Assignee: Accenture Global Solutions Limited
    Inventors: Derrick Anthony Martin, II, Alex M. Kass, Marc Carrel-Billiard, Alexandria Emily Pabst
  • Patent number: 12192297
    Abstract: Techniques are disclosed relating to generating real-time suggested actions for a user based on their user profile attributes. In various embodiments, a server system may select, in real-time, a particular action to suggest to a user based on profile attributes associated with a user account of the user. The server system may then provide a message indicative of this particular action to a user device associated with the user. In some embodiments, the server system may then receive an indication that the user has initiated the particular action. In response to this indication, the server system may update the profile attributes associated with the user account to indicate that the user has initiated the particular action. Using these updated profile attributes, the server system may then select, in real-time, an updated action to suggest to the user that is different from the particular action.
    Type: Grant
    Filed: June 29, 2022
    Date of Patent: January 7, 2025
    Assignee: PayPal, Inc.
    Inventors: Sumit Ranjan, Sriram Ramakrishnan, Ravi Shankar Chandrasekaran, Dinesh Damodharan
  • Patent number: 12175608
    Abstract: Multi-player co-located AR experiences are augmented by assigning characters and costumes to respective participants (a.k.a. “users” of AR-enabled mobile devices) in multi-player AR sessions for storytelling, play acting, and the like. Body tracking technology and augmented reality (AR) software are used to decorate the bodies of the co-located participants with virtual costumes within the context of the multi-player co-located AR experiences. Tracked bodies are distinguished to determine which body belongs to which user and hence which virtual costume belongs to which tracked body so that corresponding costumes may be assigned for display in augmented reality. A host-guest mechanism is used for networked assignment of characters and corresponding costumes in the co-located multi-player AR session. Body tracking technology is used to move the costume with the body as movement of the assigned body is detected.
    Type: Grant
    Filed: September 1, 2022
    Date of Patent: December 24, 2024
    Assignee: Snap Inc.
    Inventors: Daekun Kim, Lei Zhang, Youjean Cho, Ava Robinson, Yu Jiang Tham, Rajan Vaish, Andrés Monroy-Hernández
  • Patent number: 12175609
    Abstract: This application provides techniques for a live room presentation. The techniques comprise: receiving a live room entry instruction by an audience client computing device associated with a user; determining target avatar information associated with the user and a target live room based on the instruction; establishing a transmission connection between the audience client computing device and the target live room in a server to facilitate subsequent transmission of live data; obtaining virtual scene information and virtual audience information associated with the target live room; determining location information of each avatar corresponding to each user associated with the target live room in a virtual scene based on the target avatar information and the virtual audience information; and rendering and presenting the target live room based on the location information of each avatar in the virtual scene and the virtual scene information.
    Type: Grant
    Filed: November 22, 2022
    Date of Patent: December 24, 2024
    Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
    Inventors: Yao Wang, Min Ye, Huaizhou Zhang, Junyuan Yang
  • Patent number: 12170747
    Abstract: Methods and systems are disclosed for performing operations for providing an augmented reality unboxing experience. The operations include retrieving an augmented reality element comprising a virtual box that is in a closed state. The operations include obtaining triggers associated with the virtual box, the triggers configured to change the virtual box from the closed state to an open state. The operations include displaying the virtual box. The operations include receiving input associated with the virtual box. The operations include determining that the received input corresponds to the one or more triggers associated with the virtual box. The operations include modifying the virtual box from being displayed in the closed state to being displayed in the open state.
    Type: Grant
    Filed: July 19, 2023
    Date of Patent: December 17, 2024
    Assignee: Snap Inc.
    Inventors: Gal Dudovitch, Stephanie Engle, Christie Marie Heikkinen, Ma′ayan Mishin Shuvi
  • Patent number: 12148081
    Abstract: One embodiment of a computer-implemented method for analyzing human motion data includes receiving a set of motion data that indicates one or more movements of a first person within a real-world environment; generating a virtual avatar corresponding to the first person based on the set of motion data; determining a position of the virtual avatar within an extended reality (ER) scene based on the one or more movements; and displaying the virtual avatar in the ER scene according to the determined position.
    Type: Grant
    Filed: February 22, 2022
    Date of Patent: November 19, 2024
    Assignee: AUTODESK, INC.
    Inventors: Frederik Brudy, Fraser Anderson, Raimund Dachselt, George Fitzmaurice, Justin Frank Matejka, Patrick Reipschläger
  • Patent number: 12124764
    Abstract: Provided is a main terminal capable of entering the same virtual space as a sub terminal present in a visually-recognizable position in real space. The main terminal comprises: a sub-terminal detector acquiring a terminal identifier from each of the sub terminals; a sub-terminal selector selecting one of the sub terminals according to operator operation; a sub-terminal communicator acquiring, from the selected sub terminal, a server address of a virtual space server to which the selected sub terminal is logged in; and a server accessor logging in to the virtual space server with the acquired server address, and enters a same virtual space as the sub terminal. The server accessor preferably accesses a virtual space server located on an external network via a wide-area communication, a locally-placed virtual space server via a narrow-area communication, or a virtual space server installed in the sub terminal via a narrow-area communication.
    Type: Grant
    Filed: April 26, 2022
    Date of Patent: October 22, 2024
    Assignee: IKEYA SEISAKUSHO CO., LTD.
    Inventor: Hidesato Ikeya
  • Patent number: 12112301
    Abstract: Systems, methods, and apparatus are provided for authenticating avatar activity in a metaverse environment. A metaverse application may enable interactions between an agent avatar and a customer avatar in a secure bidirectional metaverse session. Customer identity may be verified using meta-information associated with avatar appearance or behavior, device data, and/or methods of avatar control. The agent avatar and customer avatar may view a virtual representation of a defective check in the metaverse environment. The customer avatar may sign the virtual check in the metaverse environment. The signature may be captured and reproduced on a paper check by a device interfacing with the metaverse application. The metaverse application may store technical logs of the metaverse session for future reference.
    Type: Grant
    Filed: August 1, 2022
    Date of Patent: October 8, 2024
    Assignee: Bank of America Corporation
    Inventors: Sneha Padiyar, Sandeep Kumar Chauhan, Nandini Rathaur, Aditya Sharma
  • Patent number: 12086215
    Abstract: Managing access to digital content in a virtual environment using virtual content rights, including: providing a virtual content rights database comprising data associating a user of the virtual environment with the virtual content rights acquired with respect to the digital content; receiving, at a processor, a request from a device of the user for assignment of the virtual content rights of the digital content, wherein the user uses the device to interface with the processor; updating the virtual content rights database to indicate the assignment of the virtual content rights to the user; receiving, at the processor, data from the device of the user holding the virtual content rights to digital content including songs to create a virtual user-configured music room having at least one of the songs; and updating the virtual content rights database to indicate sharing of the virtual user-configured music room by the user within the virtual environment.
    Type: Grant
    Filed: July 7, 2022
    Date of Patent: September 10, 2024
    Assignees: Sony Group Corporation, Sony Corporation of America
    Inventor: Thomas Sachson
  • Patent number: 12069036
    Abstract: Aspects of the subject technology provide for shared experience sessions within a group communications session such as a video call. The shared experience session may be, as one example, a co-watching session in which the participants in the call watch a video together while in the call. Encrypted shared state data may be exchanged between the participant devices, with which the participant devices can provide synchronized and coordinated output of shared experience data for the shared experience session of the group communications session.
    Type: Grant
    Filed: March 29, 2022
    Date of Patent: August 20, 2024
    Assignee: Apple Inc.
    Inventors: Daniel B. Pollack, Jingyao Zhang, Jose A. Lozano Hinojosa, Emad Omara, Yilmaz Can Cecen, Angus N. Burton, Blerim Cici
  • Patent number: 12061773
    Abstract: A method and an apparatus for determining a selected target, a device, and a storage medium belong to the field of computer technologies. The method includes: displaying a thumbnail map, the thumbnail map displaying at least one target; presenting, in a target presentation menu, without overlap, and based on a trigger instruction targeting a combined stack response area in the thumbnail map, at least two stacked targets in the combined stack response area, the combined stack response area being a combined area of trigger response areas respectively corresponding to the at least two stacked targets in the thumbnail map; and determining a first target presented in the target presentation menu as a selected target based on a target trigger instruction targeting the first target, the first target being one of the at least two stacked targets.
    Type: Grant
    Filed: June 2, 2022
    Date of Patent: August 13, 2024
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Peicheng Liu, Xiaohao Liu, Shan Lin
  • Patent number: 12056416
    Abstract: An augmented reality device may comprise a display, at least one sensor, a communication circuit, and at least one processor operatively connected with the display, the at least one sensor, and the communication circuit.
    Type: Grant
    Filed: February 24, 2022
    Date of Patent: August 6, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Seungnyun Kim, Hanjib Kim, Hyunjun Kim, Yongsang Yun, Kihuk Lee, Chihyun Cho
  • Patent number: 12023591
    Abstract: Systems and methods for application development via a graphical user interface (GUI) using an Entity-Component-System (ECS) architecture are provided herein. In some embodiments, a method for application development may include receiving a selection of at least one actor to be part of a game scene; displaying a representation of the at least one actor in the game scene; receiving a selection of one or more behaviors to associate with each of the at least one actors in the game scene; storing the selected one or more behaviors as associations with each of the at least one actors, wherein the associations are stored in a hash table; updating, each of that at least one actors and their associated behaviors; and automatically creating an executable video game based on the at least one actor and associated behaviors in an ECS architecture without the need for user written software code.
    Type: Grant
    Filed: February 16, 2022
    Date of Patent: July 2, 2024
    Assignee: Monterey's Coast, Inc.
    Inventors: Benjamin Carroll Alcala Roth, Jesse Kicho Ruder, Nikhilesh Sigatapu, David Anthony Cole, Charles Duplain Cheever
  • Patent number: 11995739
    Abstract: Aspects of the subject disclosure may include, for example, receiving information about an augmented reality (AR) environment which includes a plurality of objects and a user participating in the AR environment, the user viewing the AR environment through a user equipment, receiving context information for the AR environment, identifying a diminished reality (DR) object of the plurality of objects, wherein the identifying is responsive to the context information, modifying the AR environment to render the DR object invisible to the user viewing the AR environment through user equipment, monitoring movement of one or more objects of the AR environment including the DR object, and modifying visibility of the DR object to the user viewing the AR environment through user equipment as a notification of a possible collision between the user and the DR object, wherein the modifying is responsive to detecting a risk of collision. Other embodiments are disclosed.
    Type: Grant
    Filed: February 9, 2022
    Date of Patent: May 28, 2024
    Assignees: AT&T Intellectual Property I, L.P., AT&T Mobility II LLC
    Inventors: Terrel Michael LeCesne, Eric Zavesky, Jason Allen DeCuir, James H. Pratt
  • Patent number: 11991013
    Abstract: A presentation service generates an audience interface for an electronic presentation. The audience interface may simulate an in-person presentation, including features such as a central presenter and seat locations for audience members. The audience members may select emotes which may be displayed in the audience interface. The emotes may indicate the audience members' opinion of the content being presented. The presentation service may enable chats between multiple audience members, grouping of audience members private rooms, and other virtual simulations of functions corresponding to in-person presentations.
    Type: Grant
    Filed: June 21, 2021
    Date of Patent: May 21, 2024
    Assignee: Airbnb, Inc.
    Inventors: Avand Amiri, Stepan Parunashvili
  • Patent number: 11979684
    Abstract: There is provided a content distribution device including a virtual character arrangement acquisitor that acquires an arrangement in a virtual space of each of a plurality of virtual characters respectively corresponding to a plurality of participants in accordance with an operation of a corresponding participant, a trigger detector that detects a first trigger and thereafter detects a second trigger, and a display control data distributor that generates and distributes display control data for displaying at least a part of the virtual space in which the plurality of virtual characters is arranged.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: May 7, 2024
    Assignee: DWANGO Co., Ltd.
    Inventors: Nobuo Kawakami, Takashi Kojima, Hiroaki Saito, Toshihiro Shimizu
  • Patent number: 11978157
    Abstract: The present disclosure relates to a method and an apparatus for generating a three-dimensional model, a device, and a storage medium. The method includes: a scanned texture image and a depth image corresponding to the texture image are acquired; the texture image is processed by a pre-trained mask region convolutional neural network to determine at least one region of interest on the texture image and category information and mask information of each of the at least one region of interest; the depth image is updated according to the category information and the mask information of each of the at least one region of interest to obtain a updated depth image; and a three-dimensional model corresponding to the updated depth image is constructed.
    Type: Grant
    Filed: September 29, 2019
    Date of Patent: May 7, 2024
    Assignee: Shining 3D Tech Co., Ltd.
    Inventors: Tengfei Jiang, Xiaobo Zhao
  • Patent number: 11940981
    Abstract: A method for enabling a user to define a Life Based VR experience to align with the user's life. The user and partners provide custom information and settings about the user's life state which allows the user to integrate information to the Life Based VR experience. The partners may use the user's information to integrate its information, which is then interacted with in a Life Based VR experience by a user, according to various custom VR parameters. The partners may also use the user's interactions with the Life Based VR experience to assess behavior as compared to the user's life state, and the users may assess the partner's accuracy of information delivery when compared to the user's life state. The method also enables the user and partner to interact in a marketplace to procure the information relating to the user's life, user ratings, and partner ratings.
    Type: Grant
    Filed: December 15, 2020
    Date of Patent: March 26, 2024
    Inventor: Michael Bilotta
  • Patent number: 11931625
    Abstract: The present disclosure generally relates to sharing workout content on electronic devices.
    Type: Grant
    Filed: September 23, 2022
    Date of Patent: March 19, 2024
    Assignee: Apple Inc.
    Inventors: Anthony D'Auria, Jae Woo Chang, Edward Chao, Nathan De Vries, Michael D. Ford, Colin G. McKinstry
  • Patent number: 11924922
    Abstract: Application mobility is a unique feature of the edge computing to support relocation of application instance across edge computing hosts or between edge computing host and cloud computing over underlying mobile network. With the active-standby mode application instance implementation with support of L2 networks, the application mobility could achieve the service continuity with low latency switching time. An application mobility mechanism can be implemented in the data plane of edge computing host under the control of edge computing platform and management. It can be also implemented in L2 switching function of the User Plane Function in 5G networks.
    Type: Grant
    Filed: October 17, 2022
    Date of Patent: March 5, 2024
    Assignee: ZTE Corporation
    Inventors: Yonggang Fang, Qiang Huang, ZhiQiang Han, Bo Sun
  • Patent number: 11909778
    Abstract: One example method includes receiving configuration information for a virtual expo, the configuration information includes information associated with one or more virtual expo booths; generating a virtual expo floor based on the one or more virtual expo booths; establishing a virtual meeting comprising the virtual expo; receiving requests to join the virtual expo from a plurality of client devices; joining each client device of the plurality of client devices to the virtual meeting; providing, to each joined client device, information describing the virtual expo floor and locations of each of the one or more virtual expo booths; providing a location of a respective participant avatar on the virtual expo floor; receiving, from a first client devices, a selection of a first virtual expo booth; and join the first client device to a second virtual meeting associated with the first expo booth.
    Type: Grant
    Filed: January 24, 2022
    Date of Patent: February 20, 2024
    Assignee: Zoom Video Communications, Inc.
    Inventors: Andy Chan, Jeffrey Houng, Yuk Fai Lam, Pankaj Prasad
  • Patent number: 11899912
    Abstract: According to some embodiments, systems and methods are provided, comprising: a memory storing executable program code; and a processing unit to execute the executable program code to cause the system to: generate a visualization of a plurality of cards, wherein each card displays at least one dimension; receive a value of a first dimension; and in response to reception of the value: determine an association between one or more of the plurality of cards and the first dimension; and dynamically modify the visualization by emphasizing the one or more of the plurality of cards based on the association. Numerous other aspects are provided.
    Type: Grant
    Filed: April 7, 2022
    Date of Patent: February 13, 2024
    Assignee: SAP SE
    Inventor: Leena Khatri
  • Patent number: 11902766
    Abstract: An illustrative collaboration space provider system provides a virtual collaboration session that allows for audio communication between a user and one or more other users virtually located within a virtual collaboration space. The user is represented by an avatar located at an avatar location within the virtual collaboration space. The collaboration space provider system receives user input from the user, the user input representative of a voice origination location that is within the virtual collaboration space and is distinct from the avatar location. During the virtual collaboration session, the collaboration space provider system simulates propagation within the virtual collaboration space of a voice communication spoken by the user. The propagation of the voice communication is simulated to originate from the voice origination location and not from the avatar location. Corresponding methods and systems are also disclosed.
    Type: Grant
    Filed: July 30, 2021
    Date of Patent: February 13, 2024
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Samuel Charles Mindlin, Kunal Jathal, Shan Anis, David Skuratowicz
  • Patent number: 11900520
    Abstract: In an exemplary process for specifying an entrance or exit effect in a computer-generated reality environment, in response to a user entering or exiting the computer-generated reality environment, a transition effect is provided.
    Type: Grant
    Filed: December 28, 2021
    Date of Patent: February 13, 2024
    Assignee: Apple Inc.
    Inventors: Clément Pierre Nicolas Boissière, Samuel Lee Iglesias, James McIlree
  • Patent number: 11891083
    Abstract: A system for context-based adaptive virtual experience control in a vehicle is provided. The system includes an output device configured for providing a sensory output to a user of the vehicle and a computerized virtual experience control module configured for controlling the output device based upon a virtual experience mode. The system further includes a computerized context-based adaptive control module configured for monitoring contextual data related to one of the user of the vehicle or operation of the vehicle, monitoring feedback from the user related to one of favor or disfavor related to the virtual experience mode, and utilizing the contextual data and the feedback from the user to selectively, automatically command activation of the virtual experience mode.
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: February 6, 2024
    Assignee: GM Global Technology Operations LLC
    Inventors: Alaa M. Khamis, Neeraj R. Gautama, Jarvis Chau, Jomo Hanley, Kelley J. Kettenbeil, Gina E. Griffith, Scott E. Jackson, Ian Gibbs, Mark T. Gaylord, Maria Alejandra Gonzalez, Nicholis Festa, Nathan Robinson, Ute Winter, Sachin Raviram
  • Patent number: 11893330
    Abstract: Provided are a method and system for visualization of a 3D electronic device. The method includes: a structural and/or electrical characteristic of the electronic device is simulated to obtain first visualization data, the electronic device including a semiconductor device and/or an integrated circuit and the first visualization data including 3D grid position information of the electronic device and/or a physical quantity at a grid point; the 3D grid position information and/or physical quantity at the grid point in the first visualization data are/is converted into second visualization data suitable for virtual 3D displaying according to a data type; and the second visualization data is rendered in a virtual space to display a structure and/or physical quantity of the electronic device in the virtual space.
    Type: Grant
    Filed: November 26, 2020
    Date of Patent: February 6, 2024
    Assignee: MiaoTech Inc.
    Inventors: Yu Zhu, Zhenhua Wu
  • Patent number: 11887016
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing actionable suggestions are disclosed. In one aspect, a method includes receiving (i) an indication that an event detection module has determined that a shared event of a particular type is presently occurring or has occurred, and (ii) data referencing an attribute associated with the shared event. The method includes selecting, from among multiple output templates that are each associated with a different type of shared event, a particular output template associated with the particular type of shared event detected by the module. The method generates a notification for output using at least (i) the selected particular output template, and (ii) the data referencing the attribute associated with the shared event. The method then provides, for output to a user device, the notification that is generated.
    Type: Grant
    Filed: November 23, 2020
    Date of Patent: January 30, 2024
    Assignee: GOOGLE LLC
    Inventors: Daniel M. Keysers, Victor Carbune, Thomas Deselaers
  • Patent number: 11886681
    Abstract: A system and method for standardizing user interface elements are presented. A first application is identified having a higher use metric than a second application, the first application including one or more user interface elements that have one or more respective parameters. The second application has one or more user interface elements that are similar to the user interface elements of the first application and has one or more respective parameters that are different than the respective parameters of the user interface elements of the first application. A determination of similarity is made between the user interface elements applications based upon at least one predetermined criterion. Based on the determination, one or more parameters of the user interface elements of the second application are modified to match one or more parameters of the first application.
    Type: Grant
    Filed: March 21, 2023
    Date of Patent: January 30, 2024
    Assignee: eBay Inc.
    Inventors: David A. Ramadge, Justin Van Winkle, Corinne Elizabeth Sherman
  • Patent number: 11875461
    Abstract: A system and method for creating, storing, interacting, and manipulating a digital facility is disclosed. One or more computing platform(s) may be configured to electronically receive a plurality of machine-readable sensor data of a physical facility having multiple 3D objects. One or more computing platform(s) may be configured to electronically process the plurality of machine-readable sensor data to output a machine-readable point cloud model configured for augmented virtual navigation. One or more computing platform(s) may be configured to generate a machine-readable configuration database of geotagged-locations of the 3D objects. One or more computing platform(s) may be configured to generate a machine-readable dynamic configuration database of 3D objects.
    Type: Grant
    Filed: January 24, 2022
    Date of Patent: January 16, 2024
    Assignee: DTIS, LLC
    Inventors: Sarah Nancy Staab, Joseph Gerard Longo
  • Patent number: 11875129
    Abstract: Systems and methods for observation-based training of an Artificial Intelligence (AI) character model are provided. An example method includes receiving log data including interactions of a first user and a second user and adjusting, based on the log data, parameters of the AI character model to cause the AI character model to mimic behavioral characteristics of the first user in follow-up conversations with further users.
    Type: Grant
    Filed: April 28, 2023
    Date of Patent: January 16, 2024
    Assignee: Theai, Inc.
    Inventors: Ilya Gelfenbeyn, Mikhail Ermolenko, Kylan Gibbs
  • Patent number: 11856328
    Abstract: A method for virtual 3D video conference environment generation, the method may include (a) determining a first optical axis of a first virtual camera, the first optical axis represents a line of sight of the participant while a participant of the 3D video conference environment looks at a current displayed version of a virtual 3D video conference environment (V3DVCE); the current displayed version of the V3DVCE is displayed on a display; (b) determining a second optical axis of a second virtual camera that virtually captures the V3DVCE to provide the current displayed version of the V3DVCE; and (c) generating a next displayed version of the V3DVCE based on at least one of the first optical axis and the second optical axis.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: December 26, 2023
    Assignee: TRUE MEETING INC.
    Inventors: Yuval Gronau, Ran Oz, Omri Kaduri, Osnat Goren-Peyser
  • Patent number: 11847752
    Abstract: A system comprising: a user device, comprising: sensors configured to sense data related to a physical environment of the user device, displays; hardware processors; and a non-transitory machine-readable storage medium encoded with instructions executable by the hardware processors to: place a virtual object in a 3D scene displayed by the second user device, determine a pose of the user device with respect to the physical location in the physical environment of the user device, and generate an image of virtual content based on the pose of the user device with respect to the placed virtual object, wherein the image of the virtual content is projected by the one or more displays of the user device in a predetermined location relative to the physical location in the physical environment of the user device.
    Type: Grant
    Filed: January 4, 2023
    Date of Patent: December 19, 2023
    Assignee: Campfire 3D, Inc.
    Inventors: Avi Bar-Zeev, Alexander Tyurin, Gerald V. Wright, Jr.
  • Patent number: 11849257
    Abstract: Systems and methods for multi-attendee video conferencing are described. A system can convert from huddle video conference mode to spatial video conference mode. In particular, by assigning user roles, specific users can have greater control of the video conference as compared to other users. For instance, moderators may have a greater level of control of the video conferencing system. Thus, in example implementations of the present disclosure, specific users can affect transition between two or more video conferencing modes, such as between a huddle video conference mode and a spatial video conference mode.
    Type: Grant
    Filed: August 4, 2021
    Date of Patent: December 19, 2023
    Assignee: GOOGLE LLC
    Inventors: Colvin Pitts, Aaron Michael Donsbach
  • Patent number: 11843473
    Abstract: The exemplary embodiments are related to a device, system and method for implementing an audio orientated immersive experience of an event presented at a user device. A server is connected to a user device. The server generates a virtual environment that corresponds to a site of an event. The server receives tracking data corresponding to an object of the event. The tracking data is incorporated into the virtual environment. The server identifies a predetermined condition and selects enhancement data based on the predetermined condition. The predetermined condition corresponds to the tracking data and the virtual environment. The server transmits a data stream to the user device, the data stream including the enhancement data.
    Type: Grant
    Filed: June 16, 2022
    Date of Patent: December 12, 2023
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Katherine H. Ham, Jason M. Black, Eliza D. McNair, Jared E. Watterworth, Natalia X. Pulido
  • Patent number: 11838340
    Abstract: In an approach to dynamic mute control for web conferencing, one or more computer processors detect a start of a collaborative meeting. One or more computer processors receive a request to enable a dynamic mute feature for a microphone associated with a device of a user. One or more computer processors mute the microphone. One or more computer processors monitor the collaborative meeting to derive context. One or more computer processors determine a request for the user to participate in the collaborative meeting. One or more computer processors calculate an unmute confidence score based on the derived context.
    Type: Grant
    Filed: September 20, 2021
    Date of Patent: December 5, 2023
    Assignee: International Business Machines Corporation
    Inventors: Jacob Thomas Covell, Zachary A. Silverstein, Nicholas Bokun, Tyler Ems
  • Patent number: 11838686
    Abstract: A system and method for providing remote video communications, and more specifically, a system and method for providing multi-point-of-view video chatting for a group of participants is disclosed. The client device having a microphone, a video capture device having speakers, a display device, a memory having instructions stored thereon, and a processor configured to execute the instructions on the memory to cause the electronic client device to implement the method.
    Type: Grant
    Filed: July 18, 2021
    Date of Patent: December 5, 2023
    Inventor: Daniel Schneider
  • Patent number: 11831694
    Abstract: An electronic device is provided that includes a display, a processor, and a data storage device having executable instructions accessible by the processor. Responsive to execution of the instructions, the processor displays a user desktop related to a user, creates a virtual meeting that is configured to be attended by communication through a network by at least one network based electronic device, generates a shared desktop related to the virtual meeting that is configured to be shared with the at least one network based electronic device via the network, and displays the shared desktop during the virtual meeting.
    Type: Grant
    Filed: August 26, 2021
    Date of Patent: November 28, 2023
    Assignee: Lenovo (Singapore) Pte. Ltd.
    Inventors: Scott Li, Igor Stolbikov, Kelly Rikard, Rod D. Waltermann
  • Patent number: 11829525
    Abstract: Systems, apparatuses and methods may provide away to enhance an augmented reality (AR) and/or virtual reality (VR) user experience with environmental information captured from sensors located in one or more physical environments. More particularly, systems, apparatuses and methods may provide a way to track, by an eye tracker sensor, a gaze of a user, and capture, by the sensors, environmental information. The systems, apparatuses and methods may render feedback, by one or more feedback devices or display device, for a portion of the environment information based on the gaze of the user.
    Type: Grant
    Filed: April 19, 2021
    Date of Patent: November 28, 2023
    Assignee: Intel Corporation
    Inventors: Altug Koker, Michael Apodaca, Kai Xiao, Chandrasekaran Sakthivel, Jeffery S. Boles, Adam T. Lake, James M. Holland, Pattabhiraman K, Sayan Lahiri, Radhakrishnan Venkataraman, Kamal Sinha, Ankur N. Shah, Deepak S. Vembar, Abhishek R. Appu, Joydeep Ray, Elmoustapha Ould-Ahmed-Vall
  • Patent number: 11798233
    Abstract: A generation device of a three-dimensional model including: an acquisition unit configured to acquire a first mask image indicating a structure area, which is an object still within each image captured from a plurality of viewpoints, and a second mask image indicating a foreground area, which is a moving object within each image captured from the plurality of viewpoints; a combination unit configured to generate a third mask image that integrates the structure area and the foreground area within the image captured from the plurality of viewpoints by combining the first mask image and the second mask image both acquired; and a generation unit configured to generate a three-dimensional model including the structure and the foreground by a visual volume intersection method using the third mask image.
    Type: Grant
    Filed: September 16, 2021
    Date of Patent: October 24, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Keisuke Morisawa, Kiwamu Kobayashi
  • Patent number: 11783383
    Abstract: A method and system for advertising dynamic content in an immersive digital medium user experience operate a plurality of computer processors and databases in an associated network for receiving, processing, and communicate instructions and data relating to advertising content in an immersive digital medium user experience. The method and system execute instructions and processing data relating to advertising objects, the advertising objects comprising images of objects, signs, labels, and related indicia of object origin for indicating sources of purchasing one or more objects for advertising to receive advertising instructions and data from a plurality of software applications and further respond to variations in said advertising instructions and data whereby operation of said computer processors and databases enables swapping out of various advertising messages and images according to the context of said immersive digital medium user experience.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: October 10, 2023
    Inventor: Quintan Ian Pribyl
  • Patent number: 11775130
    Abstract: The present disclosure relates to techniques for enabling a retail experience in a computer-generated reality environment. In some embodiments, the techniques include: generating a computer-generated reality environment, including presenting a virtual object representing a product in the computer-generated reality environment; providing a communication session with a remote user of the product while presenting the virtual object representing the product in the computer-generated reality environment; and while providing the communication session, adjusting the presentation of the virtual object representing the product in the computer-generated reality environment using information received from the communication session.
    Type: Grant
    Filed: June 18, 2020
    Date of Patent: October 3, 2023
    Assignee: Apple Inc.
    Inventor: Alexander B. Oser
  • Patent number: 11770356
    Abstract: A method for providing a location based avatar messenger service includes transmitting, by a user terminal, location information of the user terminal to an external system; receiving, by the user terminal, information on users located in a vicinity of the user terminal from the external system; obtaining, by an image sensor of the user terminal, at least one image; and displaying, on a display of the user terminal, the at least one image and a first set of avatars associated with the users located in the vicinity such that the first set of avatars is superimposed on the at least one image, the first set of avatars including one or more avatars, the one or more avatars corresponding, respectively, to one or more users from among the users located in the vicinity.
    Type: Grant
    Filed: September 23, 2021
    Date of Patent: September 26, 2023
    Assignee: LINE Plus Corporation
    Inventor: Sol E Choi
  • Patent number: 11764984
    Abstract: A method for teleconferencing is provided. The method acquires voices of at least three participants who attend a teleconference from each of individual conference terminals of the participants and generates voice data including volume information from the acquired voices. The method also acquires video of the participants during the teleconference from each individual conference terminal and generates video data. The method displays seating information indicating seatings associated with the participants in a virtual space for each of the conference terminals of the participants. The method determines a destination of the voice data of the participants for each of the conference terminals of the participants in accordance with the voice data and the video data of the participants as well as the seating information. The method transmits the voice data of the participants from the conference terminals of the participants to destinations determined for the voice data of the participants.
    Type: Grant
    Filed: June 28, 2022
    Date of Patent: September 19, 2023
    Assignee: SHARP KABUSHIKI KAISHA
    Inventor: Asuka Komeda
  • Patent number: 11748939
    Abstract: In an aspect, a computer-implemented method allows for navigation in a three-dimensional (3D) virtual environment. In the method, data specifying a three-dimensional virtual space is received. A position and direction in the three-dimensional virtual space is received. The position and direction input by a first user and representing a first virtual camera used to render the three-dimensional virtual space to the first user. A video stream captured from a camera positioned to capture the first user is received. A second virtual camera is navigated according to an input of a second user.
    Type: Grant
    Filed: September 13, 2022
    Date of Patent: September 5, 2023
    Assignee: Katmai Tech Inc.
    Inventor: Kristofor Bernard Swanson
  • Patent number: 11699255
    Abstract: Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically scale an avatar or to render an avatar based on a determined intention of a user, an interesting impulse, environmental stimuli, or user saccade points. The disclosed systems and methods may apply discomfort curves when rendering an avatar. The disclosed systems and methods may provide a more realistic interaction between a human user and an avatar.
    Type: Grant
    Filed: June 6, 2022
    Date of Patent: July 11, 2023
    Assignee: Magic Leap, Inc.
    Inventors: Thomas Marshall Miller, IV, Josh Anon, Frank Alexander Hamilton, IV, Cole Parker Heiner, Victor Ng-Thow-Hing, Rodrigo Cano, Karen Stolzenberg, Lorena Pazmino, Gregory Minh Tran, Stephane Antoine Joseph Imbert, Anthony Marinello
  • Patent number: 11688147
    Abstract: A system comprising: a user device, comprising: sensors configured to sense data related to a physical environment of the user device, displays; hardware processors; and a non-transitory machine-readable storage medium encoded with instructions executable by the hardware processors to: place a virtual object in a 3D scene displayed by the second user device, determine a pose of the user device with respect to the physical location in the physical environment of the user device, and generate an image of virtual content based on the pose of the user device with respect to the placed virtual object, wherein the image of the virtual content is projected by the one or more displays of the user device in a predetermined location relative to the physical location in the physical environment of the user device.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: June 27, 2023
    Assignee: Campfire 3D, Inc.
    Inventors: Avi Bar-Zeev, Alexander Tyurin, Gerald V. Wright, Jr.
  • Patent number: 11671271
    Abstract: Provided are embodiments for a method for managing a multi-group virtual conference. Embodiments can include providing user access to at least one cluster of a plurality of clusters in a virtual conference and determining at least one feature word representing a topic for each of the plurality of clusters. Embodiments can also include displaying in each of the plurality of clusters the at least one feature word and receiving a user input to modify user participation in the at least one cluster. Also provided are embodiments for a system and computer program product for managing the multigroup virtual conference.
    Type: Grant
    Filed: September 24, 2021
    Date of Patent: June 6, 2023
    Assignee: International Business Machines Corporation
    Inventors: Kenya Ishimoto, Yoshio Horiuchi, Koichi Omae, Masashi Doi
  • Patent number: 11656736
    Abstract: A multi-user process receives input from multiple remote clients to manipulate avatars through a virtual environment modeled in a host memory. The environment includes portal objects operable to transport avatars, which are modeled objects operated in response to client input, between defined areas of the virtual environment. The portals are customizable in response to client input to transport avatars to destinations preferred by users. Adjacent defined areas are not confined in extent by shared boundaries. The host provides model data for display of the modeled environment to participating clients.
    Type: Grant
    Filed: March 30, 2022
    Date of Patent: May 23, 2023
    Assignee: PFAQUTRUMA RESEARCH LLC
    Inventor: Brian Mark Shuster
  • Patent number: 11651541
    Abstract: Various input modes and output modes may be used for a three-dimensional (3D) environment. A user may use a particular input mode (e.g., text, audio, video, etc.) for animating a 3D avatar of the user in the 3D environment. The user may use a particular output mode (e.g., text, audio, 3D animation, etc.) in the presentation of the 3D environment. The input/output modes may change based on conditions such as a location of the user.
    Type: Grant
    Filed: July 14, 2021
    Date of Patent: May 16, 2023
    Assignee: Roblox Corporation
    Inventors: David B. Baszucki, Philippe Clavel, Morgan Clemens Tucker
  • Patent number: 11637991
    Abstract: Systems and methods for multi-attendee video conferencing are described. A system can convert from huddle video conference mode to spatial video conference mode. In particular, by assigning user roles, specific users can have greater control of the video conference as compared to other users. For instance, moderators may have a greater level of control of the video conferencing system. Thus, in example implementations of the present disclosure, specific users can affect transition between two or more video conferencing modes, such as between a huddle video conference mode and a spatial video conference mode.
    Type: Grant
    Filed: August 4, 2021
    Date of Patent: April 25, 2023
    Assignee: GOOGLE LLC
    Inventors: Colvin Pitts, Aaron Michael Donsbach