Patents by Inventor Hongbo Fu

Hongbo Fu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240013450
    Abstract: One or more devices, systems, methods and/or non-transitory, machine-readable mediums are described herein for specifying one or more events in an augmented reality (AR) environment relative to a real-world (RW) environment. A system can comprise a memory that stores executable components, and a processor, coupled to the memory, that executes or facilitates execution of the executable components. The executable components can comprise a visual component that analyzes captured visual content of a RW environment, an interface component that integrates the visual content of the RW environment with AR content of an AR environment overlaying the RW environment, and a design component that facilitates in-situ placement of the AR content in the AR environment based on the visual content being overlayed, wherein the AR content comprises a specification of an event to be executed in the RW environment that triggers a virtual asset in the AR environment.
    Type: Application
    Filed: July 5, 2022
    Publication date: January 11, 2024
    Inventors: Hongbo Fu, Hui Ye
  • Patent number: 11087561
    Abstract: An enhanced multimodal interface and various enhanced tools are provided to enable a user to create 3-D augmented reality (AR) sketches using a mobile device. Mobile device can comprise a sketch generator component (SGC) that can integrate multiple sources of inputs with enhanced tools, comprising enhanced 3-D snapping and proxy creation tools. The inputs comprise touch screen data, motion data, and image data from a camera. SGC can provide the interface, which can support absolute and relative drawing. Via the interface, the user can select and use desired enhanced tools to create a 3-D AR sketch that augments visual content of a real-world environment captured by the camera with drawing content added by the user using the enhanced tools. SGC enables a user to create desired strokes, planar or curved surface proxies, snapping points, or other sketch features, wherein proxies can align with real-world surfaces.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: August 10, 2021
    Assignee: City University of Hong Kong
    Inventors: Hongbo Fu, Kin Chung Kwan
  • Publication number: 20210012574
    Abstract: An enhanced multimodal interface and various enhanced tools are provided to enable a user to create 3-D augmented reality (AR) sketches using a mobile device. Mobile device can comprise a sketch generator component (SGC) that can integrate multiple sources of inputs with enhanced tools, comprising enhanced 3-D snapping and proxy creation tools. The inputs comprise touch screen data, motion data, and image data from a camera. SGC can provide the interface, which can support absolute and relative drawing. Via the interface, the user can select and use desired enhanced tools to create a 3-D AR sketch that augments visual content of a real-world environment captured by the camera with drawing content added by the user using the enhanced tools. SGC enables a user to create desired strokes, planar or curved surface proxies, snapping points, or other sketch features, wherein proxies can align with real-world surfaces.
    Type: Application
    Filed: July 12, 2019
    Publication date: January 14, 2021
    Inventors: Hongbo Fu, Kin Chung Kwan
  • Patent number: 10223330
    Abstract: Group aware command based arrangement is provided. An alignment command can be received, an undirected graph comprising a group of graph nodes connected by graph edges can be constructed, wherein the group of graph nodes represent a group of selected display elements, and the undirected graph can be partitioned as a function of identifying a severable graph edge of the graph edges that connects a pair of graph nodes included in the group of graph nodes to form a first collection of graph nodes and a second collection of graph nodes.
    Type: Grant
    Filed: August 26, 2015
    Date of Patent: March 5, 2019
    Assignees: CITY UNIVERSITY OF HONG KONG, THE HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Hongbo Fu, Pengfei Xu, Chiew-Lan Tai
  • Publication number: 20170061030
    Abstract: Group aware command based arrangement is provided. An alignment command can be received, an undirected graph comprising a group of graph nodes connected by graph edges can be constructed, wherein the group of graph nodes represent a group of selected display elements, and the undirected graph can be partitioned as a function of identifying a severable graph edge of the graph edges that connects a pair of graph nodes included in the group of graph nodes to form a first collection of graph nodes and a second collection of graph nodes.
    Type: Application
    Filed: August 26, 2015
    Publication date: March 2, 2017
    Inventors: Hongbo Fu, Pengfei Xu, Chiew-Lan Tai
  • Patent number: 9542043
    Abstract: A stroke refinement technique can be used refine the location, orientation, and shape of input strokes by exploiting gradient features from an underlying image being traced. The technique can also be used to adjust user strokes with respect to image gradients. The stroke refinement technique can comprise a local optimization, a semi-global optimization, and a global optimization to facilitate error tolerant image optimization.
    Type: Grant
    Filed: December 9, 2014
    Date of Patent: January 10, 2017
    Assignee: City University of Hong Kong
    Inventors: Hongbo Fu, Qingkun Su, Wing Ho Andy Li
  • Patent number: 9542068
    Abstract: Described herein are systems and methods that employ a widgetless and buttonless multi-touch interface for constrained manipulations of 3D objects. The widget-less multi-touch user interface can map different multi-touch gestures to different 3D object manipulation tasks, allowing a user to manipulate 3D objects without operating widgets or performing mode switchings or tool selections. User interaction is greatly simplified by using single touch actions that simultaneously specify the transformation constraint, the transformation type, and the magnitude of transformation and apply the transformation to the focus object. Additionally, the axis-based constrained manipulations support active snapping and axis transfer. Active snapping allows the user to draw a free touch path connecting two 3D objects to be snapped together, avoiding tedious operations required with standard transformation manipulations.
    Type: Grant
    Filed: February 7, 2012
    Date of Patent: January 10, 2017
    Assignee: THE HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Chiew Lan Tai, Kin Chung Au, Hongbo Fu
  • Publication number: 20160162114
    Abstract: A stroke refinement technique can be used refine the location, orientation, and shape of input strokes by exploiting gradient features from an underlying image being traced. The technique can also be used to adjust user strokes with respect to image gradients. The stroke refinement technique can comprise a local optimization, a semi-global optimization, and a global optimization to facilitate error tolerant image optimization.
    Type: Application
    Filed: December 9, 2014
    Publication date: June 9, 2016
    Inventors: Hongbo Fu, Qingkun Su, Wing Ho Andy Li
  • Publication number: 20140229871
    Abstract: Described herein are systems and methods that employ a widgetless and buttonless multi-touch interface for constrained manipulations of 3D objects. The widget-less multi-touch user interface can map different multi-touch gestures to different 3D object manipulation tasks, allowing a user to manipulate 3D objects without operating widgets or performing mode switchings or tool selections. User interaction is greatly simplified by using single touch actions that simultaneously specify the transformation constraint, the transformation type, and the magnitude of transformation and apply the transformation to the focus object. Additionally, the axis-based constrained manipulations support active snapping and axis transfer. Active snapping allows the user to draw a free touch path connecting two 3D objects to be snapped together, avoiding tedious operations required with standard transformation manipulations.
    Type: Application
    Filed: February 7, 2012
    Publication date: August 14, 2014
    Applicant: THE HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Chiew Lan Tai, Kin Chung Au, Hongbo Fu