Abstract: Aspects disclosed herein provide an operator training system that can train an operator about basic machine movements, operations, and applications, such as asphalt compactor rolling patterns, paving-by-numbers, milling-by-numbers, etc. with the use of a virtual reality headset at any point or time on a work site. The operator training system uses data received from the virtual reality headset and associated hand controls to guide the operator via training scenarios. The operator training system also includes providing immediate feedback on the outcome of the training scenario and may also identify one or more areas of improvement.

Abstract: Disclosed herein are system, method, and computer program product embodiments for locating, identifying, and tracking a known criminal, fugitive, missing person, and/or any other person of interest. An embodiment operates by deploying an unmanned aerial vehicle, determining the mode of operation of the UAV, operating the UAV in accordance with the mode of operation of the UAV, determining whether a subject has been detected, capturing a first voice sample associated with the subject, authenticating the identity of the subject, and transmitting the GPS location of the unmanned aerial vehicle to a computing device.

Abstract: Disclosed herein are a method for driving a robot based on an external image, and a robot and a server implementing the same. In the method, and the robot and server implementing the same, drive of a robot is controlled further using external images acquired by camera modules installed outside the robot. To this end, a robot according to an embodiment of the present disclosure includes a communication unit configured to communicate with external camera modules acquiring external images including the robot that is being driven, a drive-information acquiring unit configured to acquire driving related information at the time of driving the robot, a driving unit configured to drive the robot, and a control unit configured to control the driving unit using external information including the external images received from the external camera modules and the driving related information.

Abstract: A remote control that receives state information from an associated media device is disclosed. The remote control, in response to receiving data indicating that the media device is in a content state, may update an input assembly to indicate that the assembly may be used to perform a movement function. The remote control may instruct the media device to perform a movement function in response to a selection gesture, where the degree of movement is a single unit. In response to a swipe gesture, the remote control may instruct the media device to perform a linear movement with a greater degree of movement. Buttons and functions of the remote control may be further adapted in response to a menu-based state, or other states of the media device.

Abstract: A simulator for a crane, a construction machine or an industrial truck, with a control station including at least one input means for inputting control commands, a graphical simulation module for calculating a virtual representation of the machine surroundings and/or machine components, such as a boom or a load hook, and a display device for displaying the calculated virtual representation, a movement simulation module being provided for determining movements and/or deformations of the machine components according to the inputted control commands, according to which the graphical simulation module calculates the virtual representation. The control station is movably mounted and can be moved by a drive device according to the movements and/or deformation of the machine components determined by the movement simulation module. The virtual representation generated by the graphical simulation module can be superimposed with a live image provided by a camera and displayed on virtual reality glasses.

Abstract: Systems, methods and unmanned agents for collaboratively controlling agents in a collaborative network by one or more agents continuously simulating numeric models of one or more other agents in the network to dramatically reduce the computational bandwidth required between agents, and improve the quality of shared estimates of the agent locations as well as the locations and characteristics of other objects of interest, e.g. targets. Bandwidth is reduced by using the models to intelligently filter data before communicating.

Abstract: Systems and methods provide for a server computer to receive a request from a first device to share a plurality of media content items with a second device, the request including a unique identifier for each of the plurality of media content items. The server computer determines a subset of the plurality of media content items to be processed by the first device, generates instructions for processing the subset of the plurality of media content items by the first device, and sends the instructions to the first device. The server computer receives the processed media content items for the subset of the plurality of media content items that were processed by the first device, generates a message enabling access to processed media content items for the plurality of media content items, and sends the generated message to the second device.

Abstract: A computer-implemented method, system, and computer program product are provided for a stabilization system utilizing pose estimation in an aerial drone. The method includes receiving, by a pose estimation system, a plurality of images from one or more cameras. The method also includes predicting, by the pose estimation system, a pose from the score map and a combined feature map, the combined feature map correlated from a pair of the plurality of images. The method additionally includes moving, by a propulsion system, the aerial drone responsive to the pose.

Abstract: The present invention relates to a remote control device for a crane, for a construction machine and/or for a pallet truck comprising a control station that has at least one input means for inputting control commands and that has a signal transmission device for transmitting the input control commands to the control apparatus of the crane, of the construction machine, or of the pallet truck; and a display apparatus for displaying a representation of the machine surroundings and/or of a piece of working equipment such as a boom or a lifting hook, wherein a movement determination unit is provided for determining movements and/or deformations of the machine components in dependence on the input control commands.

Abstract: A remote control apparatus is provided. The remote control apparatus according to an embodiment includes an inputter comprising input circuitry, a communicator comprising communication circuitry, a microphone, and a processor configured to control the communicator to transmit a first Bluetooth packet requesting an electronic apparatus to output a non-audible sound based on a control command being input through the inputter in a state where the remote control apparatus is not paired, obtain identification information of the electronic apparatus based on the non-audible sound output by the electronic apparatus corresponding to the first Bluetooth packet being received through the microphone, and control the communicator to transmit a second Bluetooth packet including the obtained identification information and a turn-on command to the electronic apparatus.

Abstract: An electronic device is provided that includes a communication circuit configured to transmit and receive wireless data with the unmanned aerial vehicle (UAV), a display configured to display a user interface (UI) for operating the UAV, a memory, and a processor electrically coupled with the communication circuit, the display, and the memory. The processor is configured to receive information about a direction of a first point of the UAV from the UAV, display a direction indication object corresponding to a direction of the first point on the display, in response to receiving a user input associated with movement or rotation of the UAV, generate a control signal for moving or rotating the UAV with respect to the first point in response to a location of the direction indication object and the user input, and transmit the generated control signal to the UAV using the communication circuit.

Abstract: A moving body, having: a movement control unit controls movement of the moving body; a storage unit stores map information and target object information pertaining to a degree of necessity for determining whether self-driving can be continued; a monitoring/control unit transmits information inquiring whether to continue self-driving if the moving body comes into close proximity with the target object; and a route calculation unit that selects as a movement route, from a plurality of routes, a route where the degree of necessity of determining whether self-driving can be continued has a small value, on the basis of the map information and the target object information If a control signal for controlling the moving body is received in response to an inquiry regarding continuing self-driving, the monitoring/control unit inputs the control signal to the movement control unit and the movement control unit executes driving control according to the control signal.

Abstract: An information processing apparatus including a generation unit that generates display control information for displaying a virtual space based on first operation information detected about a first real object corresponding to a virtual object in the virtual space and second operation information detected about a second real object corresponding to a virtual tool in the virtual space.

Abstract: A machine orientation display may be displayed by an operator display device in an operator station of a machine. The machine orientation display may include a field area, a horizontal reference displayed on the field area, a machine orientation indicator displayed on the field area and positioned and oriented relative to the horizontal reference to graphically indicate a machine orientation of the machine relative to a work surface on which the machine is disposed. The machine orientation display may further include an implement orientation indicator displayed on the field area and positioned and oriented relative to the horizontal reference and the machine orientation indicator to graphically indicate an implement orientation of an implement of the machine. The implement is movable relative to a machine body of the machine and to the work surface.

Abstract: An automatic case loader for loading product in a trailer is disclosed. A mobile base structure provides a support framework for a drive subassembly, conveyance subassembly, an industrial robot, a distance measurement sensor, and a control subassembly. Under the operation of the control subassembly, product advances through a powered transportation path to an industrial robot which places the product within the trailer. The control subassembly coordinates the selective articulated movement of the industrial robot and the activation of the drive subassembly based upon the distance measurement sensor detecting objects within a detection space, dimensions of the trailer provided to the control subassembly, and dimensions of the product provided to the control subassembly.

Abstract: An apparatus includes an image collection module that monitors at least one parameter to dynamically regulate an amount of data and resolution to be allocated to at least one object in a scene collected from an image data set. A situational awareness interface (SAI) renders a 3-D video of the scene to an operator based on the amount of data and resolution allocated from the image data set by the image collection module and receives operator commands for an unmanned vehicle (UV) that interacts with the scene.

Abstract: There is provided a remote control system including a controlled device and a remote device. The controlled device has a light source and moves according to a control signal from the remote device. The remote device is adapted to be operated by a user and includes an image sensor. The remote device determines a moving direction of the controlled device according to an imaging position of the light source in the image captured by the image sensor and a pointing position of the user, and outputs the control signal.

Abstract: There are provided a dimmer that can solve practical problems including burn-in and easily change a transmittance to external light and a video display device using the same. A dimmer includes a stack of two or more light control layers that change a transmittance to incident light by controlling an applied voltage in the incident direction of the incident light. A video display device includes a video generator that generates picture light; a video projector that projects the picture light as a virtual image in the field of view of a user; the dimmer disposed on the opposite side of the projecting side of the video projector to the user for adjusting the light quantity of external light to be entered to a user's eye through the video projector; and a light controller that controls the dimmer suitable for the luminosity of external light detected at an external light detector.

Abstract: Systems, devices, and methods for on-board sensing and control of robotic vehicles (e.g., MAVs) using commercial off-the-shelf hand-held electronic devices as a sensing and control system are provided. In one aspect, a system for controlling a micro aerial vehicle may include one or more sensors, a state estimation module in communication with the one or more sensors, the state estimation module being configured to generate an estimated pose of the micro aerial vehicle based on inputs from the one or more sensors, and a position controller in communication with the state estimation module and configured to communicate attitude commands to an attitude controller of the micro aerial vehicle. Each of the one or more sensors, the state estimation module, and the position controller may be contained in a commercial off-the-shelf hand-held electronic device that is configured to be coupled to the micro aerial vehicle.

Abstract: Methods and arrangements in a client node and a server node support a decision on decoding and playout of a certain content in the client node. The methods and arrangements relate to the determining, conveying and obtaining of information related to the characteristics (level) required for decoding and playing out the certain media content at a non-regular playout rate. The method and arrangement in the client node further relate to determining, based on the obtained information, which playout rate(s) is/are supported by the client node in regard of level. The methods and arrangements enable the client node to refrain from attempting to decode and play out of the content at a non-regular rate requiring a level which is not supported by the client node.

Abstract: An autonomous driving system for a vehicle is provided. The system includes a location unit configured to determine a current location of the vehicle; a database storing mapping information; and a control unit coupled to the location unit and the database, the control unit configured to selectively generate autonomous driving commands for the current location in view of the mapping information.

Abstract: The present invention provides systems, methods, and devices related to target tracking by UAVs. The UAV may be configured to receive target information from a control terminal related to a target to be tracked by an imaging device coupled to the UAV. The target information may be used by the UAV to automatically track the target so as to maintain predetermined position and/or size of the target within one or more images captured by the imaging device. The control terminal may be configured to display images from the imaging device as well as allowing user input related to the target information.

Abstract: The invention provides an image display system and an image presenting method thereof. The image display system includes a display apparatus and an image presenting apparatus. The display apparatus receives an output image signal and generates an image frame. The image presenting apparatus obtains a plurality of input image signals from a plurality of image sources and generates an output image signal. The image presenting apparatus provides the output image signal to a display apparatus. The image presenting apparatus receives a preview request to simultaneously and timely present the input image signals of all the image sources in a preview block of the image frame. Also, the image presenting apparatus further receives a select request to generate the output image signal according to at least one of the input image signals that is selected.

Abstract: The present invention provides systems, methods, and devices related to target tracking by UAVs. The UAV may be configured to receive target information from a control terminal related to a target to be tracked by an imaging device coupled to the UAV. The target information may be used by the UAV to automatically track the target so as to maintain predetermined position and/or size of the target within one or more images captured by the imaging device. The control terminal may be configured to display images from the imaging device as well as allowing user input related to the target information.

Abstract: Systems and methods for video processing and display are provided. In one aspect, a workstation is configured to determine a position of a remotely controlled vehicle when an image of the surroundings of the vehicle was captured, and to transform the image into a transformed image based on an estimated real-time position of the vehicle. In another aspect, a workstation is configured to identify an image captured prior to the time a remotely controlled vehicle changed its configuration. The workstation estimates a real-time position of the vehicle, and transforms the identified image into a transformed image based on the estimated real-time position of the vehicle, such that the transformed image represents at least a portion of a view of the surroundings of the vehicle at the estimated real-time position after the vehicle changed its configuration.

Abstract: A display apparatus and a display method using the same are provided. The display apparatus includes a curved display, a guide member on which the curved display is mounted to slidably move and configured to provide a curved concave path formed with respect to a user, and a driver configured to move the curved display along the guide member. The guide member includes left and right frames vertically disposed at intervals, a lower rail of which both ends are coupled to lower ends of the left and right frames, and an upper rail of which both ends are coupled to upper ends of the left and right frames and which is parallel to the lower rail.

Abstract: A method and system for just-in-time (JIT) encoding of media content is described. The JIT encoder allows a server to create one or more slices of requested portions of the media content according to one of the available quality profiles when requested without previously creating and storing different copies of the media content at the different quality profiles.

Abstract: An augmented reality (AR) device comprises a transparent display, a thermal sensor, a depth sensor, and a processor. The thermal sensor generates thermal data related to physical objects detected by the AR device. A thermal baseline identification engine forms a thermal baseline using data from infrared imaging and depth profiling sensors, thermal data of the physical objects in a mapped 3D space, thermal context of the objects both spatially and based on their operating status, and their thermal parameters. A thermal anomaly identification engine identifies a thermal anomaly based on the established thermal baseline and the real time measurements, and generates a warning notification in response to the identified thermal anomaly.

Abstract: A maintenance assistance system and method of operating are provided. The maintenance assistance system may include, but is not limited to, a camera, a speaker, a technician marker, a memory configured to store a location of a plurality of tags and a location of at least one component relative to at least one of the plurality of tags, and a processor communicatively coupled to the camera, the speaker and the memory, the processor configured to receive an indication of one of the components, determine a location of the technician marker relative to the location of the indicated component based upon data from the camera and the location of the indicated component relative to the at least one of the plurality of tags, and output position information to the speaker based upon the determined location of the technician marker relative to the location of the indicated component.

Abstract: A multimedia device and controlling method thereof are disclosed, by which heterogeneous devices are controlled under at least two different communication protocols. The present invention includes displaying a guide message for controlling at least one function of the electronic device, receiving a remote control signal corresponding to a 1st function among the at least one function from a 1st remote controller of the electronic device, saving data for identifying the 1st function and the received remote control signal in a memory by mapping the data and the received remote control signal to each other, displaying a graphic image including the data for identifying the 1st function, if the data for identifying the 1st function is selected by a 2nd remote controller of the multimedia device, extracting the remote control signal mapped to the 1st function, and transmitting the extracted remote control signal to an external device.

Abstract: An exemplary method includes receiving data representative of a content instance over a network from an access device associated with a user, storing the data representative of the content instance, providing the user with an interface configured to allow the user to define at least one access rule corresponding to the content instance, the at least one access rule based on at least one user profile and at least one access device profile, receiving a communication from another access device over the network, and performing a predefined action related to the content instance in response to the communication and in accordance with the at least one access rule.

Abstract: An object identifier is provided with a data-forming unit and a data-retrieving unit. The data-forming unit forms an integral image having an image region of the same size as an original image and an image to be integrated. The data-retrieving unit obtains compressed data derived by extracting, from a plurality of pixels constituting the integral image, at least every other pixel in at least one direction.

Abstract: A mounting structure for a remote operator station is provided. The mounting structure includes a frame having a first section, and a second section disposed adjacently in elevated relation with respect to the first section. The frame further includes a forward support member extending upward from an end of the first section and a rearward support member extending downward from an end of the second section. The structure further includes an upright support element removably coupled to the forward support member of the frame via a first coupling system. The structure further includes a laterally extending support element removably coupled to at least one of lateral sides of the second section of the frame via a second coupling system.

Abstract: A vehicle control system includes a controller configured to be able to perform a slip control in which an internal combustion engine becomes a non-operation state by setting a first clutch to a release state and an electric rotating machine is driven by setting a second clutch to a slip state. In a case where a vehicle starts to run by starting up the internal combustion engine during the slip control is performed, the controller performs a first engagement control in which the second clutch becomes an engagement state and then the first clutch becomes an engagement state at the time a lock-up clutch is in a non-engagement state, and performs a second engagement control in which the first clutch becomes an engagement state and then the second clutch becomes an engagement state at the time the lock-up clutch is in an engagement state.

Abstract: A universal remote control device (10) is programmed by determining layout properties of an existing remote control device (12) that must be replaced by the universal remote control device (10). Information identifying at least part of said layout properties is input into a selection system (14, 18). A command set for the universal remote control device (10) is selected dependent on said information. The universal remote control device (10) is programmed to implement the selected command set.

Abstract: A method and system for providing remote vision to a remote operator with respect to a plurality of machines includes a remote vision system with one or more display screens and a receiver for receiving video information and machine information from each of the one or more machines. A controller console is linked to the remote vision system and the receiver, and is configured to calculate a priority ranking of the plurality of machines based on the received machine data and to display the video information from each machine as one or more video displays on a display screen wherein at least one of the one or more video displays is modified in appearance and/or position or duration of placement based on the priority ranking.

Abstract: A method is provided for semi-automatic operation of a portable control device for a remote-controlled, unmanned vehicle. The method includes the steps of monitoring parameters of an operational environment of the portable control device, switching from a manual operation mode to a semi-automatic operation mode in response to occurrence of predetermined criteria within the operational environment, and presenting a semi-automatic operation graphical user interface to a user of the portable control device. The semi-automatic operation graphical user interface includes a reduced set of user interfaces for the semi-automatic operation mode presented by the portable control device.

Abstract: A system and method are provided for selecting a remote controlled device to be controlled from among a plurality of remote controllable devices. The system includes an electronic device having a registration interface configured to register device data corresponding to the plurality of remote controllable devices, a position locator configured to determine position data corresponding to a position of the electronic device, and an orientation interface configured to receive orientation data corresponding to an orientation of a user. A controller is configured to select the remote controlled device based on the device data, the position data, and the orientation data. The plurality of remote controllable devices each may include a respective data source configured to provide the device data, and a headset may be configured to generate the orientation data.

Abstract: Systems and methods to adjust actions based on latency levels are described. The method may be executable to determine an action being performed by a robotic device. The method may also be executable to generate data based on execution of the action to provide to a server and receive information indicative of latency attributable to communication between the robotic device and a server. The method may also determine a priority at which to provide the generated data to the server and provide the generated data to the server in an order based on the priority. When the latency is above a threshold amount, the method may identify information of the generated data having a given priority above a threshold level and provide a reduced resolution version of the identified information to the server.

Abstract: In a method for operating a vehicle which performs an autonomously controlled movement, images of the vehicle are recorded in temporal succession with a mobile control which is held by an operator located outside the vehicle, a position of the vehicle in the images, a change of the position of the vehicle in the images, a proportion of the depiction of the vehicle of the total image content and/or a change of the proportion is analyzed by an analysis device, and in case the vehicle was not or only incompletely detected in the images, the proportion of the depiction of the vehicle of the total image content, the change and or degree of change of the proportion is above or below a predeterminable threshold value, the autonomously controlled movement of the vehicle ins interrupted or terminated.

Abstract: A television service provider system includes a first set top box, a second set top box, and a remote control. The remote control transmits an infrared pairing signal which is only received by one of the set top boxes. The receiving set top box pairs itself to the remote control. The non receiving set top box is not paired to the remote control. The remote control then transmits control signals to operate the receiving set top box. The control signals are received by both set top boxes, but are executed only by the set top box that is paired to the remote control.

Abstract: A display apparatus and a control method thereof are provided The display apparatus includes: an image processor configured to process an image of content; a display configured to display the processed image of the content; a camera configured to capture an image of a remote controller; a storage configured to store information regarding a plurality of appearance states of the remote controller corresponding to user commands; and a controller configured to determine an appearance state from among the plurality of appearance states of the remote controller based on the image of remote controller captured by the camera, and control the display section to display the image of the content according to a user command corresponding to the determined appearance state of the remote controller.

Abstract: A method of searching the Internet and a video receiving apparatus, such as an Internet TV, to use the same to enable currently-displayed video to be transmitted to an external apparatus, such as a remote controller, and the video received from the external apparatus to be controlled, thereby increasing user convenience. Specifically, the video captured from the video receiving apparatus is transmitted to the external apparatus which receives coordinate data and performs an operation indicated by a menu of the currently-displayed video corresponding to the coordinate data received from the external apparatus so that websites having menus requiring user control can be used without requiring redesign even if the websites are not designed for use with the video receiving apparatus.

Abstract: There is provided a remote control system including a controlled device and a remote device. The controlled device has a light source and moves according to a control signal from the remote device. The remote device is adapted to be operated by a user and includes an image sensor. The remote device determines a moving direction of the controlled device according to an imaging position of the light source in the image captured by the image sensor and a pointing position of the user, and outputs the control signal.

Abstract: There is provided a remote control device including: a communication unit that can perform communication through a network; a remote control unit that can transmit one or more control commands to a controlled device in response to an operation by a user; a storage unit that stores control command information specifying the one or more control commands to be transmitted from the remote control unit; and a setting unit that sets the control command information to the storage unit based on a result of communication by the communication unit with a controlled device through the network, wherein the setting unit detects a controlled device connected to the network by transmitting a device search signal from the communication unit, acquires device information of the detected controlled device from the controlled device, and decides the control command information to be set to the storage unit based on the acquired device information.

Abstract: A system is disclosed for controlling operation of an electronic device, such as a TV. The system includes a first sensor located at or near the electronic device and a second sensor spaced apart from the first sensor, wherein the first and second sensors are configured to detect motion of a user within an operating zone associated with the electronic device. A processor is coupled to the electronic device and the first and second sensors, the processor being configured to input a signal from the first and second sensors. Memory is coupled to the processor, the memory comprising a sensing algorithm configured to process the input signal from the first and second sensors and determine the location of the user with respect to the operating zone. The processor is configured to send a control command to the electronic device based on an output of the sensing algorithm.

Abstract: A system and method of automatically controlling vehicle exterior lights including an image sensor and a controller to generate headlamp control signals.

Abstract: A control device controls a television. The control device includes a touch module. The control device displays a menu containing a number of soft keys on a screen. The soft keys are activated to control the television to carry out corresponding functions. All positions on the menu are associated with all positions on the touch module correspondingly. As a result, a user can select desired soft keys to carry out corresponding functions by viewing the menu on the television and touching the touch module, rather than viewing the touch module.

Abstract: Systems and methods are described for remotely controlled vehicles that hierarchically transform sensor-detected information into levels of increasing fidelity for highly efficient machine recognition of attributes and features of detected objects/events. Fusion of the feature space representations of the various levels allows correlation with the operator's attention to the respective objects for automated processing/controlling of the unmanned vehicle. High efficiencies in object/event recognition are attained with reduced memory and processor requirements, enabling near autonomous or fully autonomous operation of the vehicle.

Abstract: A remote control device is operative to enable and facilitate user control of video systems that are operative to provide one or more three-dimensional (3D) viewing effects. According to an exemplary embodiment, the remote control device includes a user input terminal having an input element operative to receive user inputs to adjust at least one of a volume setting and a channel setting of a video system, and further operative to receive user inputs to adjust a three-dimensional (3-D) viewing effect of the video system. A transmitter is operative to transmit control signals to the video system in response to the user inputs.