Abstract: A system and method of determining a policy to prevent fading drivers is described. The system and method creates virtual trajectories of incentives such as coupons offered to drivers in a transportation hailing system and corresponding states of drivers in response to the incentives. A joint policy simulator is created from an incentive policy, a confounding incentive policy, and an incentive object policy to generate the simulated actions of drivers in response to different incentives. The rewards of the simulated actions of the drivers is determined by a discriminator. The incentive policy for preventing fading drivers is optimized by reinforcement learning based on the virtual trajectories generated by the joint policy simulator and discriminator.

Abstract: In accordance with one implementation of the present disclosure, a new approach for determining a movement orientation of a user is proposed in indoor navigation. Generally speaking, a device orientation of a terminal device is obtained based on at least one signal stream collected from the terminal device carried by a moving user. A deviation degree is determined based on the at least one signal stream, here the deviation degree represents a deviation between a movement orientation of the user and an actual device orientation of the terminal device. The movement orientation is determined based on the device orientation in accordance with a determination that the deviation degree is below a threshold degree. With the above implementation, the movement orientation of the user is determined in a more effective an accurate way, and thus accuracy of the indoor navigation is increased.

Abstract: In accordance with one implementation of the present disclosure, a new approach for identifying a stepping event is proposed in indoor navigation. Generally speaking, a first signal fragment and a second signal fragment respectively within a first time window and a second time window in an acceleration signal stream are obtained, here the acceleration signal stream is collected from an acceleration sensor associated with a moving user, the first time window being shorter than the second time window. A first amplitude feature and a second amplitude feature are determined for the first and second time windows based on the first and second signal fragments, respectively. A stepping event of the user is identified based on a deviation between the first and second amplitude features. With the above implementation, the stepping event is identified in a more effective an accurate way, and thus accuracy of the indoor navigation is increased.

Abstract: A system and method to optimize the distribution of incentives for a transportation hailing service is disclosed. A database stores state data and action data received from a client devices and transportation devices. The state data is associated with the utilization of the transportation hailing service and the action data is associated with different incentives to passengers to engage the transportation hailing service. A Q-value determination engine is trained to determine rewards associated with incentive actions from a set of virtual trajectories of states, incentive actions, and rewards, based on a history of the action data and associated state data from the database. Passengers are ordered according to V-values. An incentive policy including selected incentive actions based on the determined rewards and passengers is created. An incentive server communicates selected incentives to at least some of the client devices according to the determined incentive policy.

Abstract: A system and method of determining a policy to prevent fading drivers is described. The system and method creates virtual trajectories of incentives such as coupons offered to drivers in a transportation hailing system and corresponding states of drivers in response to the incentives. A joint policy simulator is created from an incentive policy, a confounding incentive policy, and an incentive object policy to generate the simulated actions of drivers in response to different incentives. The rewards of the simulated actions of the drivers is determined by a discriminator. The incentive policy for preventing fading drivers is optimized by reinforcement learning based on the virtual trajectories generated by the joint policy simulator and discriminator.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for constructing a virtual environment for a ride-hailing platform are disclosed.