Other Rewards

Sparse

NGSIM

Successful

success, smooth, but slows down 28.07.2020_17:06:18_10_ckpt=07900_scenario=NGSIM_LANE_CHANGE_US101_VALIDATION_steps=38_total-reward=1.9.avi

Smooth, but then slows down I

(common case on NGSIM)

success, but slows down 28.07.2020_17:06:18_0_ckpt=07900_scenario=NGSIM_LANE_CHANGE_US101_VALIDATION_steps=56_total-reward=2.0.avi

Smooth, but slows down II

Failed

failed, impatient, wanted to fit in quickly 28.07.2020_17:06:18_1_ckpt=07900_scenario=NGSIM_LANE_CHANGE_I80_VALIDATION_steps=8_total-reward=-0.7000000000000001.avi

Gap getting smaller, tried to quickly fit in

(perhaps was afraid of timeout)

failed, too small gap 28.07.2020_17:06:18_24_ckpt=07900_scenario=NGSIM_LANE_CHANGE_I80_VALIDATION_steps=14_total-reward=-0.7.avi

Gap already too small, but why not...

(there are cases of overtaking in such situation, but less frequent)

openDD

Successful

success, slip but recovered 28.07.2020_15:12:50_5_ckpt=04500_scenario=OPENDD_RDB6_DENSE_steps=91_total-reward=2.0.avi

Slipped a bit, but recovered

(tried to preserve safe distance at all cost)

success, stronger slip 28.07.2020_15:12:50_7_ckpt=04500_scenario=OPENDD_RDB7_DENSE_steps=104_total-reward=2.0.avi

Stronger slip, also recovered


Failed

failed, hits in the back, unusual case 28.07.2020_15:12:50_5_ckpt=04500_scenario=OPENDD_RDB1_DENSE_steps=74_total-reward=-0.30000000000000004.avi

Rear-end collision, ignored stopped vehicle at exit

(maybe because it was smaller than most vehicles, that type of ignorance can be observed with other experiments too, probably the human driver stopped for pedestrian)

failed, stuck almost recovered 28.07.2020_15:12:50_5_ckpt=04500_scenario=OPENDD_RDB4_DENSE_steps=85_total-reward=-0.4.avi

Aggressive, didn't want to waste time

(very common case across all experiment, but that avoidance reaction is quite unique)