9. Planning under Uncertainty

Unit 9 01 Introduction

Discuss this question on aiqus. When posting use the tag 'unit9-1'

Unit 9 02 Planning Under Uncertainty MDP

Discuss this question on aiqus. When posting use the tag 'unit9-2'

Unit 9 03 Robot Tour Guide Examples

Discuss this question on aiqus. When posting use the tag 'unit9-3'

Unit 9 04 MDP Grid World

Discuss this question on aiqus. When posting use the tag 'unit9-4'

Unit 9 05 Problems with Conventional Planning 1

Discuss this question on aiqus. When posting use the tag 'unit9-5'

Unit 9 06 Branching Factor Question

For this problem (and only this problem) assume actions are stochastic in a way that is different than described in 4. MDP Gridworld.  Instead of an action north possibly going east or west, an action north will possibly go northeast or northwest  (i.e. to the diagonal squares).

Likewise for the other directions e.g. an action west will possibly go west, northwest or southwest (i.e. to the diagonals).

Discuss this question on aiqus. When posting use the tag 'unit9-6'

Unit 9 07 Branching Factor Answer

Discuss this question on aiqus. When posting use the tag 'unit9-6' 

Unit 9 08 Problems with Conventional Planning 2

Discuss this question on aiqus. When posting use the tag 'unit9-7'

Unit 9 09 Policy Question 1

Stochastic actions are as in 4. MDP Grid World.  An action North moves North with 80% chance otherwise East with 10% chance or West with 10% chance.  Likewise for the other directions.

Discuss this question on aiqus. When posting use the tag 'unit9-8'

Unit 9 10 Policy Answer 1

Discuss this question on aiqus. When posting use the tag 'unit9-8'

Unit 9 11 Policy Question 2

Stochastic actions are as in 4. MDP Grid World.  An action North moves North with 80% chance otherwise East with 10% chance or West with 10% chance.  Likewise for the other directions.

Discuss this question on aiqus. When posting use the tag 'unit9-9'

Unit 9 12 Policy Answer 2

Stochastic actions are as in 4. MDP Grid World.  An action North moves North with 80% chance otherwise East with 10% chance or West with 10% chance.  Likewise for the other directions.

Discuss this question on aiqus. When posting use the tag 'unit9-9' 

Unit 9 13 Policy Question 3

Stochastic actions are as in 4. MDP Grid World.  An action North moves North with 80% chance otherwise East with 10% chance or West with 10% chance.  Likewise for the other directions.

Discuss this question on aiqus. When posting use the tag 'unit9-10'

Unit 9 14 Policy Answer 3 Question 4

Stochastic actions are as in 4. MDP Grid World.  An action North moves North with 80% chance otherwise East with 10% chance or West with 10% chance.  Likewise for the other directions. 

Discuss this question on aiqus. When posting use the tag 'unit9-11' 

Unit 9 15 Policy Answer 4

Stochastic actions are as in 4. MDP Grid World.  An action North moves North with 80% chance otherwise East with 10% chance or West with 10% chance.  Likewise for the other directions. 

Discuss this question on aiqus. When posting use the tag 'unit9-11'  

Unit 9 16 MDP and Costs

Discuss this question on aiqus. When posting use the tag 'unit9-12'

Unit 9 17 Value Iteration 1

Discuss this question on aiqus. When posting use the tag 'unit9-13'

Unit 9 18 Value Iteration 2

Discuss this question on aiqus. When posting use the tag 'unit9-14'

Unit 9 19 Value Iteration 3

Discuss this question on aiqus. When posting use the tag 'unit9-15'

Unit 9 20 Deterministic Question 1

Discuss this question on aiqus. When posting use the tag 'unit9-16'

Unit 9 21 Deterministic Answer 1

Discuss this question on aiqus. When posting use the tag 'unit9-16' 

Unit 9 22 Deterministic Question 2

Discuss this question on aiqus. When posting use the tag 'unit9-17'

Unit 9 23 Deterministic Answer 2

Discuss this question on aiqus. When posting use the tag 'unit9-17' 

Unit 9 24 Deterministic Question 3

Discuss this question on aiqus. When posting use the tag 'unit9-18'

Unit 9 25 Deterministic Answer 3

Discuss this question on aiqus. When posting use the tag 'unit9-18' 

Unit 9 26 Stochastic Question 1

Discuss this question on aiqus. When posting use the tag 'unit9-19'

Unit 9 27 Stochastic Answer 1

Discuss this question on aiqus. When posting use the tag 'unit9-19' 

Unit 9 28 Stochastic Question 2

Discuss this question on aiqus. When posting use the tag 'unit9-20'

Unit 9 29 Stochastic Answer 2

Discuss this question on aiqus. When posting use the tag 'unit9-20' 

Unit 9 30 Value Iterations and Policy 1

Discuss this question on aiqus. When posting use the tag 'unit9-21' 

Unit 9 31 Value Iterations and Policy 2

Discuss this question on aiqus. When posting use the tag 'unit9-22'

Unit 9 32 MDP Conclusion

Discuss this question on aiqus. When posting use the tag 'unit9-23'

Unit 9 33 Partial Observability Introduction

Discuss this question on aiqus. When posting use the tag 'unit9-24'

Unit 9 34 POMDP vs MDP

Discuss this question on aiqus. When posting use the tag 'unit9-25'

Unit 9 35 POMDP

Discuss this question on aiqus. When posting use the tag 'unit9-26'

Unit 9 36 Planning Under Uncertainty Conclusion

Discuss this question on aiqus. When posting use the tag 'unit9-27'