MR framework for object manipulation using PPO