X-VoE - Visualization

Visualization

Our work is unparalleled in its post-observation interpretation process. This process enables us to reveal the physical processes occurring behind a blocking wall, as inferred by the model in three different settings within the blocking scenario. Our model has been proven to anticipate the presence of objects behind the wall with remarkable accuracy, providing a clear and concise explanation for the observation. Moreover, it determines whether the intuitive physics is being violated based on the revealed physical process, making it an indispensable tool in understanding complex physical phenomena.

Predictive_visual

In the context of predictive analysis, it's quite easy to judge the top and bottom videos and conclude that the top one is in line with physical principles while the bottom one is not. However, the predictive model assumes that the violation of physical principles occurs after the ball emerges from the right side. But, by clicking the button on the left for explanation, it is possible to restore the hidden event and determine that the physics was violated when the ball wasn't visible.

Hypothetic_visual

It is important to note that the predictive model generally assumes that there are no objects behind an occluder, leading it to determine that the video below conforms to physics while the above does not. However, by clicking the button on the left for explanation, it can be deduced that in the video above, there is indeed a blocking object behind the baffle, which causes the ball to bounce back from the blocking object. Therefore, it is evident that both the top and bottom videos conform to physics.

explicative_visual

The predictive model explaining physical events is limited by the information available at the time of prediction. As a result, it may not consider important information revealed later in the video, which could impact its ability to determine if the early events violate physical common sense. However, by clicking the button on the left for explanation, our model can confidently explain the event. It concludes that the video above aligns with the laws of physics, while the video below does not. Interestingly, this contradicts the initial conclusion reached without explanation.