15 % of falls on wheelchairs lead to severe complications!
IW 2.0 - Pitfall Detection - intends to prevent them!
15 % of falls on wheelchairs lead to severe complications!
IW 2.0 - Pitfall Detection - intends to prevent them!
Abstract
The objective of the project is to find an intelligent way to control a powered wheelchair, in order to prevent its users from pit falling, for example on a downward staircase or hole, and from tipping, due to a bump, sidewalk or wall.
To accomplish this, the first step would be to identify the environment in front of the chair and label it as a safe or dangerous situation. For this task, 2 different types of depth sensors were characterised, TeraRanger Evo64 px and StereoLabs ZED2 Depth Camera.
Meet & Greet the sensors
Compact sensor is lightweight and small size, making it perfect to fit in narrow locations when attaching to the powered wheelchair. The EVO64 uses infrared time-of-flight (TOF) technology to calculate the distance up to 5 meters, outputting 64 measures (pixels) that are displayed as an 8 x 8 matrix.
Besides , the ZED2 being a little bigger than the EVO64, this RGB-D camera offers a high-definition stereo vision image (4147200 px – 3840x1080 – at 30 fps), with a wide field of view. Beyond this, the camera also has multiple builtin sensors (IMU, Barometer and magnetometer) as well state of the art depth/spatial perception based on artificial intelligence algorithms (neural networks).
Real Life Experiments to solve Real Life Problems
In the video, we go through most of the experiments made with the sensors and the results they present.
In the end, the clear choice is the ZED2 since it is more reliable, sturdy and precise in the measurements it performs.
Results
For the Terabee Evo 64 px the experiments and their results were not accurate nor satisfatory for the level of precision needed in a wheelchair. To verify it's reading fluctuation, a further test was done with a comparison of the readigns of a sensor in a white and black surface. The results of this experiment can be visualized in the following histograms.
The behaviour of the histogram follows a Gaussian distribution curve, centered approximately in zero, which means, the data received can be filtered using an Average Filter.
Most of the consecutive readings are close to 0 - 10 cm difference, which prevents the detection of bumps, but some consecutive redings go to a difference of 50 cm, for the same depth.
Comparing both sides, we can see that the error is centered around 0-10, which means that in the same sample, the depth in both regions is the approximately the same, varying due to the noise of the sensor.
Besides all these problems, the frame rate varies according to the field in front of it which is a big problem since it is needed that the sensor is able to respond to every situation equally.
Based on these, the best choice is the ZED2 Camera due to it's high performance, accuracy and stability.
Conclusion
In conclusion, after comparing both sensors and evaluating both hypotheses, the ZED2 Depth Camera clearly showed to be more promising due to it’s high resolution, wide field of view and stable readings throughout time and independent of the situation.
Moreover, the work developed with the ZED2 already allows to identify multiple dangerous situations, as exceed inclination, bump detection and pitfall detection (important to mention that these tests could only be tested inside the house, in a limited space, due to the Covid19 pandemic).
As future work, the plan is to conduct the test in an outside environment with real life situations, to fine tune the algorithm parameters. After that, the last step would be to attach the sensor to the wheelchair, in order to control the wheelchair speed according to the classified situation.