Introduction
daadads
Our Robotic Platform
Visual Servoing
We present a general framework for accurate positioning of sensors and end effectors in farm settings using a camera mounted on a robotic manipulator.
Our main contribution is a visual servoing approach based on a new and robust feature tracking algorithm. Results from field experiments performed at an apple orchard demonstrate that our approach converges to a given termination criterion even under environmental influences such as strong winds, varying illumination conditions and partial occlusion, of up to 50%, of the target object. Further, we show experimentally that the system converges to the desired view for a wide range of initial conditions.
This approach opens possibilities for new applications such as automated fruit inspection, fruit picking or precise pesticide application.
Active View Selection
View 1
View 2
View 3
For phenotyping studies and many precision agriculture tasks counting the fruits accurately is essential. Fruit clusters often have arbitrarily complex geometry making it impossible to obtain correct fruit count from singular views (images on left shows the captured images of a cluster from three different viewpoints). We consider an agricultural automation scenario where a robot, equipped with a camera mounted on a manipulator, is charged with counting the number of apples in an orchard. We focus on the sub-task of planning views so as to accurately estimate the number of apples in an apple cluster. We present a technique to efficiently enumerate only distinct combinatoric world states and methods to estimate their likelihoods from these images
Publications
Acknowledgement
This material is based upon work supported by the National Science Foundation under Grant No. 1317788
Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.