Cowmon!
Storms - Kutatási projekt - Cargo Connect 2021-22
Storms - Kutatási projekt - Cargo Connect 2021-22
Our team has chosen the topic of animal transport. Within this, we want to make the transportation of cattle safer.
We conducted research on the dangers of transportation. Mortality rates were recorded from 0.1% to 0.01% between 2010 and 2015. This means thousands of animals die every year just in the European Union. This is a significant number both from an animal welfare perspective and a financial perspective. In addition to this, injuries are even more common, which also cause a lot of suffering to the animals as well as extra costs to the owners. As a solution, we came up with the idea to monitor the cows during transport. We install cameras whose images are analyzed by artificial intelligence. If it detects an abnormality, such as a cow being trampled, it alerts the driver, giving him the opportunity to intervene.
From the posture of the cows, it can be deduced with great certainty whether they are in danger.
Our solution is primarily made to help avoid trampling incidents, but it can also help reduce the impact of other problems (e.g.: shipping fever).
In the event of an alarm, the driver has the option to stop and intervene or even seek assistance from an expert. Quick intervention can save a significant portion of animals in danger.
By connecting the solution to an existing telemetry system, a central operator team with the right expertise could control the transportation. Using the alarms generated by the artificial intelligence, or via live camera view or replays, the driver can be given appropriate instructions. This can make the intervention more effective and reduce the impact of AI false positive alerts.
The broader topic, animal transport, was chosen quickly. This is close to us because we keep cows. At first, we wanted to observe the life functions of the animals. Breathing, pulse, blood oxygen levels can be measured quite easily and from this the condition of the animal can be deduced. However, they are all really resource intensive. Every animal must be fitted with a measuring device, which makes loading difficult and complicated, and the devices can easily fall apart. That's when the idea to use a camera came up. With the help of the freight transporter Gábor Mogyorósi and Hunland Kft, we’re able to continue.
They also use cameras to monitor the animals, and they shared the problems that they faced. (The cows lick everything they reach, it can get dirty, or break down ...)
We also asked for help from animal experts. We visited two animal resting stations (Nagylak and Magyarcsanád) whose manager, János Rovó, helped our team by sharing useful information with us.
He liked our idea and found it important from an animal welfare point of view and mentioned specific cases where this solution could have avoided an accident.
We also contacted a the company Serket-tech who has a working solution to monitor pig farming with artificial intelligence. Although they do not watch the animals during transport, they have found the idea workable.
We also wrote to Professor Temple Grandin, who (to our surprise) quickly responded. She confirmed that the biggest danger during transport is trampling and heat stress.
In addition to the camera image, the possibility of analyzing more data also came up. The measurement of the environmental parameters (temperature, humidity) is already possible, but by analyzing them together with the camera image, detections can be done using much more data. Analysis of animal’s voices has also been discussed. Due to the short time available to us, we have not yet explored these options in depth. These are opportunities for improvement.
We have looked at how animals are currently transported and what rules need to be followed.
There are transport companies that are already using camera surveillance. But while driving, the driver can’t pay attention to both the road and the camera image at the same time, so this is only used for the occasional ‘glance’. Our idea is to have the artificial intelligence analyze the image, making transportation easier and more secure.
We wanted to create a demo solution, with which we can illustrate the process and gather experience about the way artificial intelligence operates and its challenges. It was easier than we thought. From easily available solutions and tutorials on the Internet, we’ve been able to put together a solution that recognizes cows from a top view and alerts the driver when it detects a cow with an abnormal posture (lying down).
Our application, COWMON! got its name by putting together the words cow and monitoring. We also designed a logo for the product.
We wanted to create a demo solution, with which we can illustrate the process and gather experience about the way artificial intelligence operates and its challenges.
One of our team members can program very well and has already had some experience with artificial intelligence. After some research on the internet, we selected the OpenCV computer vision framework and the YOLO real-time object recognition AI platform. We designed the demo application in JAVA because we’ve already had experience using it.
We present our solution using a demo model. For this, we use lifelike Schleich cows transported by a truck made of Lego. For the camera, we use a mobile phone that is connected via USB to the computer on which the analyzation of the camera image is done.
Our goal was for the application to detect the location of the animals, mark the (abnormally) lying animal in the image, and send an alert if it finds one.
After selecting the framework, we took pictures of our model cows from multiple angles and positions. We trained the AI with the finished photos for about 10 hours.
It then was able to recognize and distinguish cows in “safe” and “dangerous” positions with good enough probability. If a dangerous position is detected, it is framed in red, and the computer emits a warning sound. Of course, there are still a lot of false alarms/recognitions for the time being, which caused a lot of funny situations during the tests and made the demonstrations a lot more exciting :)
Even now, we are not sure that basing the model on object recognition is the correct solution. We thought about using a combination of motion-detection and a wireframe-based solution, but we decided to use object recognition for the demo because of its simplicity.
We’ve tried to check what technologies are on the market for similar purposes, and so far we’ve only come to the conclusion that “It can work”.
During the creation and testing of the model, we found that it is much easier to work with artificial intelligence than we previously thought and that a lot of data (images) would be needed to develop a solution that works accurately on a larger scale.
Our idea is a solution to a big animal welfare problem.
There are already transport companies who use camera surveillance, but we plan to analyze the image with artificial intelligence, so it won’t distract the driver. During long-term transport, even on a ship, it stays “watchful” all the way through. It also eliminates problems arising from negligence, inattention, or lack of expertise.
During our research, we received a lot of feedback from the interviewed professionals that our solution could help some of their problems. They mentioned specific cases where an accident could have been avoided with our solution.
Although the direct economic benefit can be demonstrated in the long run, in our experience (also beyond the scope of this research project) this does not provide sufficient motivation for the companies to develop it, and replace the already working, “good enough” methods.
The regulations of the European Union set quite strict standards during transport. These are expected to be further tightened. The best way to spread the solution would be for regulations to evolve in that direction. We plan to contact the relevant authorities in this regard.
Several shipping companies we contacted during our research would be interested in the solution. If the product were available in a complete, “boxed” form, these companies could easily integrate it.
COWMON! would be useful both from an economical and an animal welfare point of view, breeders, slaughterhouses, and transporters would benefit from using it, but perhaps the biggest benefiters would be cows
The COWMON! application is currently up and running in the form of a mock-up version. To be used in real life, the greatest expenses would be writing the program, developing the artificial intelligence along with the biological research associated with it. This requires a one-time, larger investment. Manufacturing and installation would be at a lower cost due to the solution being software-based.
Discussions are underway with Serket-tech, who would be able to develop such a solution based on their previous work. We have already received help from their Animal scientist experts in earlier phases, now we are discussing with their developers and CEO. In addition to the technological details, we can get a lot of help from them regarding the “go to market” strategy, as they started out as a start-up company years ago.
One of the biggest challenges would be the placement of the cameras.
There is not much space around / above the animals, so a wide-angle solution would have to be used. A glass enclosure would be adequate for the physical protection of the devices due to its durability and cleanability.
We have consulted with a shipping company about their experience in using the camera system and based on this we deemed the task to be doable.
It is difficult to estimate, but based on our information so far, the development of a professional finished product would require 800-1000 engineering days (4 FTE, 1 year) of development work. We estimate this to be between € 150,000 and € 200,000, which means a very low license cost even for only 1,000 vehicles.
Cost elements of equipping a transport vehicle:
5 cameras (wide angle, with glass cover)
on-board module (storage, analysis)
installation, cabling
Based on data available on the Internet, we estimate this to be 1500-2000 EUR / vehicle, which is a small investment compared to the price of the vehicle and the cost of other equipment.
Team: Molnár Levi, Molnár Verus, Molnár Bogi, Molnár Csabi
Coach: Molnár Zsolt, Molnár Hajnalka
Elérhetőségünk: facebook.com/stormsteam