Embedded Files
Positive Reinforcement and Clicker Training
Positive Reinforcement and Clicker Training
After ruling out pain and meeting the horses basic needs, we can move onto the training process. In the Humane Hierarchy, the first step for training begins not at Exit 3 with positive reinforcement, but with Exit 2, Antecedent Arrangements, which basically means "setting the stage". This can include meeting the horse's basic needs, but beyond that, we need to set the stage before each training session. Before we begin a session, our first step should always be to remove anything from the training area that could cause the horse stress. Stress affects the horse's learning capacity, and learning only occurs when the Learner is engaged. When training new behaviors, it is always best to minimize the stress of the training area, so the horse is in the best mindset to engage with the training. When the stage is set, we can bring the horse out for its training session with Positive Reinforcement!
Bean was taught to "smile" by Capturing a Flehmen then adding a cue!
Methods of Training Behavior
Methods of Training Behavior
Shaping
Marking and rewarding small steps and attempts at performing the desired behavior.
Capturing
Marking and rewarding a behavior that the animal performs on its own.
Targeting
Marking and rewarding touching an object with part of the body, often the nose but it can be used for other parts like the shoulder.
Luring
Using a reinforcer to physically encourage a behavior, as in having a horse follow hay into a stall.
Clicker Training
Clicker Training
Clicker training is a relatively new method to the horse world, but it is very engrained in many other animal industries. Lab and zoo animals are almost exclusively clicker trained for cooperative care. Positive Reinforcement and Clicker training are widely regarded as the most ethical and effective training method for animal handling. These methods are most commonly seen in day-to-day lives through dog training.
Some common misconceptions:
You need a physical clicker to do Clicker Training.
"Clicker" Training is a misleading name. The "click" can also be called a "marker," which could be a variety of things as long as it is consistent every time. Whatever you choose for your marker has to be a neutral stimulus for the animal. If the horse is scared of the sound of the clicker, try a different sound, like a whistle. If the horse cannot hear, you can try some kind of visual marker as long as it stays the same.
Examples of possible markers:
Click (with Clicker or tongue)
Whistle
Kiss
Clap
Vibration
Flashing light
Food-based training is just bribery.
There is plenty of science backing the use of food/rewards-based training as safe and effective (1, 2, 3, 4).
Clicker training and Positive Reinforcement are only good for trick training.
Clicker training has been successful in training many behaviors, including complex behaviors, like for cooperative care, in which an animal may be trained to present a limb for a needle injection.
The Basics of Clicker Training
Clicker training at its core is very simple. Ask for a behavior, click to mark the behavior, and reward for the behavior. There are just a few steps to get started with basic behaviors.
Step 1: Choose your Marker
As discussed, your "click" can be anything as long as it is consistent. Pick a marker that you feel confident in your abilities to be able to perform quickly AND is a neutral stimulus for the horse. If a click causes the horse stress, you may choose another marker that doesn't cause stress. For many people, a click with the tongue is preferred because it does not require the use of another hand. If clicking with the tongue is difficult, you can use a kiss, whistle, or clap. There are so many possibilities for your personal training method!
Step 2: Loading the Marker
Loose idea of values of treats. Every horse will have its own preferences, but in preference tests, horses overwhelmingly prefer food reinforcers over tactile reinforcers like scratches and pets (10).
*If the horse is getting too excited for the treats you are using, lower the value of the treat to decrease the excitement. You want them to enjoy work, but you also need to set the right stage for the horse to focus on what you are asking, not just the treat!
Using what we know about Classical Conditioning, we can pair an appetitive stimulus with a neutral stimulus to create a positive association. For example, a click with the tongue on its own will not mean anything to the horse, but after pairing with an appetitive stimulus, the horse will associate the click with the appetitive stimulus.
Offer the appetitive stimulus (for this step, use a high value reward, like tasty cookies, fresh fruits, etc.) somewhere the horse can access easily.
Use your marker when the horse takes the treats, marking each time the horse picks up a treat. At first, you can mark right as the horse picks up a treat. This way, the horse hears the marker as it is experiencing the reinforcer (treats).
After some time building up the association (marker = tasty, yummy, delicious treat), you can then begin transitioning the marker into actual practice.
Step 3: Default Position
Oftentimes when discussing Positive Reinforcement with horses, the biggest concern is the risk of "mugging". Mugging occurs when the horse is not taught a solid default. Before beginning any food-based training, we must teach the appropriate way in which a horse must behave for the safety of the handler.
Start by simply standing and offering nothing, no reinforcement or cues, just still and quiet. Consider this your default position.
When the horse stands quietly with its head straight forward, or the nose slightly turned away from you, mark and reward*
*When rewarding, ALWAYS give the reward to the horse. Do not let the horse turn in to take the reward from you. You always want to give the reward in the horse's space, not your own*
The more you reinforce the default position, the more consistent the horse will be in staying in that position when it hears the marker.
Mark the behavior, reward in position.
Kota, a 3-year old BLM Mustang, brushing up his default position with an added component - an open pan of treats! Enticing, but he must learn not to crowd for food. In this training method, he learns that he still gets food in the Default position but not when he reaches into the pan.
Step 4: Training to Target/"Touch"
Target/"Touch" is a foundational behavior to teach early in a horse's progress. Teaching the horse to Target will be helpful later in teaching the horse to walk on a lead line, go over obstacles, load into a trailer, and more!
Bean, a 14 year old BLM Mustang, doing ground pole exercises at liberty using a target.
This target stick is just one example of what can be used for this, and it can be found here. This website generates zero revenue from sales.
Present the target (can be anything the horse can see but is not afraid of) either on the ground or in a neutral manner. The goal is to minimize the fear response and activate the horse's curiosity.
At first, mark and reward any engagement with the target.
Engagement could be as simple as looking at the target. Some horses will need more marking for small attempts at engaging, while others might automatically walk up to the target.
Mark and reward for increasing engagement until the horse touches the target with its nose.
These sessions can be very short! Training does not need to take up a full hour. Often, a 5-minute session will be much more effective. Try setting a short timer and ending the session when the timer goes off. Give the horse a break to graze, drink, rest, then come back to another short session, starting over with marking any engagement. This seems tedious, but this builds reinforcement history, minimizes stress, and keeps training sessions more appealing to the horse.
When the horse is consistently touching the target with its nose, pick up and move the target a little bit, but not too much. At first, keep it within reach, so the horse does not have to walk to it. Mark and reward touching target.
In this step, you may need to go back to Step 3 to help the horse figure it out.
When the horse is following the target within its reach while standing still, try moving the target just out of reach, no more than a step away. Mark and reward moving towards and touching the target.
Again, you may need to go back to Step 3 to help guide the horse to the correct response.
Continue building up moving towards the target slowly. Asking too much of the horse will make it lose interest and disengage, which stops the learning. Start by counting steps and increasing one step at a time, then 3 steps, and continue shaping the behavior until you can easily walk with the horse following the target.
This can transition into trot and canter work with time and patience.
Ask The Question
In training, we must build up the reinforcement history by rewarding for small attempts. However, it is equally important to remember to Ask The Question. When the horse starts to get bored of repeating a behavior, it might be time for you to ask:
"Are you ready to move onto the next step?"
To continue progressing in your training beyond these basics, there are additional resources included at the bottom of this page that link to educated behaviorists and trainers who post content to teach more about horse training and behavior.
Force-Free and Liberty
Force-Free and Liberty
Taking a brief field trip back to Exit 2: Setting the Stage, we must discuss the tools we are using and the location we choose for training. In order to minimize distress, the best training area is a neutral location, this can be its paddock/pasture or anywhere else, as long as the location does not cause distress. The ideal location is an enclosed but large area, where the horse can choose to disengage and leave. Why do we want to give the horse the opportunity to leave the training session? Added restraint and limited choices are all stressors for the horse. As we discussed in the Stress section, a horse can start to reach its stress threshold through trigger stacking. If restraint is a trigger, then that is going to move the horse closer to reaching that threshold.
By choosing a large enclosed area where you can safely train without the horse on a lead, you can take away one more stressor that might have reduced the horse's engagement in training!
In the training area, you should provide water and forage, which helps satisfy Exit 1: Wellness. Horses need to eat throughout the day, and restricted access to forage could cause stress. This training method not only gives them access to forage and water, but also gives them the choice to consume the forage and water as they wish. Remember, your training sessions can be very short with opportunities to take a break and come back for another short session!
Protected Contact
Protected Contact
In the pursuit to minimize stress in training, you may come across a horse that behaves in a way that puts you at risk of harm. Most of the time, these behaviors are the result of some kind of underlying pain or the memory of the pain. It can also be the result of a traumatic event. Horses will only show as much aggression as they feel the situation calls for, so responding to their aggression with more aggression can escalate the situation and make things even worse. Try your best to keep yourself calm and safe without punishing the behavior. How do we do that?
Protected Contact means to work with the horse still at liberty, but with a barrier between you and the horse. This can be a stall door or a fence as long as the horse will not go through it. This will help keep you safe where the horse can still be free to engage or disengage. Working in Protected Contact can help you build the relationship with the horse, so it feels more comfortable with handling. This is also a good way for you to learn what the horse's triggers might be and how to help them.
Hank developed severe and persistent ulcers, causing him a lot of pain. His reactions to the pain made handlers nervous around him, and he was punished. He struggles with his relationship with humans when he is in pain, so this is relationship building over protected contact to keep both of us feeling safe.
Cooperative Care
Cooperative Care
In the effort to minimize stress in captive/domestic conditions, the idea Cooperative Care was developed. The goal is to train the animal to participate in procedures. From lab and zoo animals presenting an arm for needle injections to pet dogs allowing bathing, Cooperative Care can be used across all species for a variety of procedures.
With Operant Conditioning, we can shape behaviors for the horse's benefit (5, 6, 7). For hoof care, training the horse to lift and place its hoof on a hoof stand may take some time, but it can save a farrier's back! Using Target, a horse can learn to present different parts of its body, like ears, for health checks! A few of the professionals listed at the end of this section have videos showing what this looks like in more detail with horses.
De-Sensitization and Counter-Conditioning
De-Sensitization and Counter-Conditioning
De-Sensitization
De-Sensitization
De-Sensitization is a training method in which a stimulus that may cause some stress (ex: an toy ball) is presented in a way that it does not actually cause the reaction (4, 8). Identifying the position or distance the stimulus is when the horse reacts to it is important in this process. With the stimulus presented in a way to prevent an undesirable response, you can then gradually bring it closer as long as it does not cause a reaction. If the horse becomes scared and tries to leave, allow it to leave. This is an example of the Flight response being triggered, and they now need to calm back down to get into the learning headspace again. Preventing them from escaping can lead to flooding and Learned Helplessness (8), and it does not give the horse the opportunity to willingly engage in the training, therefore decreasing the amount it can actually learn in the session.
The goal of De-Sensitization is to condition the horse to have NO reaction to the stimulus.
Counter-Conditioning
Counter-Conditioning
Counter-Conditioning is a training method in which a stimulus that causes fear or aggression is paired with an appetitive stimulus (4, 8). For example, a horse that holds trauma around hoof care might have learned to kick out when someone tries to pick up its leg. We can Counter-Condition this response by reframing the context of the stressor. This means that we can essentially dissolve the association the horse has formed with hoof care and re-pair it with a positive experience for the horse. This process is very similar to Loading the Marker (Step 2 of Clicker Training), but the stimulus in this situation causes a reaction/is not neutral. Much like with De-Sensitization, great care must be taken to prevent flooding and Learned Helplessness (8), but through Positive Reinforcement and Force-Free practices, Counter-Conditioning can be an accessible goal for anyone!
The goal of Counter-Conditioning is to condition the horse to associate a previously aversive stimulus with an appetitive stimulus.
Sources:
Sources:
McLean, A. N., & McGreevy, P. D. (2010, June 25). Horse-training techniques that may defy the principles of learning theory and compromise welfare. Journal of Veterinary Behavior. https://www.sciencedirect.com/science/article/pii/S1558787810000626
Sankey, C., Richard-Yris, M.-A., Henry, S., Fureix, C., Nassur, F., & Hausberger, M. (2010, May 21). Reinforcement as a mediator of the perception of humans by Horses (Equus caballus) - animal cognition. SpringerLink. https://link.springer.com/article/10.1007/s10071-010-0326-9
Schiller, W., Urquart, R., Schiller, T., Schiller, R., & Kindersley, T. (2023). The principles of training: Understanding the relationship between you and your horse, and Why Effective Training Works. Warwick Schiller Attuned Horsemanship.
Peters, S., & Black, M. (2012). Evidence-based horsemanship. Wasteland Press.
Wess, L., Böhm, A., Schützinger, M., Riemer, S., Yee, J. R., Affenzeller, N., & Arhant, C. (2022). Effect of cooperative care training on physiological parameters and compliance in dogs undergoing a veterinary examination – a pilot study. Applied Animal Behaviour Science, 250, 105615. https://doi.org/10.1016/j.applanim.2022.105615
Sydänheimo, A., Freeman, M., & Hunt, K. (2023). Cooperative care does not scare – use of cooperative care training in routine husbandry in dogs. Animal Behaviour and Welfare Cases. https://doi.org/10.1079/abwcases.2023.0010
Carroll, S. L., Sykes, B. W., & Mills, P. C. (2022). Moving toward fear-free husbandry and veterinary care for horses. Animals, 12(21), 2907. https://doi.org/10.3390/ani12212907
Changing behaviors. AAHA. (n.d.). https://www.aaha.org/aaha-guidelines/behavior-management/changing-behaviors/
Hall, C., Goodwin, D., Heleski, C., Randle, H., & Waran, N. (2008a). Is there evidence of learned helplessness in horses? Journal of Applied Animal Welfare Science, 11(3), 249–266. https://doi.org/10.1080/10888700802101130
Kieson, E., Felix, C., Webb, S., & Abramson, C. I. (2020). The effects of a choice test between food rewards and human interaction in a herd of domestic horses of varying breeds and experiences. Applied Animal Behaviour Science, 231, 105075. https://doi.org/10.1016/j.applanim.2020.105075
Page updated
Google Sites
Report abuse