JOY FULL Horses: Understanding Extinction: Part 12

Mastering Micro: Building Unlikely Behaviors with Resurgence
Nothing is either all good or all bad.

We want to use positive reinforcement with our animals because we see it as being both effective and more humane.  But the associations created through positive reinforcement can create addictions to harmful behaviors.  Think about the way advertisers manipulate our behavior to encourage smoking or overeating.

Resurgence and regression can be very negative procedures, but they can also be used to produce what might otherwise be very difficult behaviors to obtain.

If you aren’t sure how you can turn what seems like a negative procedure into a positive teaching strategy, PORTL can once again help to illustrate how this works.

Here’s the set up:

The trainer sets a toy chair on the table for her learner to interact with. The goal is to get the learner to push the chair over the table the way she might push a toy car.

We’ll now observe quietly in the background while the learner begins to interact with the chair.  The trainer could get lucky.  The learner might begin offering the behavior she’s after within the first couple of clicks.  But with this learner there’s no sign of any chair pushing behavior. Why?

History matters.

The learner is going to draw on all of her previous repertoire of things she has done with chairs.  In this case we have a learner who was scolded as a child for pushing her chair over the floor, so she’s not very likely to offer this type of behavior with the toy chair.

A history of punishment has played a role in depressing chair pushing behavior for this learner, but pushing would also have been an unlikely behavior if the trainer had set down a dice. The learner would have tossed the dice or shaken it in her hand because that’s what you do with this kind of object. Pushing a dice over the table like a toy car is not an obvious behavior to try.

Through a series of small approximations, the trainer could try to shaping the behavior she wants.  Her first step would be reinforcing the learner for touching the chair.

The learner in this case is not particularly creative.  She offers simple touches, but nothing else.  Again, the trainer may be dealing with a history of punishment.  Her learner doesn’t have a lot of experience being reinforced for trying things.  In fact, quite the opposite – she may have been punished for stepping “outside the lines”.  She is like so many of our animal learners – hesitant, lacking in confidence, and not showing any outward signs of curiosity.  In her first few attempts she touches the chair, but she doesn’t try any other behaviors.  Getting her to push the chair is going to be hard.

So the trainer takes the chair away and sets out a toy car. Using an object that normally would be pushed makes it very easy to get the desired action.  The learner pushes the car over the table top. Click and treat.

This is repeated several times, and then the trainer takes the car away and sets the chair out.  The learner goes back to touching it.  The chair accidentally falls over – click and treat. The learner latches on to that, expanding her repertoire to two behaviors – touching the chair and knocking it over.

We see this so many times with our animal learners.  One click and suddenly you’ve locked in a behavior you don’t want.  With a creative learner this isn’t a problem.  You can quickly shift the behavior into something you want, but with these “one trick ponies” you have to be so very careful what you click.  In this case the learner persists in knocking the chair over even when she is no longer getting reinforced for the action.

Her trainer makes a quick decision and decides to put everything but pushing the chair like a car on extinction.  Her learner is clearly becoming frustrated.  To avoid having her shut down completely, the trainer takes the chair away and sets the car out again.  The learner immediately starts pushing the car over the table top.  Click and treat.

To help with the generalization the trainer puts a third object out – a small block. The learner pushes the block.  Click and treat.  This is repeated several times, then the trainer takes the block away and sets out the car.  The car is pushed. Click and treat.

The trainer sets the chair out, and the learner pushes the chair.  Job done.

Resurgence and Dog “Yoga”
Using the car in this way is an elegant teaching strategy.  Often when we come up with these clever ways of helping our learner to be successful, we know that it works, but we don’t really have good explanations for why.   Understanding resurgence helps us with the why in this case.  And it helps us to be more deliberate in the use of this kind of teaching strategy.  Here’s another example.

One of Kay Laurence’s students taught her dog to step up with his hind legs onto a chair.  It was elegant training, a beautiful example of setting the learner up for success.  In his talk on extinction, Dr. Jesús Rosales-Ruiz helped us to see that it was also a great example of using resurgence.

Here’s the lesson: First, the dog learned to stand one foot each on four small plastic pods. This alone was impressive training.  The pods were the same ones physiotherapists use to help people improve their balance and proprioception. It took great coordination for the dog to stay balanced on the four pods. But that was only step 1.  Next he learned to keep his front feet on the floor while he maneuvered his hind feet up onto the brick ledge of a fireplace hearth.

Adding in the precision of the pods came next.  Now the dog wasn’t just standing with his front paws on the floor and his hind end up on the ledge.  He was also balancing on all four pods.

This was not done as a cute party trick.  The dog’s owner is a yoga teacher.  Her interest was very much the same as mine – helping her animal learner maintain a healthy spine.  In this orientation she could ask her dog for weight shifts that contribute to a flexible spine.

The last step was setting up a training session next to a chair. The handler withheld the click, putting the dog into an extinction process. With very little experimentation, the dog oriented himself so his hind end was to the chair.  He certainly demonstrated the flexibility of his spine by stepping up onto the chair with his hind legs so he was standing hind end up on the chair and front feet on the floor.

Generalization and Creativity
Jesús commented that if we didn’t know about resurgence we would simply be saying the dog generalized.  That’s not a sufficient explanation.  What we were seeing was a great example of resurgence. PORTL has given us a better understanding of how to encourage this kind of problem solving.  When we want to train for this type of generalization, knowing about the “why” of resurgence helps us to be more deliberate and efficient in our training.

It isn’t positive reinforcement by itself that creates a positive learning experience.  An eagerness for learning comes from being a successful puzzle solver.  That success in turn comes from the kind of efficient, clean training that the clever use of resurgence encourages.

These examples give us a great perspective on creativity.  When we’re training, we aren’t waiting and waiting for our animals to do something we can reinforce.  Instead we can “seed” the behaviors we want them to draw on.  Then we set up the conditions and let them have the pleasure of discovering for themselves new or unlikely combinations.

We have a procedure for setting up the creative process.  You give your learner the repertoire, the components that form more complex behaviors, and then you set a puzzle and let extinction be the catalyst for solving it.

Coming Next: The “Pose”

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

JOY FULL Horses: Understanding Extinction: Part 1

Today’s post begins the final chapter of JOY Full Horses, but don’t worry about the book ending too soon.  I still have a month’s worth of posts to go.  The first installment went up January 3, 2016.  I thought maybe I’d be done around April. Ha!  I hadn’t realized how much work was going to be involved in putting up each post.  My goal is to finish by January 3, 2017.  We’ll see if I make it.  In the meantime, if you have friends who would enjoy reading the JOY Full Horses blogs, do share the links.   The more the merrier in this Holiday season!

Enjoy this next installment.

Extinction and Shaping
In the last couple of posts I’ve been sharing with you a presentation given by Dr. Jesús Rosales-Ruiz on extinction.  Many clicker trainers will say they never use extinction.  I know I work hard to set up my training so horses aren’t put into the kind of guessing game that leads to outbursts of frustration and aggression.  That’s something I very much want to avoid. But that doesn’t mean I don’t use extinction. That’s what Dr. Jesús Rosales-Ruiz makes so clear when he talks about resurgence and regression.

To the people who say they never use extinction, his response is: “What do you mean you never use extinction!  Extinction is at the heart of shaping.  Shaping is differential reinforcement. It’s the interplay between positive reinforcement and extinction.  So if someone says they aren’t using extinction, probably they don’t understand what they are saying.”

That’s such a wonderfully blunt and typical Jesús comment. Thankfully he doesn’t leave people just with that.  He goes on to explain what he means.  At the core of his presentations is this statement: “If you don’t understand extinction, you won’t be able to master it.”

So what does it means to master extinction, and how do you put it to use in a positive way?  That’s what I’ll be exploring in the coming posts.

Coming Soon: Regression and Resurgence

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

Hidden Motivators

JOY Full Horses: Ten Things You Should Know About Cues: Number 10: Playing with Chains – Part 4 of 5

Hidden Motivators
Yesterday’s discussion of negative reinforcement considered the impact that each individual’s learning history has on the emotional response to a particular procedure.  Something you regard as fun might make someone else run for the hills.  When we’re choosing which teaching strategy we’re going to use with our horses or dogs, their past experience matters.

We often think of negative reinforcement in terms of the overt actions someone is taking.  We can see the slack being taken out of a lead and understand that pressure is being applied.  The release of that pressure is intended to reinforce a desired response.  But there’s another form of pressure that’s not as easy to see that plays an important role in horse training.  I’ll use an example you can experience yourself.  Suppose I’m working with you showing you some of the rope handling techniques that I teach.

I’ll begin by having you stand in balance over your feet. I’ll slide down the lead very softly.  You’re relaxed, and I want you to stay that way.  If I slide down with a lot of “make it happen” muscle, I’d be picking a fight, and you’ll stiffen into resistance.

I want you to stay soft and relaxed, so I take care how I come down the rope.  I slide into a neutral position that doesn’t effect your balance.  This is the “get ready” stage of my cue.

Now I shift my own balance.  I let my overall balance shift forward onto my toes.  This subtle shift rocks you back on your heels.  The shift is so subtle, you may at first not even notice.  I wait.  I’ve taken the slack out of the lead, but I am not pushing on you in any way.  I have simply set up a shift in your balance.

After a bit, you’ll begin to feel uncomfortable.  You can’t maintain this slightly-out-of-balance position forever. You’re having to use muscle to sustain your position, and it’s creating uneven pressure on your joints. So you take a step back.  My hand releases, click and treat.

sue-3-photos-tai-chi-wall-2

At clinics people get to feel how subtle this is.  All I have to do is rock my balance slightly forward and the other person will shift back into her heels.  She won’t feel threatened by the action. In fact she often isn’t even aware that I have created this shift in her balance.  Her focus has been on my hands, not the subtle shift in her own balance.

It’s like a magician’s trick.  You’re so busy watching where the magician is directing your attention, that you don’t notice when he slips your watch off your wrist.  It isn’t the pressure from my hand on the lead that creates the change or causes that slight discomfort.  The lead gives me the framework through which to create the shift.  It’s the mild discomfort that the balance shift creates that triggers the step back.

This shift out of what feels normal to you draws your attention inside.  I want you to become aware of your balance, to learn to pay attention to these subtle shifts and to make adjustments that bring you closer to an optimal state of comfort.  I want to help you shift from what feels normal but may actually be a state of imbalance to what feels good because you are now in functional balance. That’s also what I want for the horses.  Body aware horses stay sounder longer.  And body aware horses not only look very beautiful, they are more athletic than their out-of-balance counterparts.

harrison-3-photos-before-after

This set of three photos show Natalie Zielinski and her horse Harrison.  In the top left photo he’s standing all higgeldy-piggledy.  Whenever he stopped, he was always out of balance.  He tended to fall over his left shoulder, so when she led him, he was always crowding into her.  The beautiful trot you see in the other two photos evolved out of work that helped him become much more body aware.

What Triggers Change?
Here’s another example of hidden negative reinforcement.  This one is a dog example.  I’ve watched Kay Laurence teach a puppy to put his paw on a target.  It looks like a wonderfully elegant example of shaping with positive reinforcement.  But is that all that’s going on there?

If you want a puppy to put his paw on a target, most people would start with the target.  Kay doesn’t. Instead she sets the puppy up to offer a consistent motor pattern.  She gets the puppy moving his paw, and then she puts the target in the path of where the paw is going to land.  Simple and elegant.

She begins by having the puppy lie down.  This is the base position she uses to teach the behavior.  Lying down limits the behavior which the puppy can offer.  Instead of offering responses from the entire range of things a puppy can do with his body, now he’s restricted to those things he can do while lying down.  This makes it much easier to get only the desired behavior and to get it without a lot of unwanted add-ons.

Kay jump-starts the process by placing a treat off to the side away from the direction she is eventually going to want the puppy to move his paw.  He has to shift his balance and move his paw to the side in order to reach the treat.

He’s left out of balance.  If he were to stay in this position, he’d quickly become uncomfortable, so he rights himself.  He moves back to center.  Kay clicks as he moves his paw back towards a more balanced position, but she doesn’t feed him there.

Instead she again feeds him so he has to move his paw to reach for the treat. He gets his treat and returns to center.  Click!

Why does the puppy not just stay out there in this position where all the treats are delivered?  Why does he right himself?

Over time the answer becomes because he is being positively reinforced for moving back to center.  The function of the click is to identify for the puppy the right-answer behavior that leads to a treat being given.  But initially he rights himself because he’s out of balance and that feels odd. So even here there is a negative reinforcement component in what appears on the surface to be the most elegant of positive reinforcement training.

Trying to decide what to call a particular procedure can make your head spin.  If you are trying to stay on the positive side of training, of course, you want to avoid the harsh use of aversives, but, as we’ve just seen, not all discomfort creates a negative emotional reaction.  Rather than fight against the terminology, I prefer to use it.  I think it is useful to understand that that slight feeling of muscle fatigue will cause you to take a step back.  I don’t have to push you back or do anything else to get the behavior.  I can simply wait and let you figure out the puzzle.  The same thing holds true for my horse.

My horse’s emotional reaction will tell me if I am on the side of the angels or sliding fast down the slippery slope that appears when soft words don’t match hard actions. I use the terms to remember the history of the harsh methods modern horse training has evolved out of.  At some point we may be able to let go of that trail, but for now I think it is wiser to keep remembering.

Coming Next: Part 5: The Fluid Nature of Langauge

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

Procedure versus The Emotional Effect

JOY Full Horses: Ten Things You Should Know About Cues: Number 10: Playing with Chains – Part 3 of 5

Procedure versus The Emotional Effect
Yesterday’s post began a discussion of negative reinforcement.  Especially when you have a horse who is new to clicker training it is important to separate procedure from emotional effect.  I can perform what appears to be the same procedure with two individuals and end up with completely different emotional outcomes.

That’s true whether I am using what appears on the surface to be a positive reinforcement or a negative reinforcement procedure.  Think of all the people who run in the opposite direction if you suggest playing a training game.  I view these experiences as fun opportunities to improve my skills.  Others see them as a torturous experiences, even when you are passing out reinforcers they want. Their childhood experiences have set them up to see training games as anything but fun.  Same procedure – different emotional response – different behavioral outcome.  So for one person the training game is a positive experience.  It will get them in the room, engaged in the process.  For another it has the opposite effect.  It will get them looking for the nearest exit!

If I’m working with a horse that has been handled well all of it’s life, sliding down the lead will convert easily into a cue, and there may never really be any aversive elements in the process. That’s especially true if I have set up the use of the lead through the first couple of foundation lessons.  If I begin with basic targeting and use my food delivery to move a horse back a step or two to get his treat, he will quickly respond to my body language.  When I turn into him, he’ll easily back up.  Now I can add in the activation of the lead as I turn towards him, and he’ll back up just as readily.

robin-touch-target-back-up-with-caption

I’m really using more of a transferred cue process than negative reinforcement.

History Matters
An individual who has been hurt by leads will be deeply suspicious of them, even if I have gone through the same foundation lessons that prepared that first horse so well.  I can be super soft, but any interaction with a lead will be regarded with suspicion.  Same action, different emotions.

For the first horse the pressure acts as a cue from the very beginning. But what about the second?  When I slide down the rope, that horse is going to read it as a threat. That’s his history. If he guesses wrong, he’s expecting to be hurt.  If he comes crashing into my space with a lot of energy attempting to escape the inevitable, the wall I create with the lead is going to have to be pretty solid.  I’m ricocheting his own energy.  I’m not adding any pressure beyond that, but his previous experience will control how he feels about what I’m doing.

The Emotional Spectrum
When I slide up the lead to richochet this horse’s energy out of my space, I am operating in a zone that sits between true, easy-to-define negative reinforcement and positively taught tactile cues.  With some of the horses that I work with, it is very clear to me that I am starting out with negative reinforcement.  No question.  Slide down the rope and you meet with the guarded response of a horse who knows the pressure will escalate if he guesses wrong.  My job is to show him that that’s not going to happen.  No matter what he does, I am not going to retaliate.  His history may be creating some major flare ups of aggression, but I am not going to be drawn into a counter attack.

It’s Not Your Fault
At times like these I remember a line from Ismael Beahl’s autobiography “A Long Way Gone”.  Beahl was a child soldier in Sierra Leone’s civil war.  He and the other boys he fought with were given drugs that contributed to the horrific acts of cruelty which they committed.  He describes his actions with great honesty in his book.

When he was pulled out of the army and sent to a hospital for rehabilitation, he lashed out at the people who were trying to help him.  He had done such terrible things.  How could he live with himself?  He wanted to hurt everyone who came near him.

“It’s not your fault,” his caregivers would say, refusing to be drawn into the drama of his conflict.  Again and again they would repeat this:

“It’s not your fault.  It’s not your fault.”

At first this enraged him even more, but gradually he could hear the words and accept their meaning.

Changing Expectations
When horses are flaring up with aggression, I say the same thing to them: “It’s not your fault.”  I’ve seen how horses are handled.  In far too many places harsh handling is the norm.  It’s how we’re taught you have to be around horses.  It’s not the handler’s fault either.  It is our heritage, but it doesn’t have to be our future.  We can pass on a different legacy to the next generation of horse owners.

When I’m using a lead, my task is to direct the horse away from this expectation of retaliation.  Eventually, he will truly believe that the lead will always and only be a positive communication tool. That’s when he’ll let you in past his guard, and the relationship becomes magical.

The response to the lead shows us it’s hidden history. I cannot make a blanket statement that the slide down the lead is experienced as something pleasant and acceptable, something neutral, or something aversive.  The horse’s history creates an expectation that effects his initial emotional reaction to the rope.  In some cases the emotional reaction is one I hope to change.  By changing the way I use the lead, the lead itself may no longer trigger an unwanted emotional response.

scout-on-lead-two-photos

Coming Next: Part 4: Hidden Motivators

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

JOY FULL Horses: Unit 10 – Part 2 of 5: What We Say

JOYFULL Horses: Ten Things You Should Know About Cues: Number 10: Playing With Chains – Cues Evolve into Chains

What We Say
It’s ten p.m., an hour at which I should be heading off to bed, but I can’t leave yet.  I’m sitting in the faculty lounge at the Clicker Expo.  We’ve just come from dinner and a presentation by this year’s guest speaker.  After a full day of presentations you would think we would all be ready to call it a night, but instead we’re just getting warmed up.

Around the table with me are Dr. Susan Friedman, Ken Ramirez,  Eva Bertilsson, Kay Laurence, Dr. Jesús Rosales-Ruiz, and Laura Monico Torelli.

We are discussing terminology.  Eva got the ball rolling with a question about chains. We are wrestling with the different definitions of chains that are in use.

chain-2

Dr. Friedman is defining a chain from the perspective of a behavior analyst.  A chain has a very narrow and very specific meaning.  For a true chain, you give one cue that starts the process.  The next behavior is triggered by an internal cue.  It’s like dominoes.  You push over the first block and all the rest follow.

This type of chain can be very elegant to watch.  Imagine a series of agility obstacles set out in your arena.  You give your horse a cue that sends him out to the first obstacle, a small jump.  Just beyond the jump is a cone.  Your horse spots the cone as he clears the jump.  The cone itself serves as the cue for him to trot over to it, and pick it up.  Nearby is a large bucket.  He walks over to the bucket, drops the cone into the bucket.  A few feet past the bucket is a large platform.  Your horse now walks over to the platform, steps up onto it with all four feet, and lifts one foot high into the air while you click and run over with his treat.

That’s a technical chain.

Now imagine a different scenario.  You send your horse out over the first jump.  Just beyond the jump are two cones, a green one and a red one.  As your horse jumps, you shout “green”.  You’ve added a cue to tell your horse which cone he’s to pick up.  He heads straight over to the green cone, but now there are more choices.  Instead of one bucket, there are two identical ones, except one has a symbol of a circle painted on it, and the other a triangle.  As he picks up the green cone, you shout “circle”.  He walks over to the correct bucket and drops the cone in.

After this he again has more choices.  There are two platforms, one to the right and one to the left of the buckets.

You shout “Left”, and he walks over to the platform that’s off his left shoulder and steps up on it.

If you are using scientific terminology, this very sophisticated series of behaviors is not a chain because you are cueing each one.  It would be considered a sequence.

Our discussion rolled on around these two terms.  We all understood the distinctions.  The question was how fluid and flexible should we be with the language we use.

The Meaning of Words
In the field of learning theory scientists took for their own use many terms which already had a common-usage meaning.  Punishment is a great example.  When someone says we need to punish a child, a criminal, a terrorist, another country, the meaning is clear.  There is a moral element to it.  You don’t simply want to stop the behavior.  You want to impose a penalty.  You want the person to suffer in some way, to “pay” for his offense.  You are punishing the individual, not the behavior.

When a behavioral analyst uses the term, the meaning is very different.  There are no moral overtones of retribution.  If you smack a horse for biting, and the behavior decreases, you can say that the smack punished the biting behavior.  If the biting continues, the smack did not punish the behavior.  It may have annoyed or even frightened the horse, but if the behavior of biting didn’t decrease, the smack wasn’t a punisher.

When scientists take words that are already in common usage and redefine them, we can get a muddled result.  We also have confusion when scientists use words that we’re sort of familiar with, but not really.

A great example is operant conditioning.

That’s the big umbrella under which clicker training sits.  Operant sounds like operator.  And conditioning we understand from fitness programs.  But what do those two words put together really mean?

Look at what else happens when scientists start combining words we thought we understood.

Consider the four quadrants of operant conditioning: there’s positive and negative reinforcement, positive and negative punishment.

Positive punishment!?  Really.

Okay, the scientists explain.  The positive means simply that something has been added.  You’re adding something the horse doesn’t want and that stops the behavior, at least for the moment.  You add the smack of your hand when your horse bites you.

That’s clear enough, except it’s hard not to feel the harsh “take that” edge when you even just think about smacking your horse.  We can say we understand the plus and minus of the terms, but we still experience emotions we’ve come to associate with the words: positive equals good, negative equals bad.  Of course people get confused by these terms!  They understand them intellectually, but they experience them emotionally.  The only term that matches up and creates no conflict in meaning is “positive reinforcement”.  The rest get us into a real “knickers in a twist” state of confusion.

Negative Reinforcement
I was listening to the conversation, but I was also keeping an eye on my watch.  Eleven o’clock.  I had presentations to give the following day.  I should be calling it a night.  I decided to stay just a few more minutes.

Eva was asking more questions.  Now we were talking about negative reinforcement, a subject that always gets my attention given it’s connection to horse training.

When horses are handled with conventional training methods, rope handling is a very clear example of negative reinforcement.  The horse can avoid/escape the threat of escalating pressure by moving in the direction the handler wants.  As the horse learns to obey, the pressure diminishes to a subtle command.  The work looks soft, but the threat of escalation remains.  The soft command tells the horse how to avoid the escalating pressure.

Often people watch the finished result and think the trainer is very soft and kind.  This is very much a case of don’t judge a book by it’s cover.  The handler can look gentle because the horse understands the threat of escalating pressure that’s hidden inside every soft request.

That’s very straight forward.  If the handler is skilled, many horses thrive in this kind of system.  They know what they need to do to stay out of trouble. There’s no guess work. The commands are clear, the consequences are swiftly applied. Respond well, the pressure goes away. Fail to respond, and it escalates.  If you can figure out what is wanted – and if you can physically do it – you can stay out of trouble.

It’s easy to understand this kind of handling.  It’s textbook negative reinforcement.  And it’s also standard-issue horse training.

So what do we call it when the pressure doesn’t increase? When there is no threat of escalation, what is it?

I’ve always kept the use of the term negative reinforcement when I write about clicker-compatible rope handling.  I do this in part because I want to remember our history.  I want to remember where so many of the techniques that we use evolved from.  I want to remember so I won’t ever be tempted to go back there.

I have always combined pressure and release of pressure with the clicker.  You could say that I am simply piggy backing the clicker onto existing training systems, and that’s not really clicker training.

Perhaps, but it is a bridge.  If I am working with a rider who has spent years perfecting her horse-handling skills, I don’t want to say: “Throw all that away.  You won’t be using leads, or reins, or anything else you’re familiar with.”  That’s a great way to lose someone before they’re even out of the starting gate.

But if I say the communication system you know still works, we’re just going to teach it very differently, that makes more sense.  There’s still a huge learning curve, but I’m not going to begin by “throwing the baby out with the bath water.”

By the way do you know the derivation of that expression?  Before the modern era of indoor plumbing, baths were a rarity.  You brought water in and heated it for one bath.  The patriarch of the household took his bath first, followed in rank by everyone else.  The children would be the last ones to bathe.  By the time it was the turn of the youngest babies, the water would be murky brown.  You literally had to be careful not to throw the baby out with the bath water!

This derivation comes courtesy of the historian, Lucy Worsley and her wonderful book, “If Walls Could Talk, An Intimate History of the Home”.

Just as we still take baths – but my how they’ve changed – we still use lead ropes and other pressure cues in clicker training. But again – how things change when you take the threat away and make them clicker compatible!

Coming Next: Procedure versus The Emotional Effect

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

The Clicker Super Glue

JOY FULL Horses: Ten Things You Should Know About Cues: Number 9.) You Can’t Not Cue: Part 6 of 12

What Keeps People Interested in Clicker Training?
I ended yesterday’s post with the question: what is the “glue” that gets somebody to stick to clicker training?  What makes someone take more than that first look?  What creates the shift from being simply curious about clicker training, to giving it a try, to becoming an active user, and eventually a clicker trainer?  I think there are four main elements that go into the creation of clicker super glue.

Science
The first component of clicker super glue is a love of science.  I’ve already talked about this, but let me expand on it here.  When I talk about a love of science I don’t mean someone who has read the chapter on learning theory in the psychology text book and memorized the four quadrants.  Lots of people can give you the definitions of negative and positive punishment.  That’s simply someone who has done a bit of reading.

A love of science is something more.  It’s that curiosity that has you always asking the “why” questions.  It’s wanting to know how things work.  It’s never being satisfied with the “because that’s the way it’s done” answers.

Someone who is passionate about science is also passionate about history.  You want to know what others before you have said in answer to those “why” questions.  Where did our current ideas come from?  Why do we use marker signals?  Why do we call them bridging signals? Where did that term come from?  What was meant by it, and is it still applicable?

“Just because” isn’t good enough.  How do we test our ideas?   How do we peel back the layers of confusion our words often create and look at what is really going on when we say antecedents set the occasion for behaviors which are controlled by consequences?   Do you nod your head and passively write that down in your notes?  Or do you want to dig down into those words to find out what those relationships really mean for your animals?

People who are passionate about science understand that what is understood today is not fixed in stone.  As we learn more, our understandings change.  In the sciences, as you test ideas and develop techniques that allow for more fine-tuned levels of exploration, ideas shift.  Science is the perfect companion to training.

science is the perfect companionIn both you will hear people saying: I used to follow this line of thought, but then the data showed me that this other was a better explanation/approach.  It offered a more functional interpretation or way of handling the behavior I was seeing.

Nothing becomes entrenched because we are always asking those why questions.

Science alone is not enough.  Think of it like the super glues that come in two separate tubes.  Each tube by itself won’t hold anything together, but combine them, and you have a super glue that will last for years.  By itself science creates an interest in training, but it doesn’t guarantee that someone will turn into what I mean by a clicker trainer.

Relationship
One of the other super glue “tubes” is relationship.  When I first went out to the barn with a clicker in my hand and treats in my pocket, I was curious.  The scientist in me wanted to explore what sounded like an intriguing approach to training.  There weren’t any other equine clicker trainers around to act as role models.  I didn’t go out to the barn because I had been watching youtube videos showing me the amazing relationships people were developing with their horses.  It was the science behind the training that made me take the first look.  I kept going because that early exploration into clicker training so enriched the relationship I had with Peregrine.

I started sharing my early forays into clicker training with my clients.  I remember asking one of them what she thought about clicker training.  She said out of all the things I had shown her, it was her favorite.  When I asked why, she said it was because of the relationship it created with her horse.

Repertoire
Two tubes aren’t enough to create clicker super glue.  There is another element that I think is critical and that’s repertoire.

I’ve known many people who were excited to try clicker training.  They introduced their horses to the target, and then they got stuck.  What do you do with it?  That was the question.

When I started with the clicker, Peregrine already knew a lot, but there were glitches and speed bumps throughout his training.  Always the physical issues he had with his stifles got in the way.  As a youngster, he was plagued by locking stifles.  The stifle joint is equivalent to our knee.  When Peregrine wanted to take a step forward, the tendons that ran over his knee cap wouldn’t always release.  He’d try to move, and one or both of his hind legs just wouldn’t bend.  He’s be stuck in place until they let go.  On the ground backing usually unlocked his joints.  Under saddle the solution he was more likely to find was a hard buck forward.

So you could say he was both very well trained, and at the same time very much a problem horse.  On a good day he was a dream to ride, but when his stifles were locking up, he was a nightmare.  His stifles had forced me to learn so much more about training, especially about ground work, just to be able to manage him safely on those bad days.  On the good days, that same training produced some simply beautiful work.

Twenty plus years ago when Peregrine and I were first exploring clicker training, ground work for most people meant lunging.  That was all they knew.  You lunged your horse to get the “bucks out” so your horse was safe to ride.

Lunging was often crudely done.  The horse ran around you on a circle, often out of balance, often pulling on your lunge line.  It wasn’t fun for either of you, so if someone said: “we’re going to use the clicker to do ground work”, of course people ran for the hills!  What was fun about ground work?

I’ve raised all my horses.  Peregrine was a horse I bred.  I raised his mother, and Robin came to me as a yearling, so ground work to me has always meant so much more than lunging.  Ground work is the teaching of connection.  Ground work means showing your horse how to get along with people.  It includes basic manners and leading skills, but it’s so much more than that.  For a young horse ground work includes long walks out to learn about the world.  It includes walking through mud puddles and over wooden bridges, meeting the cows that live in the next field over, encountering joggers and bicycle riders.  It means liberty training and in-hand work.  It means learning about your body and gaining control over your balance so you can go up and down hills safely and one day carry a rider in comfort.

All this meant that after Peregrine was routinely touching a target, I wasn’t stuck.  I had a rich and varied repertoire to work with.  I began by reshaping everything I had ever taught him with the clicker.  In so many places I could almost hear him say: “Oh THAT’S what you wanted!  Why didn’t you say so before?”

Everything I had already taught him – the clicker made better. I began by using it as a piggy back tool, meaning I simply added it in to familiar lessons.  I would ask Peregrine to rotate up into shoulder-in much as I had always asked him, and I would click and treat as he complied.  It made him more willing, so it took less explaining on my part to get the desired response.

Reworking our existing repertoire got us a solid foot in the clicker door.  It gave us lots to explore to get us started.  When I’m introducing people to clicker training, I want to help them see all the many possibilities that exist in ground work.  If you equate clicker training just with targeting, you may well get stuck.  Your horse is touching a target.  That was fun, but now what?

The “now what” is finding creative ways to use that targeting behavior.  And it’s recognizing that there are many other shaping methods you can use.

It’s remembering that at one point your horse didn’t know how to pick up his feet for cleaning or to stand quietly while you put on his halter.  Can you use the clicker to make those things better?  Of course you can!  While you are learning how clicker training works, you can turn the ordinary into the extraordinary.

I like beginning with the “universals”, things we all do with our horses regardless of the type of riding we do.  We all need to clean our horse’s feet, groom them, halter them, and, if we ride, bridle and saddle them.  Below is a fun video from Monty Gwynne showing how a clicker-trained horse takes a bridle.  It’s a great example of turning the ordinary – something we all do on a regular basis – into something with real clicker flare.

Persistence
Science, relationship, repertoire are all important.  There’s one more component to our super glue and that’s persistence.

Training is not easy.  It is not straight forward.  It is certainly not a linear path where one success builds on another, and you never have another frustrating day ever again with your horse.

Training is about running up against a reaction you don’t understand and going off to have a proverbial cup of tea while you figure out a different way to approach the problem.  You have to have persistence to weather these little storms of confusion.  You have to have persistence to learn the handling skills that can make the difference between smooth-sailing success and a stormy ride.

You can understand the science inside and out, but your horse may still be turning his back and walking off the minute he sees you coming.  Persistence keeps you in the game, scratching your head trying to figure out what to do next. What do you change?  What do you add?

Persistence is what gets you to clinics and fills your bookshelves with training book after training book.  It is what gets you to tie a lead rope to your fence rail so you can practice, practice, practice your rope handling skills before you ever go near your horse.  And it is what takes you back out to the barn to see what your horse thinks of all the homework you’re doing on his behalf.

Put these four things together and you will have someone who shifts from simply giving clicker training a quick look to someone who is actively using clicker training on a routine basis.  But that still doesn’t mean someone is a clicker trainer.

Coming Next: Using Clicker Training Versus Being A Clicker Trainer

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

What Is Clicker Training?

JOY FULL Horses: Ten Things You Should Know About Cues: Number 9.) You Can’t Not Cue: Part 3 of 12

Labels
In the previous section I introduced you to Poco, an extremely ear-shy horse.  I ended that section by saying: “Poco wasn’t going to be helped by following old recipes, but by coming up with solutions that were tailored to his needs.  To do that we had to look more broadly at all that clicker training means.”

I put my first JOYFULL horses post up on January 2, 2016.  This far into the book may seem like an odd time to be asking such a basic question: what is clicker training?  But this question refers to so much more than just the surface definition of clicker training.

The term clicker training was coined by Karen Pryor.  In it’s simplest form it refers to applied operant condition in which a marker signal is paired with positive reinforcement.  In other words, if you like what your animal is doing, you click and reinforce him.

For years at clinics I’ve had people say to me you really need to call your work something other than clicker training.  What you do is so much more than clicker training.

I always throw this right back to them.  What would you call it?

I get lots of suggestions but nothing so far has stuck.  So many of the words that describe my work have been used, abused, and over-used.  Or they are too specific to a narrow area of horse training.

Harmony, balance, partnership have all been used so many times by so many different approaches to training they have lost any meaning.  You can have two diametrically opposed training systems both talking about partnership.  They’ll end up with very different looking horses and each group will be convinced they have “true partnership” and the others don’t.  Sigh.  Labels can leave behind a huge and very controversial mine field to navigate.

When I first came across clicker training, it had no associations attached to it.  It was just a label, a way of referencing a particular approach to training.  I had not seen other clicker-trained horses because there weren’t any around.  I hadn’t yet experimented with it, so I brought no strong biases to the term – good or bad.  It was simply a label, a convenient way to reference a system of training in which a marker signal was paired with positive reinforcement.

For me the term “clicker training” is still a convenient way to refer to a system of training that uses a marker signal, but it has grown to have many more associations for me and for others.  If someone has seen clicker training applied badly, just the mention of the name may send them over the edge into a long diatribe against it.

I’ve seen plenty of clumsy, not well-thought-out clicker training sessions over the years, but that doesn’t make me want to run from the label.  It makes me want to find better ways to teach the work.

What Clicker Training Means To Me
I’ve experienced so much joy both in my own horses and in sharing the work with others that I don’t want to walk away from the label.  Instead I want to make it clearer what clicker training can be.  I don’t know what clicker training has come to mean to others, but to me, when I think of clicker-trained horses, I see happy, well mannered, beautifully balanced horses who are a joy to be around.
icky-what-is-clicker-training-3
My clicker-trained horses make me smile.  I hope how I handle them gives my horses the equine equivalent of those happy feelings.  That’s what I want to share with others.

In 1993 when I started experimenting with clicker training, I didn’t head out to the barn thinking – “I’m going to write a book about this.”  I just wanted to find a way to keep Peregrine entertained while he was on stall rest.

There weren’t other people clicker training horses who I could turn to as role models or who could provide how-to instructions.  That meant I got to invent my own version of clicker training.

Defining Clicker Training
If you were to ask me to define clicker training, I would begin with Karen Pryor’s definition: clicker training is applied operant conditioning in which a marker signal is paired with positive reinforcement.

That gives us an operational definition, but clicker training is so much more than that.  I see it as a huge umbrella under which I can fit many different approaches to horse training.  For example, I studied for a time with Linda Tellington-Jones, the founder of TTEAM, so I fit her training under the umbrella.  I also put the work I learned from John Lyons under this same umbrella even though Lyons himself is not a clicker trainer.  These two training methods represent fundamentally different philosophies of horse training, but I was able to draw good things from both and adapt what I learned to fit under my clicker umbrella.

When I think of clicker training, I see a complete and very structured approach to training that results in well-mannered, happy horses.  I think of beautifully-balanced horses who are both having fun and are fun to be around.

Lucky with caption

That’s what I see.  But if all you’ve seen of clicker training is someone using it to teach simple tricks, you may see the fun – but not the balance.  Or maybe you’ve just seen someone who was fumbling around the edges of clicker training.  Your picture of clicker training may be a frustrated horse who is acting aggressively towards the handler.

Creating Stepping Stones
The more people who encounter clicker training the more different images of what it is there will be.  Clicker training will evolve and morph into something else.  That’s the nature of all creative work.  It is never static.  Clicker training, which seemed so revolutionary, so very much on the leading edge of training when I first encountered it, will become mainstream.  It will be the stepping stone to the next leading-edge idea.

We can’t yet know what that idea will be, not until it has had time to evolve.

This is the nature of the creative process.  Humans thrive on creativity.  This is part of play.  You are exploring two separate ideas and suddenly you see how you can put them together to create a completely original combination.  Both ideas by themselves were great.  Combined they are transforming.

So let’s look underneath the clicker training umbrella and see what’s really there.  Let’s also ask the question: are you a clicker trainer, or are you someone who just uses a clicker?  And what is the difference that that question is seeking to answer?

(And yes, I will get back to Poco and his ear-shy problem.)

Coming next: Are You A Clicker Trainer or a User of Clicker Training?

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com