Hidden Motivators

JOY Full Horses: Ten Things You Should Know About Cues: Number 10: Playing with Chains – Part 4 of 5

Hidden Motivators
Yesterday’s discussion of negative reinforcement considered the impact that each individual’s learning history has on the emotional response to a particular procedure.  Something you regard as fun might make someone else run for the hills.  When we’re choosing which teaching strategy we’re going to use with our horses or dogs, their past experience matters.

We often think of negative reinforcement in terms of the overt actions someone is taking.  We can see the slack being taken out of a lead and understand that pressure is being applied.  The release of that pressure is intended to reinforce a desired response.  But there’s another form of pressure that’s not as easy to see that plays an important role in horse training.  I’ll use an example you can experience yourself.  Suppose I’m working with you showing you some of the rope handling techniques that I teach.

I’ll begin by having you stand in balance over your feet. I’ll slide down the lead very softly.  You’re relaxed, and I want you to stay that way.  If I slide down with a lot of “make it happen” muscle, I’d be picking a fight, and you’ll stiffen into resistance.

I want you to stay soft and relaxed, so I take care how I come down the rope.  I slide into a neutral position that doesn’t effect your balance.  This is the “get ready” stage of my cue.

Now I shift my own balance.  I let my overall balance shift forward onto my toes.  This subtle shift rocks you back on your heels.  The shift is so subtle, you may at first not even notice.  I wait.  I’ve taken the slack out of the lead, but I am not pushing on you in any way.  I have simply set up a shift in your balance.

After a bit, you’ll begin to feel uncomfortable.  You can’t maintain this slightly-out-of-balance position forever. You’re having to use muscle to sustain your position, and it’s creating uneven pressure on your joints. So you take a step back.  My hand releases, click and treat.

sue-3-photos-tai-chi-wall-2

At clinics people get to feel how subtle this is.  All I have to do is rock my balance slightly forward and the other person will shift back into her heels.  She won’t feel threatened by the action. In fact she often isn’t even aware that I have created this shift in her balance.  Her focus has been on my hands, not the subtle shift in her own balance.

It’s like a magician’s trick.  You’re so busy watching where the magician is directing your attention, that you don’t notice when he slips your watch off your wrist.  It isn’t the pressure from my hand on the lead that creates the change or causes that slight discomfort.  The lead gives me the framework through which to create the shift.  It’s the mild discomfort that the balance shift creates that triggers the step back.

This shift out of what feels normal to you draws your attention inside.  I want you to become aware of your balance, to learn to pay attention to these subtle shifts and to make adjustments that bring you closer to an optimal state of comfort.  I want to help you shift from what feels normal but may actually be a state of imbalance to what feels good because you are now in functional balance. That’s also what I want for the horses.  Body aware horses stay sounder longer.  And body aware horses not only look very beautiful, they are more athletic than their out-of-balance counterparts.

harrison-3-photos-before-after

This set of three photos show Natalie Zielinski and her horse Harrison.  In the top left photo he’s standing all higgeldy-piggledy.  Whenever he stopped, he was always out of balance.  He tended to fall over his left shoulder, so when she led him, he was always crowding into her.  The beautiful trot you see in the other two photos evolved out of work that helped him become much more body aware.

What Triggers Change?
Here’s another example of hidden negative reinforcement.  This one is a dog example.  I’ve watched Kay Laurence teach a puppy to put his paw on a target.  It looks like a wonderfully elegant example of shaping with positive reinforcement.  But is that all that’s going on there?

If you want a puppy to put his paw on a target, most people would start with the target.  Kay doesn’t. Instead she sets the puppy up to offer a consistent motor pattern.  She gets the puppy moving his paw, and then she puts the target in the path of where the paw is going to land.  Simple and elegant.

She begins by having the puppy lie down.  This is the base position she uses to teach the behavior.  Lying down limits the behavior which the puppy can offer.  Instead of offering responses from the entire range of things a puppy can do with his body, now he’s restricted to those things he can do while lying down.  This makes it much easier to get only the desired behavior and to get it without a lot of unwanted add-ons.

Kay jump-starts the process by placing a treat off to the side away from the direction she is eventually going to want the puppy to move his paw.  He has to shift his balance and move his paw to the side in order to reach the treat.

He’s left out of balance.  If he were to stay in this position, he’d quickly become uncomfortable, so he rights himself.  He moves back to center.  Kay clicks as he moves his paw back towards a more balanced position, but she doesn’t feed him there.

Instead she again feeds him so he has to move his paw to reach for the treat. He gets his treat and returns to center.  Click!

Why does the puppy not just stay out there in this position where all the treats are delivered?  Why does he right himself?

Over time the answer becomes because he is being positively reinforced for moving back to center.  The function of the click is to identify for the puppy the right-answer behavior that leads to a treat being given.  But initially he rights himself because he’s out of balance and that feels odd. So even here there is a negative reinforcement component in what appears on the surface to be the most elegant of positive reinforcement training.

Trying to decide what to call a particular procedure can make your head spin.  If you are trying to stay on the positive side of training, of course, you want to avoid the harsh use of aversives, but, as we’ve just seen, not all discomfort creates a negative emotional reaction.  Rather than fight against the terminology, I prefer to use it.  I think it is useful to understand that that slight feeling of muscle fatigue will cause you to take a step back.  I don’t have to push you back or do anything else to get the behavior.  I can simply wait and let you figure out the puzzle.  The same thing holds true for my horse.

My horse’s emotional reaction will tell me if I am on the side of the angels or sliding fast down the slippery slope that appears when soft words don’t match hard actions. I use the terms to remember the history of the harsh methods modern horse training has evolved out of.  At some point we may be able to let go of that trail, but for now I think it is wiser to keep remembering.

Coming Next: Part 5: The Fluid Nature of Langauge

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

Procedure versus The Emotional Effect

JOY Full Horses: Ten Things You Should Know About Cues: Number 10: Playing with Chains – Part 3 of 5

Procedure versus The Emotional Effect
Yesterday’s post began a discussion of negative reinforcement.  Especially when you have a horse who is new to clicker training it is important to separate procedure from emotional effect.  I can perform what appears to be the same procedure with two individuals and end up with completely different emotional outcomes.

That’s true whether I am using what appears on the surface to be a positive reinforcement or a negative reinforcement procedure.  Think of all the people who run in the opposite direction if you suggest playing a training game.  I view these experiences as fun opportunities to improve my skills.  Others see them as a torturous experiences, even when you are passing out reinforcers they want. Their childhood experiences have set them up to see training games as anything but fun.  Same procedure – different emotional response – different behavioral outcome.  So for one person the training game is a positive experience.  It will get them in the room, engaged in the process.  For another it has the opposite effect.  It will get them looking for the nearest exit!

If I’m working with a horse that has been handled well all of it’s life, sliding down the lead will convert easily into a cue, and there may never really be any aversive elements in the process. That’s especially true if I have set up the use of the lead through the first couple of foundation lessons.  If I begin with basic targeting and use my food delivery to move a horse back a step or two to get his treat, he will quickly respond to my body language.  When I turn into him, he’ll easily back up.  Now I can add in the activation of the lead as I turn towards him, and he’ll back up just as readily.

robin-touch-target-back-up-with-caption

I’m really using more of a transferred cue process than negative reinforcement.

History Matters
An individual who has been hurt by leads will be deeply suspicious of them, even if I have gone through the same foundation lessons that prepared that first horse so well.  I can be super soft, but any interaction with a lead will be regarded with suspicion.  Same action, different emotions.

For the first horse the pressure acts as a cue from the very beginning. But what about the second?  When I slide down the rope, that horse is going to read it as a threat. That’s his history. If he guesses wrong, he’s expecting to be hurt.  If he comes crashing into my space with a lot of energy attempting to escape the inevitable, the wall I create with the lead is going to have to be pretty solid.  I’m ricocheting his own energy.  I’m not adding any pressure beyond that, but his previous experience will control how he feels about what I’m doing.

The Emotional Spectrum
When I slide up the lead to richochet this horse’s energy out of my space, I am operating in a zone that sits between true, easy-to-define negative reinforcement and positively taught tactile cues.  With some of the horses that I work with, it is very clear to me that I am starting out with negative reinforcement.  No question.  Slide down the rope and you meet with the guarded response of a horse who knows the pressure will escalate if he guesses wrong.  My job is to show him that that’s not going to happen.  No matter what he does, I am not going to retaliate.  His history may be creating some major flare ups of aggression, but I am not going to be drawn into a counter attack.

It’s Not Your Fault
At times like these I remember a line from Ismael Beahl’s autobiography “A Long Way Gone”.  Beahl was a child soldier in Sierra Leone’s civil war.  He and the other boys he fought with were given drugs that contributed to the horrific acts of cruelty which they committed.  He describes his actions with great honesty in his book.

When he was pulled out of the army and sent to a hospital for rehabilitation, he lashed out at the people who were trying to help him.  He had done such terrible things.  How could he live with himself?  He wanted to hurt everyone who came near him.

“It’s not your fault,” his caregivers would say, refusing to be drawn into the drama of his conflict.  Again and again they would repeat this:

“It’s not your fault.  It’s not your fault.”

At first this enraged him even more, but gradually he could hear the words and accept their meaning.

Changing Expectations
When horses are flaring up with aggression, I say the same thing to them: “It’s not your fault.”  I’ve seen how horses are handled.  In far too many places harsh handling is the norm.  It’s how we’re taught you have to be around horses.  It’s not the handler’s fault either.  It is our heritage, but it doesn’t have to be our future.  We can pass on a different legacy to the next generation of horse owners.

When I’m using a lead, my task is to direct the horse away from this expectation of retaliation.  Eventually, he will truly believe that the lead will always and only be a positive communication tool. That’s when he’ll let you in past his guard, and the relationship becomes magical.

The response to the lead shows us it’s hidden history. I cannot make a blanket statement that the slide down the lead is experienced as something pleasant and acceptable, something neutral, or something aversive.  The horse’s history creates an expectation that effects his initial emotional reaction to the rope.  In some cases the emotional reaction is one I hope to change.  By changing the way I use the lead, the lead itself may no longer trigger an unwanted emotional response.

scout-on-lead-two-photos

Coming Next: Part 4: Hidden Motivators

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

JOY FULL Horses: Unit 10 – Part 2 of 5: What We Say

JOYFULL Horses: Ten Things You Should Know About Cues: Number 10: Playing With Chains – Cues Evolve into Chains

What We Say
It’s ten p.m., an hour at which I should be heading off to bed, but I can’t leave yet.  I’m sitting in the faculty lounge at the Clicker Expo.  We’ve just come from dinner and a presentation by this year’s guest speaker.  After a full day of presentations you would think we would all be ready to call it a night, but instead we’re just getting warmed up.

Around the table with me are Dr. Susan Friedman, Ken Ramirez,  Eva Bertilsson, Kay Laurence, Dr. Jesús Rosales-Ruiz, and Laura Monico Torelli.

We are discussing terminology.  Eva got the ball rolling with a question about chains. We are wrestling with the different definitions of chains that are in use.

chain-2

Dr. Friedman is defining a chain from the perspective of a behavior analyst.  A chain has a very narrow and very specific meaning.  For a true chain, you give one cue that starts the process.  The next behavior is triggered by an internal cue.  It’s like dominoes.  You push over the first block and all the rest follow.

This type of chain can be very elegant to watch.  Imagine a series of agility obstacles set out in your arena.  You give your horse a cue that sends him out to the first obstacle, a small jump.  Just beyond the jump is a cone.  Your horse spots the cone as he clears the jump.  The cone itself serves as the cue for him to trot over to it, and pick it up.  Nearby is a large bucket.  He walks over to the bucket, drops the cone into the bucket.  A few feet past the bucket is a large platform.  Your horse now walks over to the platform, steps up onto it with all four feet, and lifts one foot high into the air while you click and run over with his treat.

That’s a technical chain.

Now imagine a different scenario.  You send your horse out over the first jump.  Just beyond the jump are two cones, a green one and a red one.  As your horse jumps, you shout “green”.  You’ve added a cue to tell your horse which cone he’s to pick up.  He heads straight over to the green cone, but now there are more choices.  Instead of one bucket, there are two identical ones, except one has a symbol of a circle painted on it, and the other a triangle.  As he picks up the green cone, you shout “circle”.  He walks over to the correct bucket and drops the cone in.

After this he again has more choices.  There are two platforms, one to the right and one to the left of the buckets.

You shout “Left”, and he walks over to the platform that’s off his left shoulder and steps up on it.

If you are using scientific terminology, this very sophisticated series of behaviors is not a chain because you are cueing each one.  It would be considered a sequence.

Our discussion rolled on around these two terms.  We all understood the distinctions.  The question was how fluid and flexible should we be with the language we use.

The Meaning of Words
In the field of learning theory scientists took for their own use many terms which already had a common-usage meaning.  Punishment is a great example.  When someone says we need to punish a child, a criminal, a terrorist, another country, the meaning is clear.  There is a moral element to it.  You don’t simply want to stop the behavior.  You want to impose a penalty.  You want the person to suffer in some way, to “pay” for his offense.  You are punishing the individual, not the behavior.

When a behavioral analyst uses the term, the meaning is very different.  There are no moral overtones of retribution.  If you smack a horse for biting, and the behavior decreases, you can say that the smack punished the biting behavior.  If the biting continues, the smack did not punish the behavior.  It may have annoyed or even frightened the horse, but if the behavior of biting didn’t decrease, the smack wasn’t a punisher.

When scientists take words that are already in common usage and redefine them, we can get a muddled result.  We also have confusion when scientists use words that we’re sort of familiar with, but not really.

A great example is operant conditioning.

That’s the big umbrella under which clicker training sits.  Operant sounds like operator.  And conditioning we understand from fitness programs.  But what do those two words put together really mean?

Look at what else happens when scientists start combining words we thought we understood.

Consider the four quadrants of operant conditioning: there’s positive and negative reinforcement, positive and negative punishment.

Positive punishment!?  Really.

Okay, the scientists explain.  The positive means simply that something has been added.  You’re adding something the horse doesn’t want and that stops the behavior, at least for the moment.  You add the smack of your hand when your horse bites you.

That’s clear enough, except it’s hard not to feel the harsh “take that” edge when you even just think about smacking your horse.  We can say we understand the plus and minus of the terms, but we still experience emotions we’ve come to associate with the words: positive equals good, negative equals bad.  Of course people get confused by these terms!  They understand them intellectually, but they experience them emotionally.  The only term that matches up and creates no conflict in meaning is “positive reinforcement”.  The rest get us into a real “knickers in a twist” state of confusion.

Negative Reinforcement
I was listening to the conversation, but I was also keeping an eye on my watch.  Eleven o’clock.  I had presentations to give the following day.  I should be calling it a night.  I decided to stay just a few more minutes.

Eva was asking more questions.  Now we were talking about negative reinforcement, a subject that always gets my attention given it’s connection to horse training.

When horses are handled with conventional training methods, rope handling is a very clear example of negative reinforcement.  The horse can avoid/escape the threat of escalating pressure by moving in the direction the handler wants.  As the horse learns to obey, the pressure diminishes to a subtle command.  The work looks soft, but the threat of escalation remains.  The soft command tells the horse how to avoid the escalating pressure.

Often people watch the finished result and think the trainer is very soft and kind.  This is very much a case of don’t judge a book by it’s cover.  The handler can look gentle because the horse understands the threat of escalating pressure that’s hidden inside every soft request.

That’s very straight forward.  If the handler is skilled, many horses thrive in this kind of system.  They know what they need to do to stay out of trouble. There’s no guess work. The commands are clear, the consequences are swiftly applied. Respond well, the pressure goes away. Fail to respond, and it escalates.  If you can figure out what is wanted – and if you can physically do it – you can stay out of trouble.

It’s easy to understand this kind of handling.  It’s textbook negative reinforcement.  And it’s also standard-issue horse training.

So what do we call it when the pressure doesn’t increase? When there is no threat of escalation, what is it?

I’ve always kept the use of the term negative reinforcement when I write about clicker-compatible rope handling.  I do this in part because I want to remember our history.  I want to remember where so many of the techniques that we use evolved from.  I want to remember so I won’t ever be tempted to go back there.

I have always combined pressure and release of pressure with the clicker.  You could say that I am simply piggy backing the clicker onto existing training systems, and that’s not really clicker training.

Perhaps, but it is a bridge.  If I am working with a rider who has spent years perfecting her horse-handling skills, I don’t want to say: “Throw all that away.  You won’t be using leads, or reins, or anything else you’re familiar with.”  That’s a great way to lose someone before they’re even out of the starting gate.

But if I say the communication system you know still works, we’re just going to teach it very differently, that makes more sense.  There’s still a huge learning curve, but I’m not going to begin by “throwing the baby out with the bath water.”

By the way do you know the derivation of that expression?  Before the modern era of indoor plumbing, baths were a rarity.  You brought water in and heated it for one bath.  The patriarch of the household took his bath first, followed in rank by everyone else.  The children would be the last ones to bathe.  By the time it was the turn of the youngest babies, the water would be murky brown.  You literally had to be careful not to throw the baby out with the bath water!

This derivation comes courtesy of the historian, Lucy Worsley and her wonderful book, “If Walls Could Talk, An Intimate History of the Home”.

Just as we still take baths – but my how they’ve changed – we still use lead ropes and other pressure cues in clicker training. But again – how things change when you take the threat away and make them clicker compatible!

Coming Next: Procedure versus The Emotional Effect

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com