Giving The Ball A Push

2018 marks the twentieth anniversary of the publication of “Clicker Training for your Horse”.  I am celebrating by writing thank yous each month to people who helped bring clicker training into the horse world.

Are you trying to guess who it’s going to be this month?  Anyone who has followed my work knows the stories.  You’ve met the horses through my books and DVDs. Who will I single out this time?

I could turn it into a guessing game.  This person has appeared in the game show: “What’s my line?”.  Does that help?  Maybe not.  But if I tell you that the panelists correctly guessed that she was a dolphin trainer, now some of you will know who I’m talking about.  July’s tribute belongs to Karen Pryor.

So many of us were first introduced to clicker training through Karen’s book, “Don’t Shoot the Dog”.  I discovered her book through a friend who bred and trained Irish wolf hounds.  We were having lunch together (with one of her wolf hounds literally looking over my shoulder).  Needless to say, we were talking about training.  I’ve forgotten the exact subject, but I do remember my friend saying, “But of course, you’ve read “Don’t Shoot the Dog”.

Don't Shoot the Dog

She said it in a tone that implied that of course I had.  How could I not?  But in 1993 I had never even heard of “Don’t Shoot the Dog”.  Perhaps if Karen’s publishers had called it “Don’t Shoot the Horse”, the horse world would have been exploring clicker training ahead of the dog world.  We’ll never know.  But in any event, I tracked down a copy of “Don’t Shoot the Dog” and read it with great interest.

Those of you are familiar with Karen’s book know that it is not a training book per se.  Karen was writing about learning theory, a subject which can sound very dry and off-putting.  “Don’t Shoot the Dog” is anything but.  You read it, nodding your head in agreement.  “That’s why that horse, that dog, that person responded in that way.  It all makes so much sense!  How could they do anything else.”

When I read the chapter on punishment, I remember thinking, “The horse world needs to know about this.”  The horse world needs to understand that when you use punishment, there is ALWAYS fallout.  You always get other unintended, unwanted consequences.  Punishment doesn’t work with laser-fine precision.  You may shut down the behavior you’re after, but the effect spreads out and creates negative consequences and a general dampening down of behavior.

Use it often, and you will get what in the horse world is often called a “well behaved” horse, meaning a shut down horse.  Punishment stops behavior.  That’s the definition of punishment (versus reinforcement).  When you use reinforcement (plus or minus), the behavior you’re focusing on increases.

When you use punishment, the behavior decreases.  So you may punish biting.  Strike hard enough, fast enough, the biting may indeed stop – for the moment.  But punishment isn’t a teaching tool.  It doesn’t tell the horse what TO DO to avoid the unwanted consequence.  However, it is reinforcing for the punisher.  That’s what makes it such a slippery slope.  It may not get the results that you’re after, but in the moment, oh it can feel so good.

When skilled positive reinforcement trainers talk about the four quadrants meaning positive and negative reinforcement, and positive and negative punishment, they don’t take the use of punishment completely off the table.  They recognize that under the right conditions punishment – applied well – may be a necessary and correct choice.

In many of her presentations Dr. Susan Friedman talks about the hierarchy of behavior-change procedures.

 

Susan Friedman's hierarchy

You begin with the least intrusive interventions.  You begin by exploring medical reasons for the behavior, then you move to changing the environment, and positive reinforcement procedures.  Only after many steps and pausing always to consider if there might be other alternatives, would you consider the more intrusive methods and sitting last as a possibility would be punishment.  And before people puff themselves up and say – I would never use punishment, remember Dr Friedman spent much of her career working with children with major behavioral problems that included self-injurious behavior.  So what would you do with a child who is trying to gouge her eyes out?  Is punishment of that behavior always off the table?

Punishment is certainly not where you begin, but there may be extreme situations where it is where you end up.  If a fire were fast approaching, and you needed to load a reluctant horse on a trailer NOW or leave him behind, would you resort to punishment?  Until you’re faced with that situation, it’s an open question.

Ken Ramirez, another trainer I greatly admire, doesn’t take punishment off the table either.  However, when he was overseeing the training program at the Shedd Aquarium, the novice trainers were only allowed to use positive reinforcement.  They could reinforce behaviors that they liked, but they had to be non-reactive to behaviors they didn’t like.  Only when they were more skilled could they begin to use more advanced techniques.  In his talks on this subject Ken explains why he puts these limits on his young trainers.  At some point early in their career they will come to him, asking for permission to move up the hierarchy.

“Ken,” they will say, “I could so easily solve this problem we’re having with this animal if only you would let me use this procedure that I’ve read about.”  Ken won’t let them.  He wants them to become very experienced with the basics.  If you let them begin to add in other techniques too soon, they really never learn how to be skilled and creative with the basic tools.  They jump the queue too fast and head for more intrusive techniques.

As they become more skilled, he lets them expand into the rest of the hierarchy.  His senior trainers can use any technique, including punishment, that they deem to be appropriate.  But he knows that these trainers have the experience and the skill to apply punishment well, meaning with good timing and at the right intensity to create the desired effect and minimize the fallout.  He also knows that they are so skilled and experienced that they don’t need to use punishment.  They will find other alternatives.

The odd thing in the horse world is we flip things upside down.  We reach first for punishment.  The horse bites – we strike.  It’s the horse’s fault.  And if he bites again, we’ll hit him harder.  We don’t look first for medical conditions.  Maybe that horse is full of ulcers.  Treat the ulcers and his reason for biting will go away.  We don’t rearrange the environment.  Use protective contact – put a barrier between you and the horse so he can’t bite you, and then use positive reinforcement to teach him alternatives to biting.

Instead we give six year old children riding crops (often pink riding crops with pretty sparkles), and we tell her to hit her pony harder.  We give punishment to the least experienced, most novice riders.  That’s completely upside down.  No wonder what we get back are so many sad stories, so many bad endings for both people and horses.

When I said the horse world needs to understand what Karen was saying about punishment in “Don’t Shoot The Dog”, I’ve always though some genie of the universe heard that.  “Got one! She’ll do.”  I was sent the clicker training bug.  More than that, that genie sat on my shoulder and kept urging me to write about what I was experiencing with my horses.  Lots of people, including Karen Pryor, had used clicker training with their horses before I ever went out to the barn with clicker in hand.  I was by no means the first person who ever used it with a horse.  But they didn’t disappear into their computers to write about it.  That good genie on my shoulder made sure that I did.

“Don’t Shoot the Dog” sparked my interest.  I wanted to know more about clicker training.  I read “Lads Before The Wind”,  Karen’s chronicle of the founding of Sea Life Park and the development of the first dolphin shows.  She shared with us the many training puzzles that had to be solved in order to figure out how to train dolphins.  Old-style circus training wasn’t the answer.  She turned to science and the work that was coming out of B.F. Skinner’s lab.

“Lads Before The Wind” took me a step closer.  I wanted to know more about training with a marker signal.

My friend brought me a copy of a magazine article she thought I’d find interesting.  I have no idea what the article was about.  I’m not even sure that I read it, but down in the left hand corner, in very small print, was a tiny ad for two of Karen Pryor’s early VHS videos.  I sent away for both.

The first one was recorded at a seminar that Karen gave with Gary Wilkes to a group of dog trainers.  Gary was the canine trainer who approached Karen with the question: “Do you think clicker training would work with dogs?”

In a conversation I had years ago with Karen, she said she had always had dogs, but they weren’t really trained, not like she had trained the dolphins.  They were just around.  But when Gary wondered if clicker training would work with them, Karen thought, of course!  Why not!  So she and Gary teamed up to give a series of seminars to dog trainers, and we all know what grew out of that for the dog world.

The clip from that seminar that intrigued me and sent me out to the barn to try clicker training my horse showed Gary training a twelve week old mastiff puppy to sit and then to lie down – all without touching the puppy.  These days that’s become so the norm, it wouldn’t get a second look, but in 1993 the dog training I had seen involved leash pops and pushing on the puppy to make it sit.  I was intrigued by the ease with which Gary got this puppy to lie down and stay down.

I was even more intrigued by a clip that was on the second video.  It featured Gary Priest, the Director of Training at the San Diego Zoo.  Gary talking about an African bull elephant named Chico.  Chico had tried to attack his keepers on several occasions so the decision had been made that no one could go into his enclosure with him.  So for ten years Chico had gone without foot care.  At that time the farrier literally got underneath the elephant to trim the front feet.  Gary showed a video of a farrier standing under the elephants belly to trim a foot.  “One wrong move from the elephant,” Gary says in the background – point taken.

So they had to come up with a different approach for Chico.  Gary decided to try clicker training.  They built several small openings in the gate to Chico’s enclosure.  Then they used targeting to bring him up to the enclosure gate.  It took many months, but they finally taught him to put his foot through the opening and to rest it on a metal stirrup bar for cleaning.

The video showed the keepers using targeting to guide Chico to turn around so his hindquarters were to the gate.  Then following a smaller target, Chico lifted his hind foot through the opening for his first trim in ten years.

Gary says in the voice over:  “I can’t impress upon you enough how aggressive this elephant was, but he’s standing here quietly all for the social attention and the bucket of food treats.”

I know how all too many horses even today get handled when they refuse to pick up their feet.  With some trainers, sadly, out come the lip chains, the hobbles, and three men and a boy to hold the horse down, all to force compliance.  We in the horse world do indeed have a lot to learn.

Those two videos gave me what I needed to get started.  I’ve told this part of the story many times.  My thoroughbred, Peregrine, was laid up with hoof abscesses in both front feet.  I wanted to keep him mentally engaged during what was likely to be a long recovery.  What a perfect time to give clicker training a try.  I went out to the barn with treats and a clicker.

In “Lads Before the Wind” Karen had talked about charging the clicker.  With the dolphins you blew a whistle then tossed a fish, blew a whistle then tossed a fish – until you saw the dolphins begin to look for the fish when they heard the whistle.   Now you could begin to make the blowing of the whistle contingent on a specific behavior.  For example, now the dolphin has to swim in the direction of a hoop suspended in the water.  Swim towards the hoop, and wonders of wonders, you can make the humans blow the whistle and throw you a fish.  That’s a powerful discovery.  Suddenly the animal feels in control.

I tried charging the clicker.  I clicked and treated, clicked and treated.  Peregrine showed no signs that he was connecting the click to the treat.  I remember thinking: “If this is going to take a long time, I’m not interested.”

I decided to try targeting.  There was an old dressage whip propped against the corner of the barn.  That would do.  I held it out. Peregrine sniffed it.  Click, treat.  I held it out again, same thing.  The ball was rolling.

I couldn’t do much more than ask him to target.  His feet hurt too much to take more than a step or two, but as he began to recover, I could ask for more.  I started to reshape all the things I had taught him over the years, everything from basic husbandry skills to the classical work in-hand I was learning.  When I started riding him seven weeks later, he was further along in his training than he had been before he was laid up.

Hmm.  Long lay-ups aren’t supposed to work that way, especially not with a thoroughbred.  Normally, as they recover, you go through a rough patch where they’re feeling very cooped up and your job is to convince them to walk not rear during hand walking.  With Peregrine there was no rough patch.  And he was understanding what I was asking of him so much better that he did before the lay-up.

The good genie that sat on my shoulder had picked well.  It was no accident that clicker training gained such a strong toe hold with me.  I’ve known so many people who gave clicker training a try, loved their horse’s response to the initial targeting, and then got stuck.  What do you do with it?  For them ground work meant lunging – and often lunging badly.  Ugh.  We just want to ride!

I wanted to ride as well, but I also loved ground work.  I had raised all my horses, so ground work to me meant so much more than lunging.   It meant teaching a young horse all the skills it would need to get along with people.  It meant learning how to stand quietly for haltering, grooming, foot care, medical procedures, saddling, etc..  It meant learning to lead and from that core foundation, learning about balance through the classical work in-hand and all the performance doors that opened up.  It meant expanding their world by introducing distractions and new environments.   The list went on and on.  And finally it meant connecting the ground work into riding.  Riding truly is just ground work where you get to sit down.

So as Peregrine began to recover from his abscesses, I had a lot to play with.  My training was already structured around systematic small steps.  It was easy to add in the click and a treat.  At first, you could say that all I was doing was just sugar coating same-old same old.  I would ask in the way I knew and then click and treat correct responses.  But even just that first step into clicker training was producing great results.  And when I explored targeting and free shaping – WOW! – was that ever fun!

I was liking this clicker training!  So I began to share it with my clients.  Together we figured out how to apply it to horses.  So fast forward three years to July of 1996.  I had written a series of articles that I wanted to put up on the internet.  I had built a web site, but I wasn’t sure if I could use the term clicker training.  Gary Wilkes had trademarked “Click and Treat” and the llama trainer, Jim Logan, had trademarked “Click and Reward”.  It was frustrating.  If people kept trademarking all these phrases, pretty soon there would be no way to refer to the training.

So I emailed Karen.  I introduced myself and sent her the articles I wanted to publish on my web site.  I needed to know if she had trademarked clicker training.  Could I use the term in my articles?

Twenty-four hours later I received an email back from Karen.  She had read my articles.  Would I like to write a book about clicker training horses for her publishing company?

You know the answer.  Karen gave the “ball” a huge push down the hill.  So thank you Karen.  Thank you for that initial support.  For me personally it was a great pleasure working with you on the editing of that book.  And over the past twenty years I have treasured our continued friendship.

At one of the early Clicker Expos when you were introducing the faculty, when you got to me, you began by talking about conventional horse training.  You described it as what it is – organized horse abuse.  Wow.  To be brave enough, bold enough to say it out loud.  It was shocking to hear, but so true.  You understood the horse world.  You knew about the wide-spread use of punishment.  You knew the importance of bringing positive reinforcement into this community.

You couldn’t be everywhere, doing everything yourself, but when you asked if I wanted to write a book, you gave the clicker training ball a huge push.  Twenty years later, the book we created together is still helping horse people to find alternatives.  And the horse world is changing!

Thank you Karen.

Goat Diaries – Day 5: Don’t Take Score Too Soon

Don’t take score too soon.  That sounds like a cliche, but when you’re training, it’s an important mantra to keep in mind.  On Day 4 of his training P was leaping into the air in what I interpreted to be a display of frustration.  Was it the extra energy created by adding in a second platform?  Was I somehow teaching him to charge me?  Should I get myself wound up into knots worrying about what I was seeing?

Or should I remain non-reactive to these outbursts and see what he presented over the next couple of sessions?

Don’t take score too soon keeps me from getting depressed over a session that doesn’t go as well as I would have liked.  And it also keeps me from celebrating too soon when I have a good session.  What I want to see is overall progress.  I want to see the unwanted behaviors beginning to disappear, and I want to see them replaced with behaviors that make the time we spend together go more smoothly for both of us.

I could have said: I want the unwanted behaviors to be replaced with behaviors I like, but that sounds like a very lopsided and self-centered relationship. Hopefully, the behaviors I choose to reinforce are activities that my learner also enjoys.relationship.

Reinforcement can be viewed from the perspective of probabilities.  When I see something I like, I click, and then I create on opportunity for my learner to do something I think he’ll like, such as eating a favorite treat.  If my animal a.) notices and b.) wants what I’m offering, he’ll try to figure out what he can do to get me to offer it again.  I’ll see the behavior I want beginning to occur more and more frequently under similar conditions.  That’s when I can say I’ve reinforced the behavior.

If the unwanted behavior persists, I need to remember that something is maintaining or even strengthening that behavior.  Dr. Susan Friedman reminds us to ask what’s the function?  If the goats continue to present behavior I don’t like, I need to consider two questions: 1.) Am I reinforcing it in some way that I may not even be aware of?  2.) What function does that behavior serve?  Asking this second question can help me understand what else in the environment may be maintaining the behavior.

Asking those questions is the first step.  To answer them I need more data.  In the afternoon session I collected more data and the “score card” began to show me that I was moving in the right direction.  I didn’t film the afternoon sessions so I have just my journal notes.

The July Goat Diaries: P’s Afternoon Session

At 11 I spent a few minutes with the goats just scratching all their itchy spots.  I was back at 4:30.  I fed them some hay and then did barn chores.

When I went in to play with them afterward, they were definitely ready.  I opened the outside stall door while I tidied up their stall.  P went straight out and landed on the platform.  I clicked, and he came in to get his treat, then went right back out to the platform.

E wasn’t sure what to do.  In the end he decided to stay inside with me.  While I was giving him some attention in the stall, P got frustrated and started standing up, spinning, and leaping.  He was on the platform.  Why was I not playing with him!

I closed the outside stall door but an eye on what P was doing.  When I saw him going to the platform again, I clicked.  When I saw P going to the platform again, I clicked for him.  He came over to get his treat and then went straight back to the platform.  I was liking these indicators that he knows the game, but I was concerned that I would confuse E.  He had lots of fresh hay to eat, so I outside outside to play with P.

P was great. He stayed solidly on the platform, stood with a relaxed head position, not reaching out to get food, just head up in normal posture.  I could step back to the fence, click, move forward to feed, and then step away again.  When I walked around him, he turned with me.

On cue he followed the target to the next platform, got on it directly and stayed well.  We did several rounds of this, then I left him with treats scattered on the mats.  The session had been a great success.

E’s Session

I began with leading.  (If you haven’t yet read the previous post, I suggest you begin with that. I explain in detail how I was re-introducing the lead to E and P.)  E was excellent.  He walked beside me keeping slack in the lead.   He was so very soft as he responded to the collar cues.  Excellent.  So I set the platforms up.  He was much more settled on them.  There was less of the foot shuffling that he’d been doing in previous sessions.  Nor was he stretching his nose out trying to get to the food.  On cue he went back and forth between platforms.

I put the platforms away and let E out in the pen and got P in the stall.

I worked on leading with P.  He was not as soft as E.  A couple of times he tried to pull away from the restraint of the lead.  It was clearly a well-rehearsed pattern.  I waited without adding any pull to my end of the lead.  As soon as he looked in my direction, click, I released the lead and gave him a treat.  He wanted to go to the stall door which gave me an opportunity to ask him to turn back to me.  Again, I waited.  He glanced in my direction.  Click and treat.

Why go through this process when they are both so good at staying at liberty with me?  I want to be sure that they understand and will respond to the cues that a lead gives.  I don’t want to be tricked into thinking they understand the lead when really all they are doing is following me.

Why does it matter?

Following me at liberty is great, but there are times when a lead is a useful or even a necessary tool.  If I attach a lead, what happens when they do suddenly feel pressure from it?  Does it create resistance, and panic?  When it’s a horse we’re talking about instead of a goat that question really matters.  I want my horses to know they can keep slack in the lead by softening into the feel.  They will know how to walk beside me as though they were at liberty, and I will also have this additional communication tool working for us.

One of the great draws of clicker training is the ease with which we can teach liberty work.  If you are training in a safe environment, you may never feel the need to put a lead on your animal.  My horses lived for years at a boarding barn where leads were required.  With so many people, and especially so many small children about, the rules said you had to have your horse on a lead any time you took him out of his stall.  When my horses moved to my own barn, the halters became stiff from lack of use.  We were all enjoying the camaraderie and freedom that living in a horse-safe environment created.  But there came a point where I bought Robin a new halter.  I loved the liberty work, but I missed the depth of subtle communication that the lead provides.

Shaping on a point of contact begins with safety.  There are times when we need the safety net a lead provides.  You can go this far, but no further.  That’s the constraint the lead provides.  It acts like a mobile fence.

This works for dogs as well as for horses.  Running into the street, pulling away to get to another dog, chasing after a cat can all be prevented with the “fence” a lead creates.  The reason to leave may be different, but the safety concerns are the same.

So in situations where the relationship and training may not yet be strong enough to keep an animal with you, the lead adds an extra layer of insurance.  The question then becomes have we taught our animal how to respond to the constraints of a lead?  Is it simply a case of resisting and discovering that there is no escape, that the only options are to give in and follow, or to have the pressure escalate?  That’s the kind of background many animals and handlers have come from.  For them leading is a poisoned tool.

The goats were learning through a different process.  I was setting up solvable puzzles. I’ve taken the slack out of the lead.  That’s the puzzle.  Now can you solve it?  Can you figure out which way to move to get your treat?  I begin in simple environments with few distractions and few reasons for them to want/need to leave me.  When one puzzle is solved, I present another.  Each success builds their confidence.  They know how to find the answer!  The constraint of the lead is no longer seen as an annoyance or a restriction.  It becomes a clue that helps them get to their reinforcement faster.  When that transformation occurs in their understanding, you have turned the lead into a wonderfully effective, clicker-compatible communication tool.

This kind of training expands options.  It creates freedom.  We often think of a lead as a tool that restricts.  But in this case it meant we could go more places.  Both goats were working well.  I finished the session feeling that it was time to expand their world.  Instead of opening the back door into the outside run, we’d open the front door of the stall and expand their universe of options into the barn aisle.  That would be the plan for day six of their training time with me.

P’s session ended with some soft scratching and back rubs.  I left them to do the remaining barn chores, and then I got the chair out and sat with them to wind down the evening.  They had fresh hay, but they preferred staying by me for head rubs, especially E who kept asking for more whenever I stopped.  He was so very sweet.  While I rubbed his jaw, he leaned on the arm rest and got dreamy eyed. They are delightful individuals to spend time with.

IMG_1592 both goats sleeping on platform

P on the left, E on the right, settling in for the night.

(Please Note: If you want to learn more about rope handling and shaping on a point of contact, please refer to my books, DVDs and on-line course, or come join me at a clinic.  Visit theclickercenter.com for more information.  I’ll also be teaching a lab on rope handling at this year’s Clicker Expos.)

The Goat Palace Journal – A Brief Update

“Don’t take score too soon” is also a good theme for the current Goat Palace sessions.  Another metaphor that applies is that of making clay bricks.  For each goat, over the last couple of days I’ve been working on the same lesson from one session to the next.  Pellias and Elyan have very similar lessons using multiple platforms to teach heeling positions.  Trixie is working in the hallway on her platform lessons.  Thanzi gets the whole back pen to work on leading.

I am building “clay bricks”.  In other words, I am accumulating a reinforcement history around a set of key behaviors.  When I have built enough “bricks”, I’ll be able to assemble them into a house.  The question is: will I be building a mud hut or a magnificent mansion?  Right now, if I tried to build something with the bricks, I’d get the mud hut.  Don’t take score too soon.  As long as we’re having fun and it looks as though we’re heading in a good direction, we’ll keep building these bricks.  These goats are so eager and so full of joy.  No matter what we end up creating, it will be built with laughter.

I’ll save a detailed account of what I am doing with them for another day.

Goats - Dreaming of Christmas.png

Remember to share the link to the Goat Diaries with your friends.

 

Please Note: if you are new to the Goat Diaries, these are a series of articles that are best read in order.  The first installment was posted on Oct. 2nd.  I suggest you begin there: https://theclickercenterblog.com/2017/10/02/   Two of the goats I write about originally came for a twelve day stay in July.  The July Goat Diaries track their training during this period.  In November these two goats, plus three others returned.  They will be with me through the winter.  The “Goat Palace” reports track their training.  I wish to thank Sister Mary Elizabeth from the Community of St. Mary in upstate NY for the generous loan of her beautiful cashmere goats.

 

Coming next: Day 6 – Staying Positive with Constructional Training

 

Summer Pleasures – Watermelon Parties and The Two Sides of Freedom

Watermelon Parties

watermelon

Summer means watermelon parties for the horses.  They are always a surprise.  As I walk through the barn, bowl in hand, I’ll announce: “It’s party time!”

Watermelon parties are held outside. That was quick learning on my part. It’s astounding the amount of happy drool even a few pieces of watermelon can produce.

Robin and Fengur follow me outside.  While I pass out chunks of watermelon, they stand waiting, one on either side of me.  There’s no pushing, no trying to jump the queue, no grumbling at the other horse. We have a happy time together. The horses get to enjoy one of their favorite treats, and I get to enjoy their obvious pleasure.

Summer also means sharing an afternoon nap with Robin. I’ve just come in from mowing the lower pasture. It’s time for a cool down. I’m sitting in a chair in the barn aisle, cold drink by my side, computer on my lap, and Robin dozing beside me. Fengur has wandered off to the hay box to snack. He’ll join us in a little while.

Robin asleep lip drooping

The view from my chair – Robin’s lower lip droops while he naps beside me.

Why am I writing about these simple summer pleasures? My horses live in a world of yes. I’ve been thinking a lot lately about what this means. Living in a world of yes gives me the freedom to enjoy these simple pleasures. But the freedom isn’t one-sided. Living in a world of yes gives my horses just as much freedom.

We often think of training in terms of what we need from our animals. When I walk down the barn aisle, I need you, horse, to move out of my space. When the door bell rings, I need you, dog, to go sit on your mat. I’ll teach these things using clicks and treats, but the behaviors are for my benefit more than my animal companions. The freedom to ask is all on my side.

That’s not how things are in my barn. It’s set up to maximize choice for the horses. Doors are left open so they are free to go where they want. Right now what Robin wants is to nap in the barn aisle. I couldn’t give Robin this luxury of choice if I hadn’t also given him behaviors that let us share space amiably.

When I walk down the barn aisle, Robin will often pose. It’s a simple gesture, a slight arch of the neck is all that’s needed. If he thinks I’m not paying attention, he’ll give a low rumble of a nicker. I’ll click, and give him a treat. Often I’ll get a hug in return.  That’s good reinforcement for me.

The pose is a guaranteed way to get attention from me. If Robin wants to interact, he knows how to cue me. And I am under excellent stimulus control! That’s how cues should work. They create a give and take, a back and forth dialog. They erase hierarchy and create instead the three C’s of clicker training. Those three C’s lead in turn to the freedom my horses and I enjoy sharing the barn together.

Before I can tell you what the three C’s are, we have to go back a few steps to commands.  It’s not just in horse training that commands rule. They control most of our interactions from early childhood on.  Commands have a “do it or else” threat backing them up. Parents tell children what to do.  In school it is obey your teachers or face the penalties. In our communities it’s stop at red lights or get a ticket. Pay your taxes or go to jail. We all know the underlying threat is there. Stay within the rules and stay safe. Stray too far over the line and you risk punishment.

This is how we govern ourselves, so it is little wonder that it is also how we interact with our animals. With both horses and dogs – commands have been the norm. We tell our dogs to “sit”. When it is a true command, it is expected that the dog will obey – or else! The command is hierarchical which means it is also unidirectional. A sergeant gives a command to a private. The private does what he’s told.  He doesn’t turn things around give a command back to the sergeant.

We give commands to our horses, to our dogs – never the reverse. We expect our commands to be obeyed. We say “sit”, and the dog sits. I tell. You obey. Because they are hierarchical, commands exclude dialog. The conversation is all one-sided. Commands put us in a frame that keeps us from seeing deep into the intelligence and personality of the individual we’re directing.

Cues are different. Cues are taught with positive reinforcement. At first, this sounds like a huge difference, but for many handlers it represents a change in procedure, but not yet of mind set. The handler may be using treats as reinforcement, but the cues are still taught with an element of coercion.  How can this be? It’s not until you scratch below the surface, that you’ll begin to understand the ever widening gulf that the use of cues versus commands creates.

dog touching a targetTo help you see the coercive element, let’s look at how twenty plus years ago we were originally instructed how to teach cues.  You used your shaping skills to get a behavior to happen. It might be something as simple as touching a target. Cues evolve out of the shaping process. The appearance of the target quickly becomes the cue to orient to it.  But this cue is often not fully recognized by a novice handler.  We’re such a verbal species, this handler wants her animal to wait until she says “touch”.  As she understand it, that’s the cue.  So what does she do? She begins by saying “touch” and clicking and reinforcing her learner for orienting to the target.

This part is easy. Whether she had said anything or not, her learner was going to touch the target. She’s ready to make a discrimination. Now she presents the target, but she says nothing. What does her learner do? He orients to the target, just as he’s been doing in all the previous trials. He expects to hear the click and be given a treat, but nothing happens. His person just changed the rules which has plunged him into a frustrating puzzle.

He’s in an extinction process. He’s no longer being reinforced for a behavior that has worked for him in the past. He’ll go through the normal trajectory of an extinction process. That means he’ll try harder. He’ll try behaviors that worked in the past, and he’ll become frustrated, anxious, even angry, before he’ll give up for a moment. In that moment of giving up, his person will say “touch” and present the target again.

She wants him to learn the distinction. In the presence of the cue perform the behavior – click and treat. In the absence do nothing.

The problem with this approach is she never taught her learner what “do nothing” looks like. She stepped from the world of commands into what she thinks of as a kinder world of cues, but she didn’t entirely shed the mantle of “do it or else”. With cues the threat of punishment may not be there, but extinction is still an unpleasant and frustrating experience. Why isn’t this key on my computer which was just working now locked up and frozen?!! Until you can find your way out of the puzzle, you can feel very trapped and helpless. A good trainer doesn’t leave her learner there very long. She’s looking for any hesitation that let’s her explain to her learner the on-off nature of cues.

There’s another way to teach this that doesn’t put the learner into this extinction bind.  This other way recognizes that cues create a dialog, a back and forth conversation.  I want my learner to wait for a specific signal before moving towards the target.  Let’s begin by creating a base behavior, a starting point.  For my horses this is the behavior I refer to as: “the grown-ups are talking please don’t interrupt”.  I will reinforce my horse for standing beside me with his head looking forward.  He’ll earn lots of clicks and treats for this behavior.  And he’ll begin to associate a very specific stance that I’m in with this behavior.  When I am standing with my hands folded in front of me, it’s a good bet to try looking straight ahead – click and treat.

Ruth Scilla grown ups.png

“Grown-ups”

In separate sessions he’ll also be reinforced for orienting to a target.  When both behaviors are well established, I’ll combine them.  Now I’ll look for grown-ups.  I’ll fold my hands in front of me, knowing I’ll get the response I’m looking for.  Only now, instead of clicking and reinforcing him, I’ll hold out the target to touch.  Click the quick response and treat.

The message is so much more interesting than the one created by using an extinction procedure to introduce cues.  Cues have just become reinforcers which means they have become part of a conversation.  If you want to interact with the target, here’s an easy way to get me to produce it – just shift into grown-ups.  That will cue me to lift the target up.  A conversation has begun.  We’re at the very elementary stage of “See spot run”.  I’m teaching my horses the behaviors they can use to communicate with me, and I am showing them how the process works.  You can be heard.  You WILL be heard.  Let’s talk!

The conversation that emerges over time comes from looking more deeply at what cues really are. We can think of them as a softer form of commands, but that doesn’t oblige us to step out of our hierarchical mindset. It is still I give a signal. You – my animal companion – respond. Click and treat. Diagram this out. The arrows all point in one direction.

Signal from human leads to response from animal

Peel another layer of understanding about how cues work and you come to this:

It isn’t just that cues are taught with positive reinforcement. Cues can be given by anyone or anything. A curtain going up cues an actor to begin speaking his lines. We would never say the curtain commanded the actor.

If cues can be given by anyone or anything, that means they are not hierarchical. We cue our animals, and they cue us. Cues create a back and forth exchange. They lead to conversation – to a real listening to our animals. We adjust our behavior based on their response. Cues lead to the three C’s of clicker training which I can now say are: communication, choice, and connection. And in my barn that in turn creates opportunities for more freedom. It means doors can be left open. It means I can have watermelon parties and sit with my horses while we both enjoy the afternoon breeze through the barn aisle.

Let’s parse this some more.

The mindset that commands create is very much centered around stopping behavior. Other training options won’t make sense. They won’t work.

Cue-based training makes it easier for you to see your horse’s behavior as communication, as a bid for attention. That makes it easier for you to look for solutions that satisfy his needs.

Let’s see how these differences play out in a typical boarding barn scenario. Your horse is hungry. His initial whicker has been ignored. In frustration he’s escalated into banging on his stall door. His human caretakers see this as “demanding” hay. In a command-based frame demanding hay equal rebellious behavior which can’t be tolerated. The behavior must be stopped.

Within this frame the only training options you can think of are those centered around stopping the unwanted behavior. Other options don’t make sense and won’t work. The command-based frame narrows your field of view. It’s as though you have a tight beam focused on the problem behavior. Everything within that beam is crystal clear, but everything outside the beam might as well not exist. You can’t even begin to think about other solutions. You are targeted on the unwanted behavior.  Banging on the stall door must be addressed and addressed directly.

Now let’s look at the contrast that a cue-based frame creates. Your horse is hungry. His initial whicker to you is noticed and responded to. You appreciate his alerting you to the lack of hay. You have read how important gut fill is in preventing ulcers. You attend to your horse’s needs. Within this frame many options become available including hanging a slow feeder in his stall so he doesn’t have to become anxious about his hay.

Which training options make sense will depend upon which frame you are in. If you are a teacher and you want your instructions to be effective, you need to help your students open a frame that matches what you are trying to teach.

In her presentations Dr. Susan Friedman uses a graphic showing a hierarchy of behavior change procedures beginning with the most positive, least intrusive procedures.

Dr. Susan Friedman's Hierarchy of interventions

You begin by looking at health and nutritional considerations and then move to antecedent arrangements. Hanging a hay net for our hungry horse would fit in here. Her graphic pictures a car moving along a highway. As you begin to approach more invasive procedures, there are speed bumps blocking the way. They are there to slow you down, to make you think about other approaches before you bring in the heavy guns of positive punishment. The hierarchy doesn’t exclude positive punishment as a possible solution, but it does say you would use this only when everything else has first been tried.

This hierarchy makes sense when you are looking at behavior from a cue-based perspective. From a command-based frame, the car enters not at the bottom of the roadway, but at the top.

My Changes To Procedural Changes slide

The first intervention is positive punishment. The barriers are still there, but now they act to keep you from seeing other options. It is only when punishment fails, that you are dragged, kicking and screaming, to consider other ways of changing behavior.  I’ve heard these stories so many times from people who are attending their first clicker training clinic. They’ve been brought there by “that horse” – the one who challenges everything they thought they knew about training. Nothing else worked, but then they tried, as a last resort, a bit of clicker training and everything changed! So here they are, ready to learn more.

They don’t yet know what an exciting world they are entering. Everything they have thought about training is about to be turned truly upside down and inside out. That’s all right. They have the fun of watermelon parties ahead of them.

Live in a World of Yes.png

If you want to learn more about living in a world of yes and the freedom that creates for both you and your animal companions, come join us in Milwaukee for the Training Thoughtfully conference.  https://www.trainingthoughtfullymilwaukee.com/

Questions

JOY FULL Horses: Ten Things You Should Know About Cues: Number 9.) You Can’t Not Cue: Part 8 of 12

More Questions
In the previous posts I looked at the components that go into creating clicker “super glue”.  This discussion brings us back to questions, and that’s getting us closer to returning to Poco, the ear-shy horse I introduced you to at the beginning of this unit.

There are many threads that weave through my work.  What is common to all of them are questions.  In the sciences you are trained to ask questions.  You aren’t there simply to regurgitate to others what is already known.  Your role is to explore, investigate and expand upon what is already known.

In archaeology a portion of a site that is being excavated is set aside for a future generation to uncover.  The belief is that the methods of exploration will advance, opening up the possibility that more can be learned by waiting for those techniques.

The expression: “we are standing on the shoulders of giants” holds true in every field.  Sometimes we may laugh at what people before us have believed.  We may think, what an absurd notion!  How could people possibly have believed that!? But those absurd notions were the stepping stones that brought us to our current understanding.  And the beliefs that we hold today are simply more stepping stones taking us to the next “greatest thing since sliced bread”.

Jaak Pansepp identified seven core affective systems.  (Refer to Affective Neuroscience: Published Jan. 17, 2016: https://theclickercenterblog.com/2016/01/17/)

The SEEKING system was one of the seven, and it turns out it plays a role in the other six.  We cannot help but be curious and exploratory.  It is built into the ancient networks of our brain.  As Panksepp describes it, “an infant SEEKS with no set goal.”

Creativity is a core driver.  We ask questions because we are curious.  We want to know what sits beyond the horizon whether that horizon is the physical or metaphorical.  We SEEK to know more.

Questions can take us out past the horizon line, and they can also take us inside to an exploration of our private space.  Here the questions become even more important because we cannot directly investigate these private realms.

Levels of Analysis
Panksepp asks questions at the level of individual neurons and the systems that they form within the brain.  I have been trained to ask questions at a different level of analysis.  That’s a phrase I learned from Dr. Susan Friedman.  (behaviorworks.org)  Dr. Friedman is a behavioral analyst.  She uses a wonderful metaphor of a viewing scope.  What is the lens focused on – the distant horizon or something much closer?  What is the level of analysis that interests you?

My focus is on balance, but I have to go inside to find the answers to the questions I ask.

Going Inside
What does going inside mean?  If I ask you to raise your arm, I have an overall understanding of how human anatomy works and what muscles, bones, and tendons are involved, but that doesn’t tell me how YOU lift your arm.

I could watch what you do, but that gives me only partial information.  I could ask you directly, but how many of us know how we do something so basic?  We lift our arms without thinking about HOW we are doing it.

So if I want to know how YOU lift your arm, I need to ask questions at a different level of analysis.  I might rest my arm on your shoulder so I can add the tactile information to all the other data I’m been collecting.

I will need to know how to silence all the other answers I’ve gotten from asking similar questions of others.  I can’t assume that your answer will be the same as theirs.  I ask my questions without knowing the answer.

I observe without judgment.

And I observe through questions.

I feel the movement of your arm lifting under my hand.   I could be satisfied with thinking:

Here it lifts.  Here it stops.  Here her shoulder moves.  Here her breath is held.

Instead I want to keep putting a question mark at the end of each of these sentences.

How is she lifting her arm?  Is it anything to do with what I feel under my hands?  How does her arm move? Where does the movement begin?  Where does the movement stop?  Is it the same on both sides?

Adding a Question Mark – Feldenkrais Work
Turning your observations into questions comes via Mia Segal, a Feldenkrais practitioner.  I wrote about her work earlier. (See Part 2: Unit 3, Chapter 3: Feldenkrais Work: Published June 9,2016:https://theclickercenterblog.com/2016/06/09/)

In the horse world many of us are aware of the Feldenkrais Awareness Through Movement method because of Linda Tellington-Jones.  Her TT.E.A.M training evolved out of Moshe Feldenkrais’ work for people.  Feldenkrais’ work is an exploration of movement in which an individual is guided through questions towards greater self-awareness and well being.

Asking Not Telling
Applied to horses what evolves out of this type of exploration is a question that slices straight through to your core belief system.  It is this:

Are you telling or are you asking?

You can train with a clicker and treats, but if you are telling, you aren’t playing, and you most certainly aren’t listening.

Suppose you want your horse to pick up a hind foot.  You can use your clicker and treats to “tell” him to do what you want.

“Shift your weight over off your left hind.” Click then treat.

“Unweight your left hind.” Click then treat.

“Unweight it a bit more.” Click then treat.

“Pick up your left foot.” Click then treat.

“Pick it up higher.” Click then treat.

“Hold it still while I clean your foot.” Click then treat.

You’ve been polite, but you’ve still told your horse what to do.  You’ve picked his foot up, and you’re holding it where you always hold a horse’s foot.  But suppose for this horse’s conformation that means his hock is now under pressure.

The longer you hold his foot up, the more uncomfortable he’s going to become.  He’ll start to fuss and try to pull his foot away.  You’ve been told you have to hold on.  If you let go, he’ll learn he can pull away, and he’ll never hold his foot up for you.  So you hold on.

He becomes more uncomfortable and pretty soon your wrestling match has disintegrated into a full out battle.  No matter the outcome neither of you are winners because the whole process could have been so very different.  Here’s how:

Suppose you ask for his foot instead through a series of questions.  Now it becomes:

“How do you shift your weight over off your left hind?” Click then treat as he responds with an answer.

“Can you unweight your left hind?” Yes.  Click then treat.

“Can you unweight it a bit more?” Yes. Click then treat.

“How do you pick up your left foot?” Follow his movement through the lift. Click then treat.

“Can you pick it up higher?” Yes. Click then treat.

“Where can you comfortably hold your foot?”  Click then treat as you find the spot together.

As you ask these questions, you’ll be listening to your horse.  You’ll feel how his leg unfolds as he lifts it into your hand.  Instead of holding it in a position that stresses his joints, you’ll let him show you where he can hold it comfortably.  Instead of fussing, now you have a horse who knows he’ll be listened to.

The click and the treat helps to guide him through the questions you’re asking.  The questions will give you the lesson.

The Questions – The Lesson
The Questions:

How do I feel it in my hands?

Where does the movement begin?

Where does it stop?

How does it stop?

When does it stop?

How does it begin again?

What changes with repetition?

Is it the same on both sides?

What changes under my hands?

How could it be done differently?

(Note: These questions are from Mia Segal’s youtube video: The Art of the Question.)

Your Homework
Here’s something to play with over the next few days.  Put question marks at the end of your training requests, and then make note of the changes you see in your horse.  I’ll end with a question.  What changes in your relationship as you ask questions and learn to listen deeply for the answers?

Coming Next: The Teachers We Get Are The Teachers We Need

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com