JOY FULL Horses: Understanding Extinction: Part 14

Our Creative Horses
Yesterday I shared with you the story of Robin’s “pose”.  The use of resurgence has helped us develop a much more systematic way of creating unlikely behaviors.  Because we understand the process better, we can be more deliberate in it’s use.  I ended the post by saying: “The end result may look like magic, but there is good science behind it.”

When we open up our training in this way and turn our learners into more active participants, we often find that they are even more creative than we are.  Once again Robin provided me with a great example of this.

When Robin was three I took him to the Equine Affaire to be my demo horse.  I wanted to show people what freeshaping via clicker training looks like.  I didn’t want them just to see the end product of freeshaping.  I wanted them to see me teach Robin a completely novel behavior.  The problem was he already had a pretty extensive repertoire. I was stumped for ideas, but I thought the easiest solution would be to use a prop.  One of my clients had been teaching his horse to flip a hula hoop up over his head.  I thought I could make a start on that with Robin.

Robin had been our first equine retriever.  Picking things up was solidly in repertoire.  I figured if I put the hula hoop on the ground, he would try to pick it up.  I’d be able to reinforce that and build it into Robin holding it longer which might over three days of demos lead to him flipping it over his head.  Such was my level of creativity, that’s all I could think of to work on with a hula hoop.

So during our demo, I brought out the hula hoop and tossed it out on the ground.  I was still explaining freeshaping to the audience so I wasn’t focusing yet on Robin.  While I was talking, he walked over to the hoop and stood with his front feet planted in the middle of it just as he would have stood on a mat.  Before I could respond to him, he reached down, picked up one side of the hoop and began walking himself forward foot by foot with the hoop!  That was his level of creativity!

The Creative Process
Here are the steps the horses have been teaching us:

First, you build a strong history of reinforcement for the component behaviors.

You change the situation somewhat so mild extinction comes into play.

You get a resurgence of these previously reinforced behaviors and new combinations emerge.  That’s creativity.  The most fun for me is seeing what the horses invent. As we have seen, they are often so much more creative than their human partners!

Familiar Landscapes
Kay Laurence might say we were seeing familiar landscapes with fresh eyes.

Dr. Jesús Rosales-Ruiz would say you have to understand the process of extinction before you can master it.  If you understand it, you’ll avoid situations that create macro extinction processes and all the frustration that goes along with them.  Instead you’ll use micro extinctions to build complex behaviors.

I would say that monitoring the level of extinction your learner is experiencing is a keys-to-the-kingdom part of good training.

I’ve just spent a couple of days working with a group of horses I have come to know well. One of them is a retired performance horse. Without going into a lot of details, I would describe him as an emotionally fragile horse. He’s easily worried.  If he thinks he has the right answer, he’s a superstar, but I always have to be careful how far I stretch him into new behaviors.  If he thinks he might get something wrong, he worries.  He’s come out of a training environment in which he had to perform correctly or his rider could get seriously hurt. I suspect he was punished for mistakes which accounts for his worry.

Mastering Micro
His back was looking prematurely aged so I wanted to teach him Robin’s “pilates pose”.  I had already shown him that he could get reinforced for lifting his back up and releasing at the poll.  In this particular session I was holding out for slightly better versions. As I withheld my click, I saw him experimenting.  Was it higher with his poll? Was it more lift of his back? What did I want?

The shifts he was giving me represented micro changes.  They were all within a clickable range.  Clicking him for any of these variations would have been fine, but I was waiting fractionally to see what else would pop out.

I was using micro extinctions to create the next step.  And because I was thinking about this in terms of extinction, I was monitoring closely his emotional responses.  I did not want him to become macro worried.  We were always just a second or two from a click so I could let him experiment without risking the emotional fallout of a larger extinction process.

Micro Masters
Micro is so very much the key.

Macro extinctions are frustrating.  Micro extinctions are part of good teaching.

Macro shaping can be confusing.  Micro shaping is elegant.

Macro negative reinforcement is literally painful. Micro negative reinforcement is clear communication. It is a conversation with cues exchanged in both directions.

When you go micro, your learner is always just a second or two away from a reinforceable moment.  You can cue another behavior, or you can simply click and treat. Either way, you are saying: “Yes! Great idea!” Micro Mastery is what we should be striving for in our training.  When you say someone is a great trainer, you are really saying that individual is a Micro Master.  In training that’s the “black belt” we should be aiming for.

robin-pg-lying-down-micro-masters

With this last section we come to the end of my JOY FULL Horses book – almost.  What remains is one final chapter and that’s what’s coming next.

Coming Next: Doorways

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

You Can’t Not Cue: Part 1 of 12

JOY FULL Horses: Ten Things You Should Know About Cues: Number 9.) You Can’t Not Cue: Part 1 of 12

Using the Cues Your Horse Discovers

Collecting Gems
I began with the intent of introducing a beginner clicker trainer to the concept of cues.  Look where it’s taken us!  The first post in this unit was put up on Feb. 10, 2016.  Look at all the things I’ve covered since then.  I may have started out really simple, but as I’ve marched through the list, I’ve covered some very complex concepts.

That’s very much like training in general.  Focus on one particular exercise over a period of time, and you’ll ALWAYS get many more good things emerging from it than that one simple beginning point.

The more we look at cues, the more good things we see that are connected to this “green light” concept.

So far we’ve looked at:
1.) Cues and commands are not the same.
2.) Not all cues are verbal.
3.) Cues can come from inanimate objects.  You can have environmental cues.
4.) Our animals can cue us.
5.) Cues evolve out of the shaping process.
6.) Having a cue attached to a behavior isn’t enough.  We need stimulus control – a fancy term for saying you get the behavior you want when you want it and only when you want it.
7.) We can use cues to counter balance one another to create stimulus control.
8.) Cues change and evolve. You can use this to create the degree of lightness you want.  You can also create new cues for existing behaviors.

Now for number nine I would say to my novice clicker trainer:

9.) You can’t not cue.

Your horse is a grandmaster at reading humans.  And he’s also great at predicting the future.  He knows your patterns even if you don’t.  He knows when you’re about to ask him for head lowering, for backing, etc..  Before you can give what you think is the cue, he’s already worked out what you want.  It’s time to notice those cues so you can play with them and have some fun as you solve some common training problems.

Clever Hans
I wrote about Clever Hans earlier.  (https://theclickercenterblog.com/2016/02/14/) Clever Hans was a horse who gained fame in Germany in the early years of the 20th century.  It was said he could do basic arithmetic, including multiplying and dividing.  He could tell time; he could keep track of the days in a week and solve other puzzles that were asked of him.  Ask him how much 3 times 9 was, and Clever Hans would tap out the right answer.  Of course, it had to be a trick. Horses couldn’t do math or know the answers to these other questions.  But how was he doing it?  Even when they took his owner away, Clever Hans would still tap out the correct answers.

A panel of experts examined him, but couldn’t solve the puzzle.  And then in 1907 a psychologist named Oskar Pfungst cracked the code.  Clever Hans didn’t need his owner to be present.  As long as the other people watching knew the answer, Clever Hans would stop tapping at the correct moment.  It wasn’t magic or a hoax, just a horse who was extremely good at reading body language.

He couldn’t do arithmetic and all of those other intellectual feats. People could go right back to their firmly held belief that horses were indeed stupid animals.

How sad.  There is another conclusion they could have drawn – and celebrated. Horses are brilliant at reading body language.

We are training the species that is represented by Clever Hans.  You can fight your horse’s ability to read even the subtlest of cues, or you can put it to good use.

Working WITH Your Own Clever Hans
If I were setting up a scientific study to test a horse’s ability to differentiate colours, I might want to be very rigid in my experimental design.  I would want to know that I wasn’t giving away the answer through some subtle hints I might not even be aware of.  I would have to work hard to take my body language out of the picture.  I might wear dark glasses so my horses couldn’t see where I was looking, but even that wouldn’t be enough. Horses are such masters at reading subtle signals, any tilt of my head would be a giveaway.

Fighting against my horse’s ability to read me is NOT how I train. I’m not training my horses so I can pass the scrutiny of some scientific standard.  Instead of fighting my horse’s ability to read body language, I’m going to make use of it.  I WANT my horses to read me.  And I want my horses to be successful.

So I’m going to embrace a very basic understanding of cues which is: you can’t not cue.

Canine Teachers
Several years back at the Clicker Expo Morten and Cecilia Egverdt did a series of presentations on teaching canine obedience using backchaining.  They want high energy, enthusiastic dogs who can perform with great accuracy and precision.  When a signal is given in competition, they expect an immediate response.

They taught their dogs via clicker training.  The end result was sharp, accurate performance at the highest levels of competition.  In a competition if you were comparing one of Morten’s clicker-trained dogs with other dogs that were more conventionally trained, you would see all the dogs working with extreme accuracy and precision.  They would all respond immediately to the signals they were given. They would all work at speed.  They would all work accurately.  Stimulus control would create in all the dogs very polished performances.

But Morten stressed that he didn’t want to end up with a dog that was indistinguishable from the more conventionally-trained dogs.  He wanted his clicker-trained dogs to retain the enthusiasm for their work that they displayed when they were first learning new skills.  He wanted to keep the creativity and joy even as he developed the unwavering precision in response.  He wanted his dogs to know that offering behavior was still okay.

At the start of a work session his dogs could offer behaviors that were appropriate to that particular environment.  If they were out in their training arena, they could sit, lie down, spin, run in a big circle, leap over a jump, etc..  Any and all of these behaviors would be reinforced.

It was as if the dogs had a menu from which to choose.  In this environment barking, digging holes in the footing, biting the handler – these are NOT behaviors which will ever be reinforced.  But sitting, lying down, running backwards, jumping over the jump, retrieving the dumbbell, these are all behaviors which will earn clicks and treats – until . . .

Until the handler gives the first definite cue.  After that ONLY the behaviors which are cued will be reinforced.  No off-cue behaviors will earn a click and treat.

Selecting from the Menu
I loved the concept of the menu.  In this context, these are the behaviors that have a high probability of being reinforced.  This is something I very much want my horses to understand.  It is the basis for what I refer to as default behaviors.

A horse can’t do nothing – not unless he is dead.  Your horse is always doing something.  When I’m in the barn doing chores and my horses are in their stalls, there are lots of possible “somethings” they could be doing.  Some of the “somethings” would be behaviors that I wouldn’t want – banging on the stall door or raking their teeth across the metal bars to get my attention.  I also wouldn’t want them pacing, attacking their neighbors, rearing up, etc..

I wouldn’t mind if they took a nap, ate their hay, drank from their water bucket.  Those are all perfectly acceptable behaviors.  If they want me to interact with them, they could pose, or put their ears forward.  They don’t have to wait for a specific cue from me.  I am the cue.  If I walk past my horse’s stall and he wants to initiate a conversation, all he has to do is arch his neck in what I consider to be a pretty pose.  Click – he has my attention.

I’m not under perfect stimulus control. Sometimes I’m carrying two water buckets which makes stopping to give a treat difficult.  But I think my horses would tell you, they have me pretty well trained.

What Morton and Cecilie’s work suggests is that the dogs (and horses) are learning the concept of putting individual behaviors into categories.  Under these conditions these behaviors are acceptable.  If you want reinforcement, offer me behaviors from within this class.  Cantering is a wonderful behavior to offer out here in the arena, but I don’t want to see it in the barn aisle or in your stall!

Use Your Cues
The only place where I parted company with what they were saying was their comment that they weren’t cueing these behaviors.  I watched a video clip showing one of their dogs offering behavior after behavior while Cecilie stood in a rigid position, arms at her side, feet together.  Of course she was cueing!  That body position was the cue for her dogs to offer behavior.

I don’t want to fight these cues, or pretend that they aren’t there.  The previous section looked at how cues evolve out of the shaping process.  I want to put them to work.  As soon as I recognize how fast cues emerge out of the shaping process, I can begin to use them to solve some very common behavior problems.

Coming Next: An Accident Waiting To Happen

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com