Giving The Ball A Push

2018 marks the twentieth anniversary of the publication of “Clicker Training for your Horse”.  I am celebrating by writing thank yous each month to people who helped bring clicker training into the horse world.

Are you trying to guess who it’s going to be this month?  Anyone who has followed my work knows the stories.  You’ve met the horses through my books and DVDs. Who will I single out this time?

I could turn it into a guessing game.  This person has appeared in the game show: “What’s my line?”.  Does that help?  Maybe not.  But if I tell you that the panelists correctly guessed that she was a dolphin trainer, now some of you will know who I’m talking about.  July’s tribute belongs to Karen Pryor.

So many of us were first introduced to clicker training through Karen’s book, “Don’t Shoot the Dog”.  I discovered her book through a friend who bred and trained Irish wolf hounds.  We were having lunch together (with one of her wolf hounds literally looking over my shoulder).  Needless to say, we were talking about training.  I’ve forgotten the exact subject, but I do remember my friend saying, “But of course, you’ve read “Don’t Shoot the Dog”.

Don't Shoot the Dog

She said it in a tone that implied that of course I had.  How could I not?  But in 1993 I had never even heard of “Don’t Shoot the Dog”.  Perhaps if Karen’s publishers had called it “Don’t Shoot the Horse”, the horse world would have been exploring clicker training ahead of the dog world.  We’ll never know.  But in any event, I tracked down a copy of “Don’t Shoot the Dog” and read it with great interest.

Those of you are familiar with Karen’s book know that it is not a training book per se.  Karen was writing about learning theory, a subject which can sound very dry and off-putting.  “Don’t Shoot the Dog” is anything but.  You read it, nodding your head in agreement.  “That’s why that horse, that dog, that person responded in that way.  It all makes so much sense!  How could they do anything else.”

When I read the chapter on punishment, I remember thinking, “The horse world needs to know about this.”  The horse world needs to understand that when you use punishment, there is ALWAYS fallout.  You always get other unintended, unwanted consequences.  Punishment doesn’t work with laser-fine precision.  You may shut down the behavior you’re after, but the effect spreads out and creates negative consequences and a general dampening down of behavior.

Use it often, and you will get what in the horse world is often called a “well behaved” horse, meaning a shut down horse.  Punishment stops behavior.  That’s the definition of punishment (versus reinforcement).  When you use reinforcement (plus or minus), the behavior you’re focusing on increases.

When you use punishment, the behavior decreases.  So you may punish biting.  Strike hard enough, fast enough, the biting may indeed stop – for the moment.  But punishment isn’t a teaching tool.  It doesn’t tell the horse what TO DO to avoid the unwanted consequence.  However, it is reinforcing for the punisher.  That’s what makes it such a slippery slope.  It may not get the results that you’re after, but in the moment, oh it can feel so good.

When skilled positive reinforcement trainers talk about the four quadrants meaning positive and negative reinforcement, and positive and negative punishment, they don’t take the use of punishment completely off the table.  They recognize that under the right conditions punishment – applied well – may be a necessary and correct choice.

In many of her presentations Dr. Susan Friedman talks about the hierarchy of behavior-change procedures.

 

Susan Friedman's hierarchy

You begin with the least intrusive interventions.  You begin by exploring medical reasons for the behavior, then you move to changing the environment, and positive reinforcement procedures.  Only after many steps and pausing always to consider if there might be other alternatives, would you consider the more intrusive methods and sitting last as a possibility would be punishment.  And before people puff themselves up and say – I would never use punishment, remember Dr Friedman spent much of her career working with children with major behavioral problems that included self-injurious behavior.  So what would you do with a child who is trying to gouge her eyes out?  Is punishment of that behavior always off the table?

Punishment is certainly not where you begin, but there may be extreme situations where it is where you end up.  If a fire were fast approaching, and you needed to load a reluctant horse on a trailer NOW or leave him behind, would you resort to punishment?  Until you’re faced with that situation, it’s an open question.

Ken Ramirez, another trainer I greatly admire, doesn’t take punishment off the table either.  However, when he was overseeing the training program at the Shedd Aquarium, the novice trainers were only allowed to use positive reinforcement.  They could reinforce behaviors that they liked, but they had to be non-reactive to behaviors they didn’t like.  Only when they were more skilled could they begin to use more advanced techniques.  In his talks on this subject Ken explains why he puts these limits on his young trainers.  At some point early in their career they will come to him, asking for permission to move up the hierarchy.

“Ken,” they will say, “I could so easily solve this problem we’re having with this animal if only you would let me use this procedure that I’ve read about.”  Ken won’t let them.  He wants them to become very experienced with the basics.  If you let them begin to add in other techniques too soon, they really never learn how to be skilled and creative with the basic tools.  They jump the queue too fast and head for more intrusive techniques.

As they become more skilled, he lets them expand into the rest of the hierarchy.  His senior trainers can use any technique, including punishment, that they deem to be appropriate.  But he knows that these trainers have the experience and the skill to apply punishment well, meaning with good timing and at the right intensity to create the desired effect and minimize the fallout.  He also knows that they are so skilled and experienced that they don’t need to use punishment.  They will find other alternatives.

The odd thing in the horse world is we flip things upside down.  We reach first for punishment.  The horse bites – we strike.  It’s the horse’s fault.  And if he bites again, we’ll hit him harder.  We don’t look first for medical conditions.  Maybe that horse is full of ulcers.  Treat the ulcers and his reason for biting will go away.  We don’t rearrange the environment.  Use protective contact – put a barrier between you and the horse so he can’t bite you, and then use positive reinforcement to teach him alternatives to biting.

Instead we give six year old children riding crops (often pink riding crops with pretty sparkles), and we tell her to hit her pony harder.  We give punishment to the least experienced, most novice riders.  That’s completely upside down.  No wonder what we get back are so many sad stories, so many bad endings for both people and horses.

When I said the horse world needs to understand what Karen was saying about punishment in “Don’t Shoot The Dog”, I’ve always though some genie of the universe heard that.  “Got one! She’ll do.”  I was sent the clicker training bug.  More than that, that genie sat on my shoulder and kept urging me to write about what I was experiencing with my horses.  Lots of people, including Karen Pryor, had used clicker training with their horses before I ever went out to the barn with clicker in hand.  I was by no means the first person who ever used it with a horse.  But they didn’t disappear into their computers to write about it.  That good genie on my shoulder made sure that I did.

“Don’t Shoot the Dog” sparked my interest.  I wanted to know more about clicker training.  I read “Lads Before The Wind”,  Karen’s chronicle of the founding of Sea Life Park and the development of the first dolphin shows.  She shared with us the many training puzzles that had to be solved in order to figure out how to train dolphins.  Old-style circus training wasn’t the answer.  She turned to science and the work that was coming out of B.F. Skinner’s lab.

“Lads Before The Wind” took me a step closer.  I wanted to know more about training with a marker signal.

My friend brought me a copy of a magazine article she thought I’d find interesting.  I have no idea what the article was about.  I’m not even sure that I read it, but down in the left hand corner, in very small print, was a tiny ad for two of Karen Pryor’s early VHS videos.  I sent away for both.

The first one was recorded at a seminar that Karen gave with Gary Wilkes to a group of dog trainers.  Gary was the canine trainer who approached Karen with the question: “Do you think clicker training would work with dogs?”

In a conversation I had years ago with Karen, she said she had always had dogs, but they weren’t really trained, not like she had trained the dolphins.  They were just around.  But when Gary wondered if clicker training would work with them, Karen thought, of course!  Why not!  So she and Gary teamed up to give a series of seminars to dog trainers, and we all know what grew out of that for the dog world.

The clip from that seminar that intrigued me and sent me out to the barn to try clicker training my horse showed Gary training a twelve week old mastiff puppy to sit and then to lie down – all without touching the puppy.  These days that’s become so the norm, it wouldn’t get a second look, but in 1993 the dog training I had seen involved leash pops and pushing on the puppy to make it sit.  I was intrigued by the ease with which Gary got this puppy to lie down and stay down.

I was even more intrigued by a clip that was on the second video.  It featured Gary Priest, the Director of Training at the San Diego Zoo.  Gary talking about an African bull elephant named Chico.  Chico had tried to attack his keepers on several occasions so the decision had been made that no one could go into his enclosure with him.  So for ten years Chico had gone without foot care.  At that time the farrier literally got underneath the elephant to trim the front feet.  Gary showed a video of a farrier standing under the elephants belly to trim a foot.  “One wrong move from the elephant,” Gary says in the background – point taken.

So they had to come up with a different approach for Chico.  Gary decided to try clicker training.  They built several small openings in the gate to Chico’s enclosure.  Then they used targeting to bring him up to the enclosure gate.  It took many months, but they finally taught him to put his foot through the opening and to rest it on a metal stirrup bar for cleaning.

The video showed the keepers using targeting to guide Chico to turn around so his hindquarters were to the gate.  Then following a smaller target, Chico lifted his hind foot through the opening for his first trim in ten years.

Gary says in the voice over:  “I can’t impress upon you enough how aggressive this elephant was, but he’s standing here quietly all for the social attention and the bucket of food treats.”

I know how all too many horses even today get handled when they refuse to pick up their feet.  With some trainers, sadly, out come the lip chains, the hobbles, and three men and a boy to hold the horse down, all to force compliance.  We in the horse world do indeed have a lot to learn.

Those two videos gave me what I needed to get started.  I’ve told this part of the story many times.  My thoroughbred, Peregrine, was laid up with hoof abscesses in both front feet.  I wanted to keep him mentally engaged during what was likely to be a long recovery.  What a perfect time to give clicker training a try.  I went out to the barn with treats and a clicker.

In “Lads Before the Wind” Karen had talked about charging the clicker.  With the dolphins you blew a whistle then tossed a fish, blew a whistle then tossed a fish – until you saw the dolphins begin to look for the fish when they heard the whistle.   Now you could begin to make the blowing of the whistle contingent on a specific behavior.  For example, now the dolphin has to swim in the direction of a hoop suspended in the water.  Swim towards the hoop, and wonders of wonders, you can make the humans blow the whistle and throw you a fish.  That’s a powerful discovery.  Suddenly the animal feels in control.

I tried charging the clicker.  I clicked and treated, clicked and treated.  Peregrine showed no signs that he was connecting the click to the treat.  I remember thinking: “If this is going to take a long time, I’m not interested.”

I decided to try targeting.  There was an old dressage whip propped against the corner of the barn.  That would do.  I held it out. Peregrine sniffed it.  Click, treat.  I held it out again, same thing.  The ball was rolling.

I couldn’t do much more than ask him to target.  His feet hurt too much to take more than a step or two, but as he began to recover, I could ask for more.  I started to reshape all the things I had taught him over the years, everything from basic husbandry skills to the classical work in-hand I was learning.  When I started riding him seven weeks later, he was further along in his training than he had been before he was laid up.

Hmm.  Long lay-ups aren’t supposed to work that way, especially not with a thoroughbred.  Normally, as they recover, you go through a rough patch where they’re feeling very cooped up and your job is to convince them to walk not rear during hand walking.  With Peregrine there was no rough patch.  And he was understanding what I was asking of him so much better that he did before the lay-up.

The good genie that sat on my shoulder had picked well.  It was no accident that clicker training gained such a strong toe hold with me.  I’ve known so many people who gave clicker training a try, loved their horse’s response to the initial targeting, and then got stuck.  What do you do with it?  For them ground work meant lunging – and often lunging badly.  Ugh.  We just want to ride!

I wanted to ride as well, but I also loved ground work.  I had raised all my horses, so ground work to me meant so much more than lunging.   It meant teaching a young horse all the skills it would need to get along with people.  It meant learning how to stand quietly for haltering, grooming, foot care, medical procedures, saddling, etc..  It meant learning to lead and from that core foundation, learning about balance through the classical work in-hand and all the performance doors that opened up.  It meant expanding their world by introducing distractions and new environments.   The list went on and on.  And finally it meant connecting the ground work into riding.  Riding truly is just ground work where you get to sit down.

So as Peregrine began to recover from his abscesses, I had a lot to play with.  My training was already structured around systematic small steps.  It was easy to add in the click and a treat.  At first, you could say that all I was doing was just sugar coating same-old same old.  I would ask in the way I knew and then click and treat correct responses.  But even just that first step into clicker training was producing great results.  And when I explored targeting and free shaping – WOW! – was that ever fun!

I was liking this clicker training!  So I began to share it with my clients.  Together we figured out how to apply it to horses.  So fast forward three years to July of 1996.  I had written a series of articles that I wanted to put up on the internet.  I had built a web site, but I wasn’t sure if I could use the term clicker training.  Gary Wilkes had trademarked “Click and Treat” and the llama trainer, Jim Logan, had trademarked “Click and Reward”.  It was frustrating.  If people kept trademarking all these phrases, pretty soon there would be no way to refer to the training.

So I emailed Karen.  I introduced myself and sent her the articles I wanted to publish on my web site.  I needed to know if she had trademarked clicker training.  Could I use the term in my articles?

Twenty-four hours later I received an email back from Karen.  She had read my articles.  Would I like to write a book about clicker training horses for her publishing company?

You know the answer.  Karen gave the “ball” a huge push down the hill.  So thank you Karen.  Thank you for that initial support.  For me personally it was a great pleasure working with you on the editing of that book.  And over the past twenty years I have treasured our continued friendship.

At one of the early Clicker Expos when you were introducing the faculty, when you got to me, you began by talking about conventional horse training.  You described it as what it is – organized horse abuse.  Wow.  To be brave enough, bold enough to say it out loud.  It was shocking to hear, but so true.  You understood the horse world.  You knew about the wide-spread use of punishment.  You knew the importance of bringing positive reinforcement into this community.

You couldn’t be everywhere, doing everything yourself, but when you asked if I wanted to write a book, you gave the clicker training ball a huge push.  Twenty years later, the book we created together is still helping horse people to find alternatives.  And the horse world is changing!

Thank you Karen.

Goat Diaries – Day 5: Don’t Take Score Too Soon

Don’t take score too soon.  That sounds like a cliche, but when you’re training, it’s an important mantra to keep in mind.  On Day 4 of his training P was leaping into the air in what I interpreted to be a display of frustration.  Was it the extra energy created by adding in a second platform?  Was I somehow teaching him to charge me?  Should I get myself wound up into knots worrying about what I was seeing?

Or should I remain non-reactive to these outbursts and see what he presented over the next couple of sessions?

Don’t take score too soon keeps me from getting depressed over a session that doesn’t go as well as I would have liked.  And it also keeps me from celebrating too soon when I have a good session.  What I want to see is overall progress.  I want to see the unwanted behaviors beginning to disappear, and I want to see them replaced with behaviors that make the time we spend together go more smoothly for both of us.

I could have said: I want the unwanted behaviors to be replaced with behaviors I like, but that sounds like a very lopsided and self-centered relationship. Hopefully, the behaviors I choose to reinforce are activities that my learner also enjoys.relationship.

Reinforcement can be viewed from the perspective of probabilities.  When I see something I like, I click, and then I create on opportunity for my learner to do something I think he’ll like, such as eating a favorite treat.  If my animal a.) notices and b.) wants what I’m offering, he’ll try to figure out what he can do to get me to offer it again.  I’ll see the behavior I want beginning to occur more and more frequently under similar conditions.  That’s when I can say I’ve reinforced the behavior.

If the unwanted behavior persists, I need to remember that something is maintaining or even strengthening that behavior.  Dr. Susan Friedman reminds us to ask what’s the function?  If the goats continue to present behavior I don’t like, I need to consider two questions: 1.) Am I reinforcing it in some way that I may not even be aware of?  2.) What function does that behavior serve?  Asking this second question can help me understand what else in the environment may be maintaining the behavior.

Asking those questions is the first step.  To answer them I need more data.  In the afternoon session I collected more data and the “score card” began to show me that I was moving in the right direction.  I didn’t film the afternoon sessions so I have just my journal notes.

The July Goat Diaries: P’s Afternoon Session

At 11 I spent a few minutes with the goats just scratching all their itchy spots.  I was back at 4:30.  I fed them some hay and then did barn chores.

When I went in to play with them afterward, they were definitely ready.  I opened the outside stall door while I tidied up their stall.  P went straight out and landed on the platform.  I clicked, and he came in to get his treat, then went right back out to the platform.

E wasn’t sure what to do.  In the end he decided to stay inside with me.  While I was giving him some attention in the stall, P got frustrated and started standing up, spinning, and leaping.  He was on the platform.  Why was I not playing with him!

I closed the outside stall door but an eye on what P was doing.  When I saw him going to the platform again, I clicked.  When I saw P going to the platform again, I clicked for him.  He came over to get his treat and then went straight back to the platform.  I was liking these indicators that he knows the game, but I was concerned that I would confuse E.  He had lots of fresh hay to eat, so I outside outside to play with P.

P was great. He stayed solidly on the platform, stood with a relaxed head position, not reaching out to get food, just head up in normal posture.  I could step back to the fence, click, move forward to feed, and then step away again.  When I walked around him, he turned with me.

On cue he followed the target to the next platform, got on it directly and stayed well.  We did several rounds of this, then I left him with treats scattered on the mats.  The session had been a great success.

E’s Session

I began with leading.  (If you haven’t yet read the previous post, I suggest you begin with that. I explain in detail how I was re-introducing the lead to E and P.)  E was excellent.  He walked beside me keeping slack in the lead.   He was so very soft as he responded to the collar cues.  Excellent.  So I set the platforms up.  He was much more settled on them.  There was less of the foot shuffling that he’d been doing in previous sessions.  Nor was he stretching his nose out trying to get to the food.  On cue he went back and forth between platforms.

I put the platforms away and let E out in the pen and got P in the stall.

I worked on leading with P.  He was not as soft as E.  A couple of times he tried to pull away from the restraint of the lead.  It was clearly a well-rehearsed pattern.  I waited without adding any pull to my end of the lead.  As soon as he looked in my direction, click, I released the lead and gave him a treat.  He wanted to go to the stall door which gave me an opportunity to ask him to turn back to me.  Again, I waited.  He glanced in my direction.  Click and treat.

Why go through this process when they are both so good at staying at liberty with me?  I want to be sure that they understand and will respond to the cues that a lead gives.  I don’t want to be tricked into thinking they understand the lead when really all they are doing is following me.

Why does it matter?

Following me at liberty is great, but there are times when a lead is a useful or even a necessary tool.  If I attach a lead, what happens when they do suddenly feel pressure from it?  Does it create resistance, and panic?  When it’s a horse we’re talking about instead of a goat that question really matters.  I want my horses to know they can keep slack in the lead by softening into the feel.  They will know how to walk beside me as though they were at liberty, and I will also have this additional communication tool working for us.

One of the great draws of clicker training is the ease with which we can teach liberty work.  If you are training in a safe environment, you may never feel the need to put a lead on your animal.  My horses lived for years at a boarding barn where leads were required.  With so many people, and especially so many small children about, the rules said you had to have your horse on a lead any time you took him out of his stall.  When my horses moved to my own barn, the halters became stiff from lack of use.  We were all enjoying the camaraderie and freedom that living in a horse-safe environment created.  But there came a point where I bought Robin a new halter.  I loved the liberty work, but I missed the depth of subtle communication that the lead provides.

Shaping on a point of contact begins with safety.  There are times when we need the safety net a lead provides.  You can go this far, but no further.  That’s the constraint the lead provides.  It acts like a mobile fence.

This works for dogs as well as for horses.  Running into the street, pulling away to get to another dog, chasing after a cat can all be prevented with the “fence” a lead creates.  The reason to leave may be different, but the safety concerns are the same.

So in situations where the relationship and training may not yet be strong enough to keep an animal with you, the lead adds an extra layer of insurance.  The question then becomes have we taught our animal how to respond to the constraints of a lead?  Is it simply a case of resisting and discovering that there is no escape, that the only options are to give in and follow, or to have the pressure escalate?  That’s the kind of background many animals and handlers have come from.  For them leading is a poisoned tool.

The goats were learning through a different process.  I was setting up solvable puzzles. I’ve taken the slack out of the lead.  That’s the puzzle.  Now can you solve it?  Can you figure out which way to move to get your treat?  I begin in simple environments with few distractions and few reasons for them to want/need to leave me.  When one puzzle is solved, I present another.  Each success builds their confidence.  They know how to find the answer!  The constraint of the lead is no longer seen as an annoyance or a restriction.  It becomes a clue that helps them get to their reinforcement faster.  When that transformation occurs in their understanding, you have turned the lead into a wonderfully effective, clicker-compatible communication tool.

This kind of training expands options.  It creates freedom.  We often think of a lead as a tool that restricts.  But in this case it meant we could go more places.  Both goats were working well.  I finished the session feeling that it was time to expand their world.  Instead of opening the back door into the outside run, we’d open the front door of the stall and expand their universe of options into the barn aisle.  That would be the plan for day six of their training time with me.

P’s session ended with some soft scratching and back rubs.  I left them to do the remaining barn chores, and then I got the chair out and sat with them to wind down the evening.  They had fresh hay, but they preferred staying by me for head rubs, especially E who kept asking for more whenever I stopped.  He was so very sweet.  While I rubbed his jaw, he leaned on the arm rest and got dreamy eyed. They are delightful individuals to spend time with.

IMG_1592 both goats sleeping on platform

P on the left, E on the right, settling in for the night.

(Please Note: If you want to learn more about rope handling and shaping on a point of contact, please refer to my books, DVDs and on-line course, or come join me at a clinic.  Visit theclickercenter.com for more information.  I’ll also be teaching a lab on rope handling at this year’s Clicker Expos.)

The Goat Palace Journal – A Brief Update

“Don’t take score too soon” is also a good theme for the current Goat Palace sessions.  Another metaphor that applies is that of making clay bricks.  For each goat, over the last couple of days I’ve been working on the same lesson from one session to the next.  Pellias and Elyan have very similar lessons using multiple platforms to teach heeling positions.  Trixie is working in the hallway on her platform lessons.  Thanzi gets the whole back pen to work on leading.

I am building “clay bricks”.  In other words, I am accumulating a reinforcement history around a set of key behaviors.  When I have built enough “bricks”, I’ll be able to assemble them into a house.  The question is: will I be building a mud hut or a magnificent mansion?  Right now, if I tried to build something with the bricks, I’d get the mud hut.  Don’t take score too soon.  As long as we’re having fun and it looks as though we’re heading in a good direction, we’ll keep building these bricks.  These goats are so eager and so full of joy.  No matter what we end up creating, it will be built with laughter.

I’ll save a detailed account of what I am doing with them for another day.

Goats - Dreaming of Christmas.png

Remember to share the link to the Goat Diaries with your friends.

 

Please Note: if you are new to the Goat Diaries, these are a series of articles that are best read in order.  The first installment was posted on Oct. 2nd.  I suggest you begin there: https://theclickercenterblog.com/2017/10/02/   Two of the goats I write about originally came for a twelve day stay in July.  The July Goat Diaries track their training during this period.  In November these two goats, plus three others returned.  They will be with me through the winter.  The “Goat Palace” reports track their training.  I wish to thank Sister Mary Elizabeth from the Community of St. Mary in upstate NY for the generous loan of her beautiful cashmere goats.

 

Coming next: Day 6 – Staying Positive with Constructional Training

 

JOY FULL Horses: Understanding Extinction: Part 9

Eureka Moments: What is Insight?

Using resurgence – Insight
Yesterday I shared several PORTL games developed by Dr. Jesús Rosales-Ruiz.   The games deliberately used extinction.  What was observed was this: when you have been consistently reinforcing behaviors as you establish them in repertoire, and you then remove all reinforcement for them, you get a resurgence of these previously reinforced behaviors.  They reoccur in the order in which they were trained.  

When you instead extinguish the individual behaviors during the teaching phase, you get a different result.  The student will go back to the most recently learned behavior.  If that doesn’t work, he’ll go a little further back, and then a little further back.

In resurgence the behaviors occur in the order in which they were taught, so the oldest behavior in the cluster occurs first.

In regression the order reverses.  The most recently taught behavior reappears first.

So how does this help us?  How can we use this understanding to shape behavior?  To get the ideas rolling Jesús shared several video examples where resurgence was used to train complex, creative behaviors.

The first video came from Robert Epstein’s work. Epstein was B.F. Skinner’s last graduate student.  Together they were exploring the concept of “insight”.  How do we solve puzzles?  Are we truly creating something that has not existed before, or is creativity a product of combining known components to solve a novel puzzle?

Bird Brains
To explore this question Epstein taught a pigeon three component behaviors: pecking a banana, climbing on a box, and pushing the box towards a target.

The pigeon was then put into a chamber with the box and the banana.  The banana was hung up out of reach.  The pigeon couldn’t peck the banana, so an extinction process began. There was a resurgence of previously trained behaviors.  The pigeon was able to push the box under the banana, get up on the box, and peck the banana.

How did the pigeon solve this puzzle so quickly?  What is insight? What really is creativity?  Skinner and Epstein would say the pigeon could solve the problem because it had in its existing repertoire the necessary components.  Pigeons that had no experience pushing the box or jumping up on the box failed to solve the puzzle.

What is Creativity?
Jesús gives us a very process-oriented way thinking about this experiment.  This kind of complex puzzle solving was achieved through resurgence.  Set up the underlying components well, add in a bit of extinction, and “creativity” pops out.

If you leave out one of the components, the individual will struggle to solve the puzzle.  He will experience a much longer extinction process.  Macro extinction emotions will begin to surface, and you have to hope the subject has the persistence to become truly creative.

This is the kind of creativity that is truly stressful.  It’s much better to analyze the end goal – the complex behavior you want to train – break it down into all of it’s component tasks, and then train each of the components separately.  The result will be brilliant looking pigeons that solve in minutes what we might otherwise think would be an impossible puzzle for them.

Persistence
Jesús’ comment was there is “nothing new under the sun”. The behaviors you try are all built out of things you’ve done before.  All the components of what appears to be a novel behavior have been trained in the past. So let’s consider what happens when a group of people are presented with a challenging puzzle.  When they begin experimenting and find that the usual, familiar things aren’t working, some will give up quickly.

Others will persist.  They will experiment with novel combinations of what they already know, but again most will quit if they don’t come up with a solution fairly quickly .

A few will keep trying until they stumble across a novel combination that works.  We call these people inventors and creators because they are persistent enough to find these novel combinations.  The discovery process can be a painful one, but once the new combination has been found, it’s easy for everyone else to copy the results.

I can absolutely relate to this.  Give me a horse puzzle to solve, and I can be very persistent. My life experience has taught me that persistence pays off.  But put me in front of a computer that isn’t cooperating, and I shut down fast. There my experience has produced a different set of expectations. I’ve been in enough situations where errors in a software program have made a problem unsolvable, at least for my level of computer skills.  I don’t have the programing background that makes wrestling with a software issue fun.  Extinction has gone too far and been too uncomfortable.  So in one situation I can be very persistent and creative.  In another I’m the one going through the classic cycle of emotions that macro extinction produces.

I know first hand both how much fun the creative process can be when the expectation of success is there.  And I also know how painful and unpleasant the extinction process is when that expectation is missing.

What I want to create for my learners is a feeling of confidence.  Whether horse or human, I want them to KNOW they can solve whatever training puzzle I throw at them. Build this expectation in early before others have taught them hard lessons about failure, and you get brilliant, enthusiastic, joyful individuals.  They are the optimists of this world.  Whether horse or human, they are fun to be around.  That’s what an understanding of these concepts helps us to create.

Coming Next: Degrees of Freedom

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

JOY Full Horses: Understanding Extinction: Part 2

Yesterday’s post ended with a quote from Dr. Jesús Rosales-Ruiz: “If you don’t understand extinction, you won’t be able to master it.”  Today’s post will begin to unravel what that means.

Regression and Resurgence
I’ve talked about regression in previous posts.  Now we need to add in resurgence and the distinction between them.

In regression you revert back to previously extinguished behaviors.

In resurgence you revert back to previously reinforced behavior.

This isn’t just semantics.  According to Jesús regression and resurgence emerge out of different training strategies and produce different outcomes.

Regression can be defined as: “If the present behavior is not capable of getting reinforcement, one reverts to older forms of response which were once effective, but which have previously been extinguished.” The order in which this unfolds is significant.

Under stress you will revert to an older way of behaving.  If that behavior is not reinforced, you’ll go through another extinction process.  You’ll revert back to even older behaviors. You’ll keep trying things and trying things, until you either give up entirely, or you are pushed to creativity.  This can be a stressful process which is why some people equate creativity with an unpleasant experience.  If you were to suggest to them that they take a creative writing class, they would be running for the hills!  In their experience there’s nothing fun about being creative.  How very sad!

Extinction History
Regression emerges because a behavior which normally earns reinforcement is no longer working.  Often we think of extinction as simply a procedure that’s intended to reduce behavior.  You don’t like a dog’s barking so you never reinforce it in the hope that the behavior will go away.  This simplistic view misses an important key to understanding how to use extinction. A dog that isn’t barking is still doing something.  What is the “something” that takes the place of the barking?  The behaviors that emerge in an extinction process are not random. Understanding the order lets you master the process.

Jesús described extinction as the mirror image of reinforcement.

Extinction tells you what was reinforced in the past.

Reinforcement tells you what behaviors you are building for the future.

I wrote about this is previous posts.  (https://theclickercenterblog.com/2016/11/17/)  When you are first learning about clicker training, if your handling confuses the horse and puts him into an extinction process, you are revealing his past.   You may see his frustration expressed as pawing, pinned ears, even occasionally biting.  Don’t blame yourself for the outburst. You didn’t create the behavior you’re now dodging.  Turn your spotlight instead on his past.  That’s where the behavior was learned.

The Catalyst, Not the Cause
You may be the catalyst, but you are not the cause.  That’s good news. You don’t have to take his behavior personally. The cause sits not in the present, but in the past. It’s only natural to become worried by the emotional reaction you’re seeing. People sometimes inadvertently end up compounding the problem. If their handling skills are clumsy or they don’t yet know how to manage the environment, they can put the horse into even more of an extinction process.

I’ve seen this in beginner handlers.  They don’t yet understand how much a lack of clear criteria can impact a learner.  Everything starts out so wonderfully.  The horse gets clicked and reinforced for touching a target.   What fun!  But then the handler gets distracted.  She misses three or four clickable moments.  Those missed clicks can put the horse into an extinction process that leads to emotional outbursts. That’s where video cameras can be so useful. Video helps the handler see the training from the horse’s point of view.  It reveals the good tries he’s offering and helps the handler understand more clearly what needs to be reinforced.

The solution to the extinction puzzle lies in embracing clicker training.  Through clicker training you’ll be building a repertoire of behaviors that gives the horse alternatives to his old patterns. Instead of reverting back to behaviors you don’t want, now the extinction process will be popping out behaviors you’ve planted, behaviors you like and that you can reinforce.  Suddenly, you aren’t in an extinction process anymore.  You’re back on track with high rates of reinforcement.

This will take bit more unraveling of the extinction puzzle to understand.

Coming Next: Extinction Reveals the Past

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com