The Goat Diaries – Day 3: Arrange the Environment for Success

The Goat Palace – Journal Report for 11/19/17: You Never Know What You Have Taught

Galahad had the first session of the day.  He’s an eager, happy learner, and he very much chose to go into the far end to play.  I stayed for a few minutes down in the front section visiting with the other goats. Elyan and Pellias were up on the top platform of the jungle gym.  They were eager for head scratches. Surprisingly, so was Thanzi.

By the time I extracted myself from their appeal for more, Marla had already begun Galahad’s session.  She commented that what she thought she had taught him was not what he had learned.  Ah yes, that’s the clinic mantra: You never know what you have taught.  You only know what you have presented.  Yesterday he had been going to his target, click, followed by Marla dropping a treat in one of the food buckets.  He went promptly to the bucket, got his treat, and then touched the target again. Marla would then drop his treat in a second bucket, so he was going back and forth between buckets with a quick stop in between to touch the target.

His takeaway from that was just to go from bucket to bucket – never mind touching the target.  It reminded me of the table games that we play to learn about training and to work out procedures for teaching concepts.

Training game

Playing the table game during the Five Go To Sea Caribbean conference cruise.  I’m hiding from the sun under the funny hat.  Kay Laurence is sitting behind us.

Kay Laurence is the originator of these games. Several years ago we were together at an airport, both with long waits for our flights home.  So we found a quiet corner and pulled out a table game kit.  I was the learner, something when I’m teaching I rarely get to be, so that was a treat.  Kay had a plan in mind for teaching me to use the pieces from the game to draw a pentagon.  Of course, I had no idea what she had in mind.  But I was a contented learner because I was making lots of correct choices and getting clicked and reinforced  at a high rate.  The only problem was the rules I was using to produce the actions she was reinforcing were not the same rules Kay was trying to teach.  So I was coming up with the right answer but for the wrong (from Kay’s perspective) reason.

Every time Kay presented me with a puzzle moment I got stuck.  Puzzle moments are small tests to check to see if what you think you are teaching is what your learner is learning.  It was a fascinating and fun experience, though it could easily have been a frustrating experience if either of us had brought a different mind set to the game.

My flight was coming up, so we had to end the game.  Kay explained what she wanted me to do.  My reaction to being told the “answer” was interesting.  I felt deflated.  I wanted to go on and work through the puzzle.  Being told the answer was far less satisfying than discovering the answer on my own.  I missed the puzzle solving, and I missed seeing what strategies Kay would have used to get things sorted out. But my plane wasn’t going to wait for us to finish the game, so we had to jump straight to the final answer.

Galahad had come up with a solution to the puzzle that made total sense to him.  Go from bucket to bucket and expect your person to drop a treat in when you get there.  He had completely by-passed the target.

Watching him, I also didn’t think he was noticing Marla’s tongue click. With horses I suggest that people begin with an actual clicker.  The sharp sound that a box clicker makes is very noticeable, and the horses seem to catch on fast to the significance of the sound.  After a couple of targeting sessions with the clicker, you can switch to a tongue click, and the horses are very aware of the new marker signal.

I suggested to Marla that she get an actual clicker.  At the stage where you’re using target sticks, clickers are easy to use. You can duct tape a box clicker onto the end of the target stick so you have easy access to the clicker.

Marla got a box clicker and continued on with the lesson.  Galahad quickly remembered that he was supposed to touch the target. Yesterday’s fluid pattern was back. Now it was: orient to the target, click, go to the indicated food bucket for a treat, look for the target. A clean loop was reappearing.

This experience highlights another part of the start-up process.  I like to begin with very short sessions.  With horses I have people count out twenty treats.  That means handlers who are new to this process have to stop frequently to reload their pockets. This also gives them time to think about what has just occurred and to consider what, if any, changes need to be made.

With five goats to juggle I was certainly finding I needed to do a lot of adjusting.  It wasn’t just what was happening with the individual I was focusing on.  What was going on with the other goats?  When I had Pellias out by himself, he was having a grand time, but how stressed was Elyan?  Was he being chased by Thanzi?  Yes.  When I took Thanzi out, was Trixie able to cope?  There was a lot to think about, a lot to keep shifting around to find the right training combinations.

Keeping your initial training sessions short lets you check in with your animals more frequently to see what they are actually learning. Each time you go back in and start up the session, you get to see what’s been processed from the previous session. If your learner has come up with a different answer, these short sessions mean it hasn’t become so entrenched that it is now hard to shift the pattern.

It is ironic that I am writing about short sessions, because I am known for using long training sessions. With an established learner I’ll fill my pockets with treats and keep going. That seems to suit the learning style of horses, but these long sessions are broken up into smaller units. I give breaks through the behaviors I’ve taught. For example, I might be working on lateral flexions. We’ll have a bit of success, then it’s off to find a mat. The mat acts both as a conditioned reinforcer and a way to give a break. The change in the rhythm of the training provides a break without having to stop the play.

At the heart of this is the training principle: for every exercise you teach there is an opposite exercise you must teach to keep things in balance.

The balance that I thought was needed now for the other goats was a morning session of quiet visiting.  I was very pleased that Thanzi wanted to participate in some head scratching.  I had the two ladies in the back section so the three youngsters could relax and not worry about dodging out of Thanzi’s way.  She stayed by the gate while I scratched her head.  Normally, she’s been drawing away when I try to touch her, so I consider this real progress.  Trixie came up to me repeatedly through the morning, but she’s not yet ready for a proper scratch.  The boys, on the other hand, had a blissful time enjoying a prolonged cuddle session.

Afterwards, Marla and I worked some more on the Goat Palace.  We’re getting close to the finish line, but there always seem to be a few more things to do.  Years ago my family did some remodeling to the house.  The process dragged on and on.  Every day my father would make a list of things that the builders still needed to get done before he could sign off on the job.  He remarked that they always seemed to get done only half the remaining jobs.  You would think on a finite project like that, you would be able to check everything off the list, but it never seemed to happen.

At the moment we seem to be caught in that twilight zone of always completing just half the remaining tasks.  One of yesterday’s tasks was tidying up the section we’ve designated for storage.  I was very pleased to see how little we have left to store.  We have managed to use up an amazing amount of miscellaneous clutter.  So perhaps when we run out of stuff to find a use for, we will also run out of tasks that still need to be done. That will finish off phase one of the goat palace.  (I say phase one because phase two is obviously going to be expanding the goat jungle gym. That will be as much for our entertainment as it will be for theirs.)

One of the things that contributed to the tidying up of the storage area was the snow blower went out to be serviced for the winter.  That left a clear area that could be used for training.  So in the early evening I took advantage of this space to work with Elyan and Pellias.  It was a good time for training.  The goats were beginning to settle down for the night.  It was easy to close the middle gate so only Pellias and Elyan were in the front section.

I had everything set up for them out in the storage area.  I had my chair, a food bucket and a couple of platforms, including the very distinctive foam platform I had introduced them to in July.

Elyan came out first.  I brought him out on a lead, and then turned him loose.  He stayed nearby.  He was clearly interested in playing, but he wasn’t sure what to do.  I let him explore for a couple of minutes, then I brought out the baton and directed him towards the foam platform.  He hopped up onto it, click, I dropped the treat into the bucket.  He had to step down from the platform to get to the bucket.  So now the question was what would he do?  The answer was he backed up to get back on the platform. Click! Drop treats in the food bucket.

Elyan seemed to catch on fast.  The “rule” was get back to the platform, and you’ll get clicked.  At least that’s what was happening.  His “rule” might just as easily have been: back up, and you’ll get clicked. The platform was just in the path of the backing. I’ll need to have a puzzle moment to check whether he is going to the platform or simply backing up.

In any case, while he was getting his treat, I nudged the platform a little further away.  He continued to back himself onto the the platform.  We could have kept going all night, but this was a session that should be kept short.  I got up from my chair, and he followed me back in to the front section.

Pellias was eating hay.  He hadn’t been at all fussed having his brother outside the pen.  But now I wanted to do a swap, and they were both at the gate.  I got Pellias out and sat down in my chair.  He went straight to the platform.  Click.  I dropped treats in the bucket.  He stepped off the platform, got his treat and went straight back to the platform.  I repeated this a couple of times, and then I exclaimed; “Wait a minute.  You’re not Pellias!” In the fading light I hadn’t noticed that little Elyan had pushed past his brother for a second turn.  With his jacket on to keep his coat clean, it was harder to tell them apart. No wonder he was so good!

I got them switched around so now it truly was Pellias’ turn.  He’s always been a platform superstar.  He went straight to the foam platform.  Click.  But now the food delivery was different.  He’s used to getting the treat from my hand, not a food bucket.  I moved the bucket close to the platform and helped him find the hay stretcher pellet.  He got his treat and then stepped off the platform. He wandered away from the platform. I waited.  He began to eat the leaves that we hadn’t swept out of this area.  I got out my baton target and gave it a little shake.  That got his attention.  He followed it to the platform, click, drop the treat.

The hay stretchers make a very sharp noise as they fall into the bucket.  That helped draw Pellias’ attention, and he began to look in the bucket for his treat.  He only had to take his front feet off the platform to get to the bucket, so it was easy for him to step back onto it and get clicked.  My concern was the sound of the treat dropping into the bucket might become the functional marker signal, so I clicked, and began to wait to see him react to the click before I made any move to drop the treat into his bucket.  I got lucky several times with that.  He had turned on the platform so he could look down the driveway.  The sound of my tongue click turned him around, so it was clear, at least in this situation, that he was responding to the sound of the click.

Again, I kept the session short.  When I opened the gate to let him back in, I dropped treats on the floor to distract Elyan.  Pellias came in to get the treats, as well.  I’m not sure I want the others out in this area yet, but for these two their July visit prepared them well for going outside of their pen.

I filled their hay feeders, opened the middle gate and left the goats tucked in for the night.

Today’s July Goat Diary appropriately enough continues with the initial training of platforms.

The July Goat Diaries: Clicker Training Day 3: Arrange The Environment for Success

I described earlier the morning sessions of day three in which I introduced both goats to platforms.  This was an errand day so I wasn’t able to fit in as many sessions as usual. When I got back to the barn around 5, E and P were clearly hungry. They were standing on a bed of hay, but none of it was to their liking. I gave them fresh hay and left them to eat while I did barn chores.

7 pm session with P

P was very rambunctious – literally. He reared up several times. I managed to dodge him and get him on the platform, but the session didn’t feel very productive.

I wasn’t satisfied with the way he was orienting to the target. I thought a second platform might help. If a platform was the end destination, it might make more sense to him why he was following a target. I decided to consider this a data collecting session.  I knew where I needed to head, but I would wait until tomorrow to add the second platform.  Training success depends very much upon having a good set-up.  I suspected adding the second platform would help smooth things out.  Instead of continuing on with a session that wasn’t going well, I would wait until I had a better set up.

In contrast to P, E’s session was great. He was so very soft and sweet. I had him target the baton, click, treat. Then I scratched him around his ears. His eyes got soft, and he leaned into my hand, clearly enjoying the feel. I asked him to follow the target again, click, treat, scratch.  Who knows what E was learning.  I certainly found it very reinforcing!  I began his day with bliss, and that’s how I ended it.

The password to open this video is: GoatDiariesDay 3 E Learns

Note: When I was in town, I stopped at the new bird store that’s just opened.  I bought some black sunflower seeds which the goats really like. So now they are getting a mix of sunflower seeds, peanuts and hay stretcher pellets.

8 pm final session of the day.

We ended the evening with “cuddle time”.  While Ann groomed Fengur, I took my chair into the stall and enjoyed a few minutes of goat bliss.

Coming Next: Clicker Training Day 4

Please Note: if you are new to the Goat Diaries, these are a series of articles that are best read in order.  The first installment was posted on Oct. 2nd.  I suggest you begin there: https://theclickercenterblog.com/2017/10/02/ 

JOY FULL Horses: Understanding Extinction: Part 11

Being Emotional Is Being Alive
In the previous section we looked at degrees of freedom.  We often assume that someone who is at the top of their chosen profession must also be emotionally at the top of the world.  How can this successful actor or professional sports hero be anything but happy?  And yet we hear over and over again how miserably unhappy these people often are.

Degrees of freedom help us understand this paradox.  If you have become “The Expert” because that’s all you can do, you may well feel trapped and isolated.  Emotional  labels become attached to these extreme conditions.  You’ll describe yourself as being depressed, frustrated, anxious, unhappy.

Dr. Jesús Rosales-Ruiz offered us another gem, a reminder, from his discussion of regression and resurgence.  Often when people talk about “emotional behavior” such as aggression, they are forgetting that we are always emotional. It isn’t that now we are happy, and then a switch turns off and we feel nothing.

“Living is being emotional.”

The nature and intensity of the emotions fluctuates.  We experience different degrees depending upon conditions and our reinforcement history.  But thinking in terms of “emotional behavior” is too simplistic. Emotion is part of all behavior. It is not separate from it.

Traveling helps you to understand how much our emotions are a product of the habit patterns that have formed within our familiar environments and how true it is that emotions are always present. Perhaps you are one of the huge number of people who have more to do than you could possibly accomplish in one day. You have a family to care for, a house and barn to maintain, horses to feed and clean up after – not to mention ride.  All that and then there’s also an overfull schedule at work.  You’re always under stress, but it’s become so the norm, you don’t pay much attention to how you’re feeling.  A mildly stressed state is just the normal emotional background “noise”.

And then you treat yourself to the Five Go To Sea cruise where everything is different.  You still have a full day, with more to do and see than any one person could possibly squeeze into a day, but your normal triggers aren’t there.  The phone isn’t ringing.  You aren’t on the internet with the constant influx of work-related emails.  Your co-worker’s voice coming through the office wall isn’t annoying you.  All those triggers are gone and now you get to experience who you are and how you feel without them.  You become acutely aware of just how stressed you’ve been now that you’ve stepped out of your normal habit patterns. You’re still emotional, but now the environment is set up to trigger the kinds of supportive, pleasant emotions you want to experience.

So the next time you find yourself saying that your horse, your dog, your fellow human is being emotional, remind yourself that that’s an ever present condition.  “Living is being emotional.”  The question is, how can you influence conditions so the emotions that support a JOY FULL experience are the ones coming to the fore?

Coming Next: Building Unlikely Behaviors with Resurgence

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

JOY FULL Horses: Resurgence and Regression

Reverting to Past Behaviors
Imagine you have joined us for the Five Go To Sea conference cruise.  You have just come from breakfast which you enjoyed on a terrace overlooking the open waters of the Carribbean.  You have now settled yourself comfortably in the Reflection’s conference room to listen to Dr. Jesús Rosales-Ruiz’s lecture on resurgence and regression.

Jesús began by sharing the story of a professor who was attending a conference in Mexico.  She got trapped in an elevator.  At first she tried pushing all the buttons, calling out for help, things we would all think to do.  Two hours later, when they finally got the elevator working again and the doors open, they found her huddled in the corner of the elevator calling for her mother – and her mother had been dead for years.

What does this story tell us?  We regress in predictable patterns that reveals our history.

When a behavior that was being reinforced no longer works, you enter an extinction process in which you regress back to previously learned behavior.  When the first behaviors you try don’t work, you go back another step and then another.

As Jesús said, very tongue in cheek, during the extinction process we see behavior that was modeled for us in our childhood.  If you want to learn about someone’s early family dynamics, watch what happens to them when they are under stress.  If one of his students is acting out, he tells them – “Don’t blame me.  Blame your parents.  You’re simply presenting behavior that was modeled for you in childhood.”

So extinction can reveal history.  That’s definitely a gem to take away from our Caribbean treasure trove and carry back to our horses.

Extinction Reveals Your Horse’s Past
When a horse is first learning about clicker training, much of what he knows no longer applies.  You’re holding a target up for him to touch.  A lot of horses figure out quickly how the game is played, but some get confused.  Suppose you’re working with a horse you recently adopted from a horse rescue.  He isn’t sure what he’s supposed to do. Consider the dilemma he finds himself in.  You only mean well, but he doesn’t know that.  Past experience has told him wrong answers get punished, but the few things he knows how to do aren’t working.   He is plunging head long into an extinction process.

The extinction process can reveal a horse’s training history. It helps us to understand the “childhood” our horses have had.  Did your horse have a fair introduction to people, or are there issues you need to know about?

In most cases when you introduce a horse to the clicker, it’s smooth sailing.  The horse quickly figures out the game. You may have to go through a little bit of explaining around the food, but for most horses this moves along without any major hiccups.  You hold a target up, he investigates it, click, you give him a treat.  Easy.  Unless he’s one of those horses who has been punished for showing any self-expression.

If your horse has learned that being “well behaved” means he doesn’t offer any behavior you haven’t asked for, he’ll be good at following orders, but not taking the initiative. In fact your “well-behaved” horse may have learned that offering behavior is dangerous.  The best way to avoid punishment is to wait to be told what to do.

This is why I put well-behaved in quotes. Is he well mannered in the way a clicker-trained horse can be? Or is he simply not offering much in the way of behavior? There’s a huge difference.  In the first, the personality is expressed. In the later, it is suppressed.

When you hold out the target, a suppressed horse may be stuck for answers.  He doesn’t know what you want.  The “right answers” that normally work don’t seem to apply in this new situation.  This horse finds himself in a difficult position.  He knows he’s supposed to do something, but past experience tells him if he guesses wrong, he’ll be punished.  He’s not sure what the answer is so he’s plunged into an extinction process.

Extinction follows a predictable pattern.  At first he may try offering the one or two things that might possibly fit this situation.  When those don’t work, he’ll shift rapidly from feeling frustrated and worried to being aggressive. That’s the next, predictable stage in the extinction process.  Your “well behaved” horse is suddenly coming at you with teeth bared.

It’s easy to blame clicker training or the treats for this sudden turnaround in behavior, but I’ve always seen it very differently. I’ve always said that what is happening is the training history of the horse is being revealed.  Jesús’ presentation on resurgence and regression confirmed this.  It helped me understand even more clearly this dynamic. Sadly, there are all too many horses who have been at the receiving end of excessive punishment.  Often you don’t know which is the horse who really is sweet and well behaved, and which is shut down through punishment.  This is one of the reasons I put so much structure around the beginning steps of clicker training.  The support of these lessons helps insulate the punished horses from their history.

Well Behaved or Shut Down?
Often what we refer to as “well behaved” horses (and people) are really individuals whose behavior and personality have been shut down through the use of corrections. They have learned to wait to be told what to do.  Offering behavior, and expressing their personality has been punished.  Give them a command, and they will respond promptly.  They can seem like such perfect horses.  Safe, easy to direct. But put them into a situation where they don’t know the answer – in fact they really don’t even understand the question – and you will begin to see things unravel.  As the extinction process unfolds, they will take you back through the stair steps of how they have been treated, and often the story they tell is not a pretty one.

Clicker training did not cause these outbursts.  When these horses are not sure of the “safe” answer, they’ll began to regress back through their training history. You are seeing the behavior that others “swept under the carpet” by suppressing it with punishment.

When you are brand new to clicker training, and, especially if you are also new to horses, this can be a hard dynamic to understand.  What you hear about clicker training is how much fun it is, how much horses enjoy it.  So you give it a try.  But instead of smooth sailing, your horse falls apart.  Instead of having a wonderful time, you’re dodging teeth.

You’ve been promised a dream horse and all you have is a nightmare. How could you not blame clicker training?  But just as equally, how can you go back? How can you return to the use of punishment to suppress the behavior you’re now dealing with?

You keep hearing from others that you need to trust the process.  That can seem like a hard choice, especially when you don’t really understand what the process is, but what other choice is there?  You don’t want to go back to your correction-based training, so you plunge ahead, clicker in hand.

Coming Next: Leaving History Behind

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

JOY FULL Horses Part 3: How Clicker Trainers Play

Five Go To Sea
If someone had asked me a few years back what the likelihood was of ever finding me on a cruise ship, I would have said you had a better chance of winning the lottery – the real one, not the kind I described in the last section.  But in the spring of 2014 that’s exactly where I was.  Kay Laurence had decided to celebrate her sixtieth birthday in style.  She was going on a Caribbean cruise, but not just any cruise.  She invited Ken Rameriz, Dr. Jesús Rosales Ruiz, and myself to join her on a Five Go To Sea conference/cruise/adventure.   I’m really not sure what to call it, so I’ll just settle for amazing!  That describes it the best.

I’m sure you’ve done the math.  Kay, Ken, Jesús and myself make four not five.  Number five were all the other conference attendees.

Before I plunge into describing the conference and all that we learned, let me set the stage by describing the ship we were on.  Prior to going on the cruise, I didn’t know what to expect.  I knew cruise ships were enormous, but this ship dwarfed anything I had imagined.  I looked up it’s dimensions.  It was 127 feet wide and 1047 feet long. Some people think in terms of football fields.  I translate dimensions into riding arenas.  The ship was twice the width of my indoor arena and more than eight times as long!

Now take those dimensions and stack up 14 floors of guest accommodations, restaurants, theaters, pools, meeting rooms, dance floors, lounges, spas and all the other amenities a cruise ship has to offer, and you’ll begin to get a sense of the size of the ship.  And however big it was from the ground floor up, there was that much again below to accommodate the crew, kitchens, engines, fuel, water, food storage and everything else that it takes to provide for well over 4,000 people. My barn looks like a big building sitting by itself on the side of a hill, but it would be easily swallowed up inside the belly of this ship.

celebrity-reflection

Most of the 4,000 people who were vacationing on the ship were there for the spas, the theaters and all the other guest amenities.  And then there was this rather odd group of clicker trainers who completely baffled the staff.  We weren’t sleeping in after a night of partying.  Instead we were getting up at the crack of dawn to meet up for a morning t’ai chi and body awareness session.  Instead of lounging for hours at a time by the pool or gambling in the ship’s casino, we spent the days at sea in the conference room.  That was our idea of fun!

“Riding” the Ocean
I know heading into the cruise many of the conference attendees were concerned about being seasick. I can now tell you that yes, you do feel the pitch and roll of the ocean. Was anyone sea sick? On the first day some people were definitely feeling a bit queasy. Experienced travelers like Ken Ramirez had taken precautions and were wearing motion sickness patches.

What did I experience? I can now say that I loved being out on the open ocean. Was the rolling of the ship fun?  Absolutely! I loved it!  It felt like riding!  I might have a different tale to tell if we’d been crossing the north Atlantic in a winter gale, but I loved the rolling of the ship.  When you ride, you let the motion of the horse take you.  It’s not about blocking the energy or keeping yourself rigid. You let your joints follow the forward and up of the horse’s back. The ship was like that.

There’s an exercise I teach called the “four points on the bottom of your feet”. It’s a Feldenkrais exercise.  You begin by noticing how you move, how you shift your balance as you roll around the four points on the bottom of your feet (inside toe, outside toe, outside heel, inside heel).  How do you shift your balance forward and back, side to side? How do you send and receive these shifts in balance?

In the “Four Points” exercise you are asking yourself:  Where does the movement begin?  Where does it stop? What blocks it?  What could I release, what could I find that would let me flow more easily around the four points on the bottom of my feet?

The roll of the ship let me explore those questions.  I loved the feel.  The ship would pitch to the side, and I would roll with it, catching my balance at the top of the swell and rolling down with it.  I kept thinking how boring it was going to be to be back on land that didn’t roll and sway under my feet.  I loved “riding” the ship.

I suspect the people who were feeling a little “green around the gills” were wishing I would stop grinning like a Cheshire cat each time the ship pitched up over a wave. There’s nothing so annoying as someone who is having a good time when you’re feeling miserable – especially when what is making you feel sick is the very thing they are laughing about.

I do think it is a great example of how we create our own reality.  I went into the cruise expecting to have a great adventure.  I could have stiffened against the pitch of the ship and made myself miserably sick.  Instead I flowed with it and had a grand time “riding”.

I love exploring balance.  On that first day at sea I had a hard time staying balanced.  I could roll around the four points just fine, but I couldn’t stand with my feet together.  I had to keep stepping out wider to catch my balance. There was also no walking a straight line down the endlessly long corridors of the ship.  I swayed from wall to wall looking like I’d just downed a bottle of Caribbean rum.   But a couple of days later, not only could I stand feet together, so could everyone else. I led the group through the beginning steps of learning to stand balanced over your feet.  On day one this would have been a challenge for all of us.  But on day three of the conference everyone had gained sea legs.

The Conference
We do create our own reality.  Kay Laurence discovered she likes cruises, so she created a conference cruise to celebrate her 60th birthday.  She designed a conference like no other.  We had overall themes for each day, but we weren’t tied to particular presentations.

Normally at conferences the organizers want to know what you’re going to talk about months ahead of the event.  I understand their perspective.  They need to advertise the event, but eight months out I don’t know what is going to be inspiring me.

I much preferred Kay’s approach.  Creativity comes from combining familiar elements in new ways.  All four of us had heard each other speak before.  We were familiar with the material that was going to be presented, but in the format of this conference we had so much more time for conversation and discussion.  We could expand on ideas presented and adjust our choice of presentations to follow up on topics that were of interest.  That meant the impact of the presentations went beyond that of most conferences.

What emerged from those talks was a true Caribbean treasure trove.  If you asked each of the participants who went on the Five Go To Sea cruise what the highlight of the trip was, I’m sure you would get dozens of different answers.  For some it might be an adventure they had on one of the excursion days. For others it might be a dinner time conversation with one of the speakers. For me I would say the cornerstone of the event was Dr. Jesús Rosales Ruiz’s talk on resurgence.  In the previous unit I talked about Kay Laurence’s microshaping.  This is very much linked to the concepts Jesús introduced us to in his talk.

Kay wants a 98% or higher success rate.  To get to that you need to thin slice your criteria.  If you’re sloppy, if you’re waiting for your animal to offer behavior, you will end up with a hodgepodge of clicks.  You’ll miss clickable behaviors.  You’ll click for a head turn this time and a foot lift the next.  Kay calls this dirty shaping.

For both Kay and myself clean, elegant shaping evolves out of microshaping.

Reaction Patterns
Micro.  That’s always been the direction I’ve looked.  Remember Dr. Susan Friedman’s phrase – level of analysis.  (https://theclickercenterblog.com/2016/09/16/) She talks about that in reference to the focus someone has.  If you are looking through a Caribbean pirate’s spy glass, are you focused on the distant horizon or the bird that’s skimming across the water just a few feet out from your ship?   When you consider why a certain behavior is occurring, are you trying to figure out what part of the brain is activating and what individual neurons are firing?   Or are you looking at observable events that surround the behavior which might be effecting the frequency of it’s occurrence?

Levels of focus very much relate to training.  You can go macro and be outcome driven and send your horse directly over fences.  If you and your horse are bold and athletic enough, you’ll be successful.

Alternatively, you can go micro and look at the reaction patterns that will allow you to jump those fences successfully.  (I discussed reaction patterns in the previous post.)

going-micor-textGoing macro prematurely can lead to crashes.  Going micro will produce the macro outcomes without seeming to work on them directly.

Most of us have been told that we need to walk, trot, and canter our horses in both directions every day for training to advance.  But if your horse is out of balance in the faster gaits, practicing them just makes the balance problems more entrenched.

There’s a lovely expression that sits at the core of my training:
“The walk is the mother of all gaits.”

What this means is you can focus on the underlying reaction patterns that lead to great balance in all three gaits without needing to go out of the walk.  When you do ask for the trot or canter after a hiatus from these gaits, it will feel as though you have a completely different horse under you.

Extinction
Going micro gives us something else.  It allows us to transform the make-it-happen force and violence of traditional horse training into clicker-compatible good technique.  It is this transformation that makes true play between horses and humans possible.

To get there we need to look at extinction and the role it plays in shaping.  To help us we’re going to return to the Five Go To Sea cruise and sit in on the lecture Dr. Jesús Rosales-Ruis gave on Extinction and Resurgence.

So get out your notebook, pull up a chair and join us on the cruise.  You’re about to be treated to a gem of a lecture.

Coming Next: Resurgence and Regression

P.S.: We so enjoyed the conference cruises that Kay came up with yet another innovation: a land cruise. We had our first Training Thoughtfully Land Cruise in the UK in January 2016.  In 2017 we will be holding our second.  This one will be October, 20-22, 2017 in Milwaukee WI.

If you are thinking Milwaukee seems an unlikely place for a land cruise, one of the reasons for picking the locations is Kay and I want to use these conferences to provide a stage for local talent.  People often feel that there is no one close to them they can go to for help.  These conferences will help connect people to their local training resources.  At this conference two of my Click That Teaches coaches, Jen Digate and Natalie Zielinski, will be presenting, along with several dog trainers Kay knows.  All of them are local to the Milwaukee area.

Anticipation is a wonderful thing.  If you are reading this in November 2016, there is currently an early bird special available for the conference registration.  Visit trainingthoughtfullymilwaukee.com for full details.

Remember, if you are new to the JOY Full Horse blog, click on the JOY Full Horses tab at the top of this page to find the full table of contents and links to each of the articles I have published so far.

I hope you will want to share these articles by sending links to this blog to your friends.  But please remember this is copyrighted material.  All rights are reserved. Please do not copy any of the “JOY Full Horses” articles without first getting written permission from Alexandra  Kurland, via theclickercenter.com

Also note: these articles are not intended as an instruction guide for introducing your horse to clicker training.  If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

A Summer of Adventures!

scenery whales conference horses

Labor Day weekend seems like a good time to post this report on the Five Go To Sea conference and the August clinics. It’s taken me a while to put it together.  The problem with heading off on a summer of adventures is at some point you come bumping back into reality.  That happened to me when I returned from three weeks of travel.  I got home to find the hot water heater in my house was leaking and the tank was sizzling ominously.  I turned off everything I could find that was even remotely connected to the hot water tank and headed off to spend the night at the barn.  Thursday got the hot water tank replaced.  Friday a repair man came to fix the snowblower that wouldn’t start last winter.  I know the first snowfall is still a fair way off, but waiting until November to get it fixed is a bad idea.  Just to round things out, I also took my aged truck in for servicing.  I was learning that these machines have one thing in common with our brains.  They all operate under a use it or lose it principle.

Our brains thrive on novelty and that was certainly provided by the Five Go To Sea conference cruise.  The first cruise took us to the Caribbean. This year we sailed up the Alaska coastline.  The route the ship took was through what is referred to as the inner passage.map with caption
It travels between islands and through spectacular fjords so it doesn’t matter where you are on the ship, there is always something breathtaking to look at.  Our conference room had floor to ceiling windows so we didn’t miss out by being in a conference.   By the end of the first day, I think we were all in agreement that every conference from now on should provide a similar spectacular backdrop.  It certainly gave us some memorable conference moments.conference attendees 3

One such moment occurred during a presentation Kay was giving on PORTL, a training table game.  Kay was in the middle of a demonstration.  She was working with one of the conference attendees showing everyone how to get the game started.  Her learner made an unexpected move that Kay had not planned for.  Kay began to talk about these “oh, oops” moments.  Do you have a strategy in place to deal with this kind of situation?  How do you move on without confusing or frustrating your learner?  She had barely posed the question when one of our keen spotters cried “whale!” and everyone, Kay included, rushed to the windows.  Apparently, that’s what you do.  By the time we returned to the game the sticky moment was completely forgotten!

whale watching during conferenceIt helps to bring along your own naturalist on these cruises.  Ken Ramirez isn’t just a first class trainer.  Not surprisingly, he’s also an expert whale spotter, and he could tell us what we were looking at based on the size and shape of a quickly glanced spout.  My first whale sightings were just that.  A fleeting glimpse of a very distant spout.  But in Juneau I joined four of the conference participants for a whale watching tour.  In addition to seeing some spectacular scenery, we had close up views of hump back whales.

whale watching collageOther trip highlights included a hike through the coastal rainforest.  I’m not sure what I was expecting, but it wasn’t this.  Moss covered trees created a magical landscape.  I spotted a large hole disappearing under the roots of one massive tree.  “What would live in there?” I asked our guide.  She gave me a general answer, running down the list of small mammals that inhabit these forests.  What she left off her list were elves, brownies and fairies.  In a woods like this they were just as likely to be the inhabitants of this hidden cavity as any martin or rabbit.

giant tree with caption

nurse tree with caption2

At Skagway I boarded a train that followed the route the “Stampeders” took in the late 1800s on their journey to the Yukon in search of gold.  You have to wonder at the mass insanity that overtakes people.  Riding in the comfort of an old-fashioned train, I could marvel at the beauty of deep river gorges.  But if I had to carry a year’s worth of supplies up these same mountains, would I have thought they were beautiful?  The train was built in 1898 to carry the Stampeders to the gold fields of the Yukon.  Today it brings gold in the form of tourist dollars into the area.

railroad 4 photos tain picturestrain follows same routeminers narrow trail 2ghost bridge 2climing into the clouds 2The train passes through a section of trail called “Dead Horse Pass”.  It’s estimated that over three thousand horses and mules died along this stretch of trail.  Ignorance was the culprit.  The shop assistants and mill workers who were racing to the gold fields knew nothing about how to balance a pack.  They didn’t even really know where the Yukon was or what kind of conditions they were heading into.  Pictures taken of them in San Francisco before they headed north to the gold fields showed prospectors posing in front of painted mountain scenes with palm trees in the foreground!  But it wasn’t palm trees that they encountered as they drove their over packed horses up the White Pass Summit.

I thought of these horses as the train passed through this section of the trail.  I think of them now as I write this in my barn where my very pampered horses get to live a life of great comfort.  Perhaps it balances the scale just a little.  Throughout our history with horses we have a lot to answer for.

We met a very different kind of horse in the Butchart Garden in Victoria, British Columbia.  Along with a delightful giraffe, a camel, an ostrich, a reindeer, and a large cat with a salmon in its mouth, the horses pranced around an old-fashioned Carousel.  We wanted to ride them all, so we ended up taking several turns on the Carousel.  I rode a rabbit and, in honor of Kay, a large white dog.  One of us should have ridden the Orca, but we were running out of time.  The garden closed at nine, and we didn’t want to miss the bus that would take us back to the ship.carousel butchart 2

Did I mention that we also spent our days at sea in the conference room?  Ken treated us to an update on the training he’s been doing teaching dogs to count.  I had requested that for the day that I organized.  The results of his experiment are impressive, but what I particularly wanted him to include were the preliminary steps he goes through to design a good training set up.

So many of us simply jump straight into training.  We find out too late that we can’t really manage our props, that our set up is clumsy, and we haven’t given any thought to all the things that can – and now are going wrong. Ken showed how a bit of training practice without any dogs revealed some major issues in his original set up.  He also showed his clumsy first attempt when he was still evolving the best training procedure to use.  He refers to this as exploratory training.  What do you need to change before you begin the real task of training and data collection?

Ken is such a skilled and creative trainer, it was good to see things going wrong for him in this early phase of the training.  This isn’t to gloat but to understand that this planning phase is part of good training.

He also shared with us his recent foray into butterfly training.  He couldn’t show us any video, but his detailed description of the training process was a definite trip highlight.  I don’t know which surprised us more – that butterflies could be trained or that butterflies could be bullies.

Kay focused much of her time on the training game, PORTL.  She divided people up into groups of three: a learner, a teacher and a coach.  The first tasks were fairly simple.  The teacher was to introduce the learner to the game.  Kay instructed them to plan thoroughly before they brought in their learner.  What were they going to do if their learner did something unexpected, if there was a bad click, if they got stuck and needed to consult with the coach?Portl planning session 2With Ken’s emphasis the day before on planning the teachers and coaches took this training prep very seriously.  Normally people rush through this part of the process.  They jump right in with their learners and then don’t have any plan for dealing with the unexpected.  You see that kind of approach creating a lot of frustration on both sides of the table.kay coaching Portl planning sessionNot so with this group.  More than half an hour went by and none of the learners had been called in.  The teachers and coaches were still engaged in careful planning.  The poor learners weren’t sure what they were supposed to do.  No one had anticipated this contingency – that the prep would be so very comprehensive.  The advantage of being on a cruise ship is we could send them off to get a drink or to whale watch while the rest of their team planned out their training strategy.

break time at the conferenceWe learned from this experience.  On the last day of the conference we again played PORTL.  This time Kay set more challenging tasks which definitely required some planning time.  I took the “learners” through some body awareness/training exercises.  That produced some interesting results.  When the teachers came to get their learners, people didn’t want to leave to go play the game.  One “teacher” ran into a training puzzle and needed a moment to think.  She told her learner that they would only be a couple of minutes.  She could stay at the table while she consulted with her coach.  “Oh no”, her learner told her.  “Take your time.” She was going back to rejoin the body awareness session.

Ken coaching POrtl standingPortl plan first then playI must say having the backdrop of the open ocean created the perfect setting for body awareness exercises.  The gentle pitch and roll of the ship added to the proprioceptive experience.  Even the occasional “whale” cue which sent us all rushing to the windows contributed to the learning.  How quickly could you come back from a mammoth distraction into a state of calm balance for your animal?  And since I was among those who rushed to the window I couldn’t fuss when others did the same.

(I’ll write a separate post on some of the work I covered during the conference, including the body awareness exercises.)

The cruise ended all too soon.  When we docked back in Seattle early on Friday morning, I felt as though I could easily have set sail again.  Alaska is a landscape I could easily become lost in.  We are talking about where to go next.  What adventure should we have for our next cruise?  I could easily return to Alaska to sail up through the inner passage and see again those magnificent fjords.

For those who don’t want to go on a ship, Kay is talking about a land cruise next winter in the UK.  I’ll enjoy that as well, but I will also be looking forward to our next ocean adventure.

The cruise was over, but not my travels.  I headed next to a small clinic at Monty Gwynne’s, one of my Click That Teaches coaches.   Many of you have met Monty through her wonderful PRE Icaro.Monty and Icky 2 photos

Icky is only one of the many horses Monty has trained.  She also has a barn full of ponies who have all learned lateral work.  They made my job so easy.  They were the true teachers.  I simply stepped aside and let them teach people how to dance with horses.  On the third day we brought three of the horses into the arena for the start of a quadrille.  We had originally planned on having six horses working together for our drill team, but two of the participants had to leave early, and the third was busy attending to her own horse.  So we settled on just three horses which was enough for everyone’s first attempt at working in sync with one another.

Watching them coming down the long side together in shoulder-in was the highlight of my entire trip.  What a treat!  Monty has a treasure trove of wonderful horses.  If you want to explore what the combination of clicker training and an understanding of good balance can create, you should plan a trip to visit Monty.drill team Monty's ponies

I flew home on Tuesday, spent half a day catching up and then drove to the Cavalia Retirement Farm for a three day clinic.  It was another great event.  Several of the attendees were brand new to clicker training so the focus this time was on foundation work.  One of my Click That Teaches coaches, Sue Bennett, joined us.  Having Sue there to help meant we could split up into smaller groups to give people lots of one on one coaching.

Bilbo enjoying the clinicThe star of the clinic was Bilbo, an enormous Ardennes daft stallion.  When Bilbo enters the arena all eyes are on him, and it isn’t just because he’s so big.  Bilbo has charisma.  We generally save him for the end of the day.  We let him play his version of Panda catch.  He’s not as good at it yet as Panda.  She runs at full gallop from person to person.  I am glad to say Bilbo chooses a more sedate speed.  His reward for moving from one station to the next is not just a click and a treat.  He also gets a back scratch from everyone in the clinic.  He’s so big you can have the entire clinic group around him and everyone can find a spot to scratch.  Did I mention that Bilbo likes clinics and wouldn’t mind if they happened every weekend?favorite photos from 2015 clinics 2

I enjoy the clinics and all the other adventures, but it is good to be home for a bit.  I have pastures to mow, plumbing to fix, and horses to enjoy.

Alexandra Kurland
theclickercenter.com

5GoToSea: Pt 14: The Positive Side of Resurgence

Resurgence and Regression: Understanding Extinction So You Can Master It

From a presentation given by Dr. Jesús Rosales-Ruiz during the 2014 Five Go To Sea Conference cruise.

Part 1: The Elevator Question
Part 2: The Translation to Horses: Is Personality Expressed or Suppressed?
Part 3: Unraveling the Regression Mess
Part 4: Extinction and Shaping
Part 5: Extinction Reveals The Past
Part 6: Accidental Extinction
Part 7: Emotions
Part 8: Training With High Rates Of Reinforcement
Part 9: Cues and Extinction
Part 10: PORTL
Part 11: Mastering Extinction
Part 12: Creativity Explored
Part 13: Degrees of Freedom
Part 14: The Positive Side of Resurgence

If you are new to this series, I suggest you begin with Part 1

Part 14: The Positive Side of Resurgence

Building Unlikely Behaviors with Resurgence
Jesús reminded us that nothing is either all good or all bad.  We want to use positive reinforcement with our animals because we see it as effective and more humane.  But positive reinforcement doesn’t always produce desirable outcomes.  In people it can lead to addictions to harmful behaviors such as over eating or gambling.

Resurgence and regression can be very negative procedures, but they can also be used to produce what might otherwise be very difficult behaviors to obtain.

toy chairJesús again used PORTL to illustrate how this can work.  In one video example, a trainer set a toy chair on the table for her learner to interact with.  The goal was to get the learner to push the chair over the table the way she might push a toy car.  The learner began to interact with the chair, but not in a way that would lead to pushing it. Why?  Because history matters. The learner is going to bring back all of her history, all of her previous repertoire of chair behaviors as she experiments.  Pushing it like a car is very unlikely because that’s not how she would have interacted with this kind of object in the past.

The same would be true if the trainer had set down a dice.  The learner would have tossed the dice or shaken it in her hand because that’s in the reinforcement history of that object.  Pushing a dice over the table like a toy car would probably be much harder to get.

Instead of trying to shape the behavior through small approximations, the trainer used resurgence.  Her first step was getting the learner to touch the chair consistently. The learner in this video was not particularly creative.  She touched the chair, but she didn’t try any other behaviors.  Getting her to push it was going to be hard.

So the trainer took the chair away and set out a toy car.  Using an object that normally would be pushed made it very easy to get the desired behavior.  The learner pushed the car over the table top. Click and treat.

This was repeated several times and then the trainer took the car away and set the chair out. The learner went back to touching it.  The chair accidentally fell over – click and treat.  The learner latched on to that, expanding her repertoire to two behaviors – touching the chair and knocking it over.  She persisted in knocking it over even when she did not get reinforced for the action.  Everything but pushing it like a car was put on extinction – meaning the trainer no longer reinforced her for these behaviors.

To avoid escalating the learner’s frustration, the trainer took the chair away and set the car out again.  The learner immediately started pushing the car over the table top. Click and treat.

To help with the generalization the trainer put a third object out – a small block.  The learner pushed the block.  Click and treat.  This was repeated several times, then the trainer took the block away and set out the car.  The car was pushed.  Click and treat.

The trainer set the chair out and the learner pushed the chair.  Job done.

Resurgence and Dog “Yoga”
Jesús next showed an example of using resurgence to train a dog to step with his hind legs onto a chair.

The dog was taught through a series of very carefully managed steps.  First, the dog learned to stand one foot each on four small plastic pods.  This alone was impressive training.  The pods were the same ones physiotherapists use to help people improve their balance and proprioception.  It took great coordination for the dog to stay balanced on the four pods.  But that was only step 1.  Next he learned to keep his front feet on the pods while he maneuvered his hind feet up onto the brick ledge of a fireplace hearth.

This was not done as a cute party trick.  The dog’s owner is a yoga teacher.  Her interest was very much the same as mine – helping her animal to maintain a healthy spine.

The last step was setting up a training session next to a chair.  The handler withheld the click, putting the dog into an extinction process.  With very little experimentation, the dog oriented himself so his hind end was to the chair.  He certainly demonstrated the flexibility of his spine by stepping up onto the chair with his hind legs so he was standing hind end up on the chair and front feet on the floor.

Generalization and Creativity
Jesús commented that if we didn’t know about resurgence we would be saying the dog generalized.  But generalization had nothing to do with it.  What we were seeing was resurgence.  Kay added that for her this process is what is meant by creativity.  It isn’t waiting and waiting for the dog to do something new.  Instead we give them a whole range of behaviors, and they come up with a new or unlikely combination.  What Jesús was showing us was a procedure for setting up the creative process.  You give the animal the repertoire, the components of more complex behaviors, and then you set up a puzzle and let extinction be the catalyst for solving it.

Coming soon: Part 15: Going Micro

Please note: If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

5GoToSea: Pt. 13: Degrees of Freedom

Resurgence and Regression: Understanding Extinction So You Can Master It

From a presentation given by Dr. Jesús Rosales-Ruiz during the 2014 Five Go To Sea Conference cruise.

Part 1: The Elevator Question
Part 2: The Translation to Horses: Is Personality Expressed or Suppressed?
Part 3: Unraveling the Regression Mess
Part 4: Extinction and Shaping
Part 5: Extinction Reveals The Past
Part 6: Accidental Extinction
Part 7: Emotions
Part 8: Training With High Rates Of Reinforcement
Part 9: Cues and Extinction
Part 10: PORTL
Part 11: Mastering Extinction
Part 12: Creativity Explored
Part 13: Degrees of Freedom

If you are new to this series, I suggest you begin with Part 1.

Part 13: Degrees of Freedom

Optimistic Puzzle Solvers
How do you help horses and handlers to become more optimistic puzzle solvers?  One way is to expand the repertoire of both the handler and the learner.  The broader and more extensive the repertoire, the more options an individual has.  If a horse knows only two choices and neither of them are working, he’s in trouble.

Jesús referred to this as being coerced by your repertoire.  Here’s the example: suppose a high school student is a great debater.  In fact he’s so good, he’s captain of the debating team. You’d expect someone like that to have a really high self-esteem. He’s so successful how could he not?

But look a little closer, and you’ll see why.  This individual is great at debating, but he’s no athlete.  He’s left out of a lot of other school events.  He doesn’t play sports.  He doesn’t go to school dances.  He has poor social skills so at lunch he’s off by himself.

Yes, in debating he wins all the prizes, but he has only that one skill.  So he’s being coerced into improving his debating skills because that’s all he can do.  He’s the best debater in the school, but that doesn’t keep him from feeling left out and miserable. With only that one skill he has only one degree of freedom.

Other members of the debating team may not be as good as he is, but they are also involved in other school activities.  Compared to him they have three or four degrees of freedom, and they are much happier.

The captain of the debating team is the best, but he’s been coerced into that position because he has no choices.  For him, as well as for our horses, the way to improve his emotional well-being is to expand his repertoire so he has more reinforcing activities available to him.

Kay Laurence confirmed this approach for dogs.  If you’re working with an aggressive dog, you want to expand his repertoire.  Teach him a dozen new behaviors: turning your head to the left, to the right, lifting a paw, walking in a circle, touching a target, etc..  Now in a threatening situation he has a dozen new ways to respond, instead of just the two or three that he started with.

Being Emotional Is Being Alive
Jesús dropped in another gem at this point by reiterating that when we talk about emotional behavior such as aggression, we are forgetting that we are always emotional. It isn’t that now we are happy, and then a switch turns off and we feel nothing.

“Living is being emotional.”

The nature and intensity of the emotions fluctuates.  We experience different degrees depending upon conditions and our reinforcement history. But thinking in terms of “emotional behavior” is too simplistic.  Emotion is part of all behavior.  It is not separate from it.

single suitcaseTraveling helps you to understand how much our emotions are a product of the habit patterns that have formed within our familiar environments and how universally present emotions are. Perhaps you are one of the huge number of people who have more to do than you could possibly accomplish in one day.  You have a family to care for, a house and barn to maintain, horses to feed and clean up after – not to mention ride.  All that and then there’s also an overfull schedule at work.  You’re always under stress, but it’s become so the norm, you don’t pay much attention to how you’re feeling.  A mildly stressed state is the normal background.

And then you treat yourself to the Five Go To Sea cruise where everything is different.  You still have a full day, with more to do and see than any one person could possibly squeeze into a day, but your normal triggers aren’t there.  The phone isn’t ringing.  You aren’t on the internet with the constant influx of work-related emails. Your co-worker’s voice coming through the office wall isn’t annoying you.  All those triggers are gone and now you get to experience who you are and how you feel without them.  You become acutely aware of just how stressed you’ve been now that you’ve stepped out of your normal habit patterns and can experience the contrast.  You’re still emotional, but now the environment is set up to trigger the kinds of supportive, pleasant emotions you want to experience.

That’s the kind of positive environment I want to create for my learners: one in which puzzle solving is fun, and both horses and handlers eagerly seek it out.

On a Caribbean cruise what do clicker enthusiats do for fun? They play PORTL games.

On a Caribbean cruise what do clicker enthusiats do for fun? They play PORTL games.

Coming Soon: Part 14: The Positive Side of Resurgence

Please note: If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

5GoToSea: Part 12: Creativity Explored

Resurgence and Regression: Understanding Extinction So You Can Master It

From a presentation given by Dr. Jesús Rosales-Ruiz during the 2014 Five Go To Sea Conference cruise.

Part 1: The Elevator Question
Part 2: The Translation to Horses: Is Personality Expressed or Suppressed?
Part 3: Unraveling the Regression Mess
Part 4: Extinction and Shaping
Part 5: Extinction Reveals The Past
Part 6: Accidental Extinction
Part 7: Emotions
Part 8: Training With High Rates Of Reinforcement
Part 9: Cues and Extinction
Part 10: PORTL
Part 11: Mastering Extinction
Part 12: Creativity Explored

If you are new to this series, I suggest you begin with Part 1.

Part 12: Creativity Explored

Creativity Explored
Do you have a training-related question?  Are you wondering which teaching strategy will work the best?  Are you puzzling over some element in learning theory?  Great.  Design a set up, test it a few times to work out the procedure and then invite your friends over for a pizza and PORTL party.  In the course of an evening you’ll be well on your way to answering your questions, and you might even have collected data to write a scientific paper!

I do like the new name that’s been given to this shaping game, PORTL: Portable Operant Research and Teaching Laboratory.  As Jesús pointed out, we’ve been using lab rats to learn about human behavior.  Now we are doing the reverse.  We’re using humans as a model for animal behavior. Turnabout is fair play.  Much better to frustrate an undergrad than some poor lab rat!

So how does this help us?  Jesús shared several examples where extinction strategies were used to train complex, creative behaviors.

What Is Insight?
The first used a great video from Robert Epstein’s work.  Epstein was B.F. Skinner’s last graduate student.  They were exploring the concept of “insight”.  How do we solve puzzles?  Are we truly creating something that has not existed before, or is creativity a product of combining known components to solve a novel puzzle?

To explore this question Epstein taught a pigeon three component behaviors: pecking a banana, climbing on a box, and pushing the box towards a target.

The pigeon was then put into chamber with the box and the banana.  The banana was hung up out of reach.  The pigeon couldn’t reach the banana to peck at it, so an extinction process began.  There was a resurgence of previously trained behaviors. The pigeon began pushing the box, but it was very clear the behavior was deliberate.  The pigeon pushed the box under the banana, hopped up on the box, and pecked the banana. Puzzle solved.

So here’s the question: what is insight? What really is creativity?

Jesús would say this kind of complex puzzle solving was achieved through resurgence. Set up the underlying components well, add in a bit of extinction, and “creativity” pops out.

If you leave out one of the components, you have to extend the extinction process and hope the subject really does become creative.  But this is the kind of creativity that is truly stressful. It’s much better to analyze the complex end-goal behavior, break it down into all of it’s component tasks, and then train each of the components separately.  The result will be brilliant looking pigeons that solve in minutes what we might otherwise think would be an impossible puzzle for them.

Inventors and Creators
Jesús’ comment was there is “nothing new under the sun”.  You are not going to do anything that you haven’t already done before.  All the components of what appears to be a novel behavior have been trained in the past. When individuals experiment and find the usual, familiar things aren’t working, some will give up.  Others will keep trying until they come up with a novel combination that works.

We call these people inventors and creators because they are able to find these novel combinations.  That first learning process can be a painful one, but once the new combination is worked out, it’s easy for others to copy the results.

I can absolutely relate to this.  Give me a horse puzzle to solve, and I can be very persistent. My life experience has taught me that persistence pays off.  But put me in front of a computer that isn’t cooperating, and I shut down fast.  There my experience has produced very different expectations.  I’ve experienced too many situations where errors in a software program have made a problem unsolvable, at least for my level of computer skills.  I don’t have the component skills that make wrestling with a software issue fun.  Extinction has gone too far and been too uncomfortable.  So in one situation I can be very persistent and creative.  In another I’m the one going through the classic cycle of an extinction shut down.

I know first hand both how much fun the creative process can be when the expectation of success is there.  And I also know how painful and unpleasant the extinction process is when that expectation is missing.  So here’s the question: which one are you creating for your horses, your dogs, your children – for yourself?

Coming soon: Part 13: Degrees of Freedom

You can watch the pigeon experiment in this video clip:

Please note: If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

5GoToSea: Pt 11: Mastering Extinction

Resurgence and Regression: Understanding Extinction So You Can Master It

From a presentation given by Dr. Jesús Rosales-Ruiz during the 2014 Five Go To Sea Conference cruise.

Part 1: The Elevator Question
Part 2: The Translation to Horses: Is Personality Expressed or Suppressed?
Part 3: Unraveling the Regression Mess
Part 4: Extinction and Shaping
Part 5: Extinction Reveals The Past
Part 6: Accidental Extinction
Part 7: Emotions
Part 8: Training With High Rates Of Reinforcement
Part 9: Cues and Extinction
Part 10: PORTL
Part 11: Mastering Extinction

If you have not yet read the previous articles, I suggest you begin with Part 1.

Part 11: Mastering Extinction

Using PORTL to Master Extinction
Extinction happens all the time.  When you withhold your click, you set up an extinction process.

If you withhold the click because you are unclear about your criteria or you’re clumsy in your handling skills, you could be setting up your learner for a macro extinction with all of the painful emotions that go along with it.

Or you could be withholding the click with very deliberate intent.  In this case you are using a micro extinction process to help shape a more complex behavior.  You are using extinction to your advantage.  The conclusion: extinction doesn’t have to be something you avoid.  It can be something you actively use to create more complex behavior patterns.

Today’s post shows how the shaping game, PORTL can help us understand how this works.

Jesús watching participants at a conference learning to play PORTL.

Jesús coaching participants at a conference as they learn how to play PORTL.

Shaping with Resurgence
Jesús used videos of PORTL experiments to illustrate what he meant.  He reminded us that there is a difference between resurgence and regression.  The first video example showed an elegant use of resurgence.

The learner was taught Behavior 1: tapping a small block.  Once that behavior was confirmed the block was removed and a toy car was placed on the table.

 

Behavior 2 was rolling the toy car over the table top.  When the car was brought out for the first time, there was a small extinction burst of tapping the car, but the learner quickly shifted to pushing it.

When that behavior appeared to be solid, the car was removed and a third object was placed on the table.  Now the behavior was lifting.

Behavior 4 was a different action.  The learner put a wooden ring on her finger.

When each of these behaviors seemed solid, the trainer reviewed one at a time what the learner was to do with each of the objects.

The trainer then placed all four objects out on the table but not in the order in which they had been taught.  There was now no reinforcement given.  The trainer was simply observing the learner’s behavior – not giving any feedback or reinforcement of any kind.  The point was to see in what order the learner would interact with each object.

The result:  The learner went first to object 1/behavior 1, then moved to object 2/behavior 2, then object 3/behavior 3/and finally object 4/behavior 4.

So even though that wasn’t the left to right order in which the objects were set out, that was the order in which the learner interacted with them.

The conclusion: when you have not gone through an extinction process for the behaviors you are using, when you have instead reinforced them and then you remove reinforcement, the behaviors occur in the order in which they were trained.  This is resurgence as opposed to regression.

Shaping with Regression
Now here’s the fun part.  When you first extinguish the individual behaviors, you get the opposite result.  Now you see regression.  People will go back to the most recently learned behavior.  If that doesn’t work, they’ll go a little further back, and then a little further back – thus revealing their training history.

Jesús showed a second video, this one was exploring what happens in a shaping session where you reinforce an approximation, and then go through an extinction process so you can switch to a new behavior.  Here’s the set up:

The trainer set out one item on the table.  The learner began to manipulate it, trying to find out what was going to be clickable.  The trainer didn’t click any of this creativity.  She waited for it to extinguish and then clicked for one simple behavior – touching the object with one finger.  That was the “hot” action.

The trainer clicked and reinforced for successful approximations, then she took a break to record her data.  She continued to train in ten click units until she had achieved a high degree of consistency in touching the object with one finger.

This was the set up for the experiment.  In the next phase she set out in a circle nine or ten different objects, including the one they had been working with.  The learner began by touching the familiar object.  That got clicked and reinforced several times, then the trainer stopped reinforcing for that object.  She was using extinction to eliminate that behavior.  The learner began experimenting, touching various objects, but she only got clicked for touching the one that was immediately next to the previously hot object in the counter-clockwise direction.

The learner switched over to this object and began touching it consistently.

So now the handler stopped reinforcing for this object and only reinforced for the next object on the circle.  The learner again experimented and then discovered that the only object that she got paid for touching was the third one on the circle.

When this was consistent, the handler again stopped reinforcing for touching this object.  The learner was catching on to the overall pattern.  Now she moved more quickly to the fourth object and discovered that was the “hot” one to touch.

They continued counter-clockwise around the circle until every object had been the “hot” one once and touching it had also been extinguished.

At this point the handler stopped reinforcing for anything and observed the learner’s behavior. The result: the learner quickly switched to moving clockwise around the circle, touching  the objects in the reverse order in which she had learned them.  So she learned them originally counter-clockwise: object 1, then object 2, then object 3, then object 4, etc.

Now she was touching them clockwise: object 10 – object 9 – object 8 – object 7, etc.  She wasn’t getting clicked for any of these touches, but the pattern was very persistent.

What PORTL Reveals
So again: in the first video where the behaviors were taught, but not extinguished, the learner went through them in the order in which they had originally been learned.

In the second video where behaviors were extinguished, the learner went through them in the reverse order.

You won’t find these distinctions in the scientific literature.  This difference in behavior relating to resurgence and regression is something Jesús and his students have been revealing by playing PORTL.

Coming Soon: Part 12: Creativity Explored

Please note: If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com

5GoToSea: Pt 10: PORTL

Resurgence and Regression: Understanding Extinction So You Can Master It

From a presentation given by Dr. Jesús Rosales-Ruiz during the 2014 Five Go To Sea Conference cruise.

This is Part 10 of a 15 part series.
Part 1: The Elevator Question
Part 2: The Translation to Horses: Is Personality Expressed or Suppressed?
Part 3: Unraveling the Regression Mess
Part 4: Extinction and Shaping
Part 5: Extinction Reveals The Past
Part 6: Accidental Extinction
Part 7: Emotions
Part 8: Training With High Rates Of Reinforcement
Part 9: Cues and Extinction
Part 10: PORTL

If you have not yet read the previous articles, I suggest you begin with Part 1.
Part 10: PORTL

PORTL’s Origins

Jesús and the son of one of the conference attendees playing PORTL during the Five Go To Sea cruise.

Jesús and the son of one of the conference attendees playing PORTL during the Five Go To Sea cruise.

PORTL evolved out of Genabacab, a table game Kay Laurence developed for teaching shaping.  Genabacab has very few instructions and really only one rule: the only person who is allowed to talk is the learner.  The trainer and spectators are not to give any verbal hints or to discuss what is going on until afterwards.

The table game lets you work out shaping plans BEFORE you go to your animal.  Do you want to learn how to attach a cue to a behavior and then change that cue to a new cue?  You can work out the process playing the table game and spare your animals the frustration of your learning curve.

Kay has described workshops at her training center where someone arrives with a “how do I teach this?” type of question. Maybe the handler wants to teach match to sample, or she wants to see if her dog can indicate which object is the biggest one in a set. Instead of going straight out to the dog and confusing it with missteps and false starts, everyone in the group will pull out their Genabacab games.  They will spend hours happily absorbed in developing the best teaching strategies for their dogs.  Their dogs, meanwhile, are spending the day relaxing while their people work away at the puzzle. It’s only once the process is well understood, that the dogs are brought in for training.

Jesús has been using Genabacab to help his students understand the concepts of learning theory.  He wants to bring the game to the scientific community as a research tool, so – with Kay’s blessing – he has renamed it.  It is now PORTL – Portable Operant Research and Teaching Laboratory.  Animal studies are increasingly difficult to do. They are expensive, and there is always the question of ethics.  How fair is it to run studies on lab rats?  PORTL is a much better solution.  You can have a question about how a particular process works, design an experiment using the PORTL game, and in the course of an evening have gathered enough data playing the game with a group of undergrads to write a paper – all without frustrating a single lab rat.  Now that’s progress!

PORTL Games
Jesús’ students meet on a regular basis to play PORTL games.  In his talk he showed some videos that illustrated beautifully how he used it to ask questions about regression and resurgence.  In one video two tasks were taught.  First, the learner was shaped to place one hand over the other – right hand over left, and then to reverse it – left hand over right.  The behavior was put on a fixed ratio of 5.  That means the learner was clicked and reinforced on every fifth swap of hands.

The second task was tapping a block.  Again, the learner was put on a fixed ratio of 5. (The learner was to tap the block five times for each click and treat.)

The trainer then increased the ratio for the tapping to 30.  The learner began  to tap the block, but now there was no click and treat after 5 taps.  The learner kept going to about 13 taps.  At that point she began to experiment.  She reverted back to swapping hands.  Then she tried a few more taps, before going back to hand swaps.  She tapped the block a few more times.  The trainer was still keeping track so each of these taps was counting towards the count of 30 she was looking for.

In the twenties the learner began to be creative.  She tried different ways to move hand over hand.  She’d go back and forth between experimenting with hand swaps and tapping the block.  Finally she reached a count of 30 at which point her handler clicked and reinforced her.  Jesús’ point is now all the extra gunk was also chained in. If the handler were to keep reinforcing the tapping of the block, she would also see the frequency of the hand swapping skyrocket.  That’s not the desired, goal behavior, but it would increase right along with the tapping.

Now you are probably thinking:  “Well that’s just poor training.  No one is going to jump from a fixed ratio of 5 to one of 30.”  My response would be to say that this can happen inadvertently. Suppose a handler has had a behavior on a high rate of reinforcement.  He’s asking the horse to carry himself in a correct bend.  He’s cueing it through gentle requests down the rein.  The horse is responding on a consistent basis, but then he’s distracted or the footing changes so he loses his balance. Whatever the reason, the handler isn’t getting the same consistent response. Instead he’s getting a string of unwanted behavior.  Sometimes the horse almost meets criterion, but not enough to click.  And then he comes through with the right answer.  The handler captures that moment with a click and a treat.  The question is: what is the long term result of that click?  Has the handler just identified a single clickable moment or has he chained in a long string of unwanted behavior?

The horse’s future responses will answer that particular question, but Jesús response in general is: if you want clean behavior, you need to learn to microshape.

Jesús made the further comment that this type of inadvertent chaining happens all too often when people are working with autistic children.  The sad thing here is the previous behavior that is being reinforced is not something harmless like hand swapping, but it’s often self-injurious behavior like head banging.

To sort out the tangle you need to analyze the whole behavior chain rather than focus in on individual behaviors.  These adjunctive behaviors can create a lot of stress. Again Jesús emphasized that’s why it is so important to understand extinction.  You need to understand it so you can master it.

Coming Soon: Part 11: Mastering Extinction

Please note: If you are new to clicker training and you are looking for how-to instructions, you will find what you need at my web sites:

theclickercenter.com                    theclickercentercourse.com