Theme Layout

Rightsidebar

Boxed or Wide or Framed

Theme Translation

Display Featured Slider

Yes

Featured Slider Styles

Display Grid Slider

No

Grid Slider Styles

Display Trending Posts

No

Display Author Bio

Display Instagram Footer

Dark or Light Style

Search This Blog

Do you Believe in Dog? (2018). Powered by Blogger.

Copyright Do You Believe in Dog (2018)

The content on Do You Believe in Dog? is copyrighted. If you are interested in using any content produced on Do You Believe in Dog? please email a request.

Strap line

It started when two canine scientists decide to become pen pals in an era of digital media...

Translate

Showing posts with label assessment. Show all posts
Showing posts with label assessment. Show all posts

8 July 2015

Getting practical: Do non-experts make the same behavior assessments of working dogs as experts?

Getting practical: Do non-experts make the same behavior assessments of working dogs as experts?



Guest post by: Jamie Fratkin, PhD

First off, I just wanted to say that I love reading your blog! ('THANK You!' say Mia and Julie). I think it’s such a great platform to deliver the latest in dog research for both researchers and dog lovers, and I am excited to be able to contribute. 

Dog being dog. Copyright Steve DeBono.
Just as a bit of background on me. I just finished my PhD in Social/Personality Psychology at the University of Texas at Austin, working with Sam Gosling. My research focus has been examining personality in dogs as well as examining relationships between dogs and people. The project I’ll be talking about is one that I started in my first year of grad school.

The idea for the project was prompted by a practical question in the context of working dogs. Numbers vary a bit depending on the organization, but only about 50% of the dogs trained and bred for working-dog roles end up succeeding or actually working in the roles they were bred for. Lots of money and time is spent raising and training these dogs and with so few dogs succeeding, it is important to determine the factors that might influence success. If we can find these factors we may be able to train more successful dogs or at least figure out at an early age which puppies are most likely to succeed. 



Many studies have begun to explore the role of personality in working-dog success (e.g., Duffy & Serpell, 2012; Goddard & Beilharz, 1982, Sinn, Gosling, & Hilliard, 2010).  Just as not every person is suitable for every job, not every dog is suitable for every working role. For example, you don’t want a dog that is afraid of traffic to lead a visually impaired person. You also don’t want a dog that is easily distracted to be in charge of detecting explosive devices.

Research suggests that some traits seem to be particularly relevant to a dog’s working success. For example, in the 80s, Goddard & Beilharz conducted a series of studies examining guide dogs in Australia and found low fearfulness was a significant predictor of success.

These other studies are promising but there is practical obstacle to doing them. That is, most experts from working dog organizations are already pressed for time by all of the responsibilities they have to oversee. So they usually don’t have time to undertake the behavioral observations that are key to systematically assessing dogs’ personalities.

So for this study, we wanted to find out whether we could save the experts’ time by having non-experts rate the dog’s assessments instead of the experts. We examined this question in two assessment contexts. One context consisted of Belgian Malinois puppies undertaking a short, very standardized test; dogs were placed in a room and the assessors went through a series of standardized steps to examine the dog’s reactions to various stimuli such as a vacuum cleaner being turned on. The second context consisted of Labrador Retrievers undertaking a longer and less standardized test in which the dogs were walked through different environments and their reactions to the environment were observed and translated into traits like confidence and concentration.  



Experts from working-dog organizations had already rated these assessments. So we recruited non-experts (some of whom had never even owned a dog before) to rate the videos of the behavioral assessments that had already been rated by the experts. We gave the non-experts about an hour of training. These non-experts then watched videos at their own pace and made ratings based on how the dog performed in the assessments.
 

In general, we found strong evidence that non-experts could match expert ratings for many traits in both assessments. However, non-experts did not match experts for about 25% of the traits (e.g., dog’s focus on a reward object). The reason for the discrepancies between experts and non-experts could be that some traits are more difficult to observe via video recordings (vs. watching the behavior live), but it also could be that some traits are more difficult for non-experts to observe than experts. Overall, our results suggest that for many traits non-experts can match expert ratings of dog assessments. Given that non-experts are far more abundant than experts, this finding has has wide ranging practical implications for organizations hoping to assess personality in dogs.  

Jamie and Quasia

~ ~ ~
Jamie's study is available via free promotional access until January 2016. This means you can download now and view whenever. For more about the research in the Special Issue of 'Behavioural Processes,' see 'Really, Canine Science is Open Access.'

Learn more about Jamie and her research on her website


References:
Duffy, D. L., & Serpell, J. A. (2012). Predictive validity of a method for evaluating temperament in young guide and service dogs. Applied Animal Behaviour Science, 138, 99-109. 


Fratkin, J. L., Sinn., D. L., Thomas, S., Hilliard, S., Olson, Z., & Gosling, S. D. (2015). Do you see what I see? Can non-experts with minimal training reproduce expert ratings in behavioral assessments of working dogs? Behavioral Processes, 110, 105-116. 


Goddard, M E., & Beilharz, R. G. (1982). Genetic and environmental factors affecting the suitability of dogs as guide dogs for the blind. Theoretical and Applied Genetics, 62, 97-102. 


Sinn, D. L., Gosling, S. D., & Hilliard, S. (2010). Personality and performance in military working dogs: Reliability and predictive validity of behavioral tests. Applied Animal Behaviour Science, 127, 51-65. 



© 2015 Jamie Fratkin | Do You Believe in Dog?

Continue Reading »
DoYouBelieveInDog
1 Comments

You Might Also Like

30 October 2012

Ideally amicable: beauty and behaviour (part 2)

Ideally amicable: beauty and behaviour (part 2)


Hellloooo Julie,

(source)
Isn’t it interesting that bigger eyes are a preferred attribute for attractiveness, yet we find animals covering their faces (and therefore obscuring their eyes!) super cute? The eyes have it, but they obviously aren’t the full story. 

I look forward to hearing more!

While you tell me about what rings our bells in terms of physical looks, I'd like to get back to telling you about Tammie King's research into behaviour assessment and contemplating what behavioural traits we prefer in our companion dogs (Part 1 here).

I think I was up to telling you how Tammie set about creating an assessment with the aim of measuring the canine personality trait, ‘amicability’. She wanted to see if this was possible using a relatively SIMPLE protocol (because remember, we need this to be feasible for use in the real world). 

(Abstract from King et al., 2012, details below)
Tammie modified a well-known protocol called the Ainsworth Strange Situation Test for this purpose. Dogs were filmed undergoing the assessment in which they were exposed to a novel environment and unfamiliar person, initially with their owner and then without.

Tammie then gathered a focus group of dog behaviour experts (dog trainers, vets, people who work in animal shelters, breeders, etc. etc.) who independently watched videos of dogs who had undergone the pilot study and rated them on their level of amicability, based on a previously described list of attributes. There was a high level of agreement between which dogs the experts considered more or less amicable. This demonstrated that the protocol was able to elicit a range of behaviours which is excellent as it means we should be able to accurately identify what it was that enabled the experts to identify ‘amicable’ and ‘non-amicable’ dogs.
(source)

Tammie put her scientist hat back on and decided the most objective way to work out what was important to measure, was to begin by measuring absolutely every freaking behaviour, from every freaking angle. So she did. Data were collected from over 200 dogs and their owners.


Take a look at some of the footage:


She kept tally of all behavioural variables and went about conducting analyses to determine which variables to retain and which to discard, basically which ones were important in predicting ‘amicability’ Her ethogram is the king kong of canine ethograms.

(source)
To further evaluate the assessment, Tammie  asked two of the experts to rate ALL of the dogs to examine the intra-inter- rater reliability (which was very high = good!). Tammie also examined test-retest reliability and predictive validity. She also compared the owners’ reports of their dogs’ amicability. Interestingly, experts and owners don’t always agree

Dogs were behaving differently than owners expected. This might be due to a number of factors. Perhaps the assessment only offers a small snapshot of the dogs’ behaviour in the limited time available; perhaps owners are biased at look at their dogs through rose tinted glasses, etc. 

After a whole lot of statistical analysis, Tammie was able to determine which behavioural variables best predict ‘amicability’. The amount of contact the dog made with the stranger, its locomotion, vocalisations, time spent in particular areas of the arena and body posture were  all considered important.


Tammie has copped a bit of flack from ‘concerned individuals’ who seem afraid that this assessment will be the be-all-and-end-all of dog temperament tests and that every dog will be forced to be AMICABLE

But honestly, this is just a starting step. Step 1 in developing an accurate behaviour assessment for dogs, using the canine personality dimension of ‘amicability’ as a test case.

Tammie won’t really know how successful it is as a test protocol until a lot more data is collected from many dogs far and wide. Longitudinal data would be helpful, as would examining different breeds, puppies to adults, dogs from varying regions, etc. etc. Tammie also believes strongly that having a test like this in existence does not mean we take the emphasis off TRAINING dogs. We still need educate people about dog behaviour, welfare and training to ensure dogs and people live together harmoniously.

Dogs, like people and other animals, are constantly evolving. Perhaps some of the newer dog types around are already being selected for amicability without people realising it? Perhaps new breeds might be developed for this identified niche of FAMILY PET/COMPANION dog. This still leaves room for the people who want whatever dog they want and leaves them free to train it to do what they want.

Tammie suggests we will benefit from being TRANSPARENT about the sort of dog/s we have. Because having ACCURATE information on our dogs’ behaviour can help us make informed decisions regarding their breeding, training, housing and socialisation requirements. It has the potential to help with dog-owner matching, breeding decisions, etc. and also pave the way for future behaviour assessments aimed to measure other traits. In my mind, that has to be a good thing!

So what about their looks?
Are there physical traits that could also make for better companion animals?

Mia

Further reading:

King, T., Marston, L.C. & Bennett, P.C. (2012). Breeding dogs for beauty and behaviour: Why scientists need to do more to develop valid and reliable behaviour assessments for dogs kept as companions, Applied Animal Behaviour Science, 137 (1-2) 12. DOI: 10.1016/j.applanim.2011.11.016

Ley, J., Bennett, P. & Coleman, G. (2008). Personality dimensions that emerge in companion canines, Applied Animal Behaviour Science, 110 (3-4) 317. DOI: 10.1016/j.applanim.2007.04.016

King, T., Marston, L. & Bennett, P. (2011). Development of the Monash Canine Amicablity Assessment (MCAA), Journal of Veterinary Behavior: Clinical Applications and Research, 6 (1) DOI: 10.1016/j.jveb.2010.08.033

© Mia Cobb 2012
Continue Reading »
DoYouBelieveInDog
0 Comments

You Might Also Like

23 October 2012

Ideally amicable: beauty and behaviour (Part 1)

Ideally amicable: beauty and behaviour (Part 1)


Hi Julie!

How was the APDT conference
Those citizen science projects in your last post were completely awesome – I still can’t decide if the slowed down baby laughter sound is hilarious or scary! Not sure I’d want to hear my kid’s giggle turned into Uncle Fester’s slow-play snicker is all I’m saying.

Looking at those babies’ behaviour, we can obviously tell they are happy little campers, but what assessments can be made about dog behaviour? More importantly, what are the behaviours that contribute to dogs thriving and living happily as modern-day companion dogs and members of our families?

(source)
The Anthrozoology research group considered this question a few years back. We often have discussion about dogs with our science goggles on (no, not literally – we don’t even wear lab coats! *snicker*). We talked about the idea of dogs having their behaviour scored and assessed in the same (best practice) way as their hips/elbows/eyes/insert physical trait are prior to breeding. Wouldn't that be amazing? This would be more than simply a breed standard description (e.g. Lhasa Apso: “Gay and assertive, but chary of strangers”; Dalmatian: "stable and outgoing, yet dignified", AKC breed standards), as you touched on in an earlier post. This would be an actual assessment of an individual dog’s behaviour.

This could be such a helpful tool. For potential owners (e.g. check out the documented behaviour profiles of the individual parents before purchasing a pup), for local councils (e.g. could help them better manage the dogs living in their community, including the dangerous ones), breeders, trainers, shelters, etc. etc. etc.

Tammie and her dog Kade
Tammie King was part of those discussions and her research is taking on this huge piece of big-picture pie, head first. Tammie began her PhD journey wanting to improve our capacity to accurately and objectively assess canine behaviour with the goal of improving transparency of the types of dogs we have (own/breed) in our communities. This is a continuously challenging area of study and one of significance for many sectors of our society.

(source)
But hasn’t someone already worked out how to do that?
There are already plenty of behaviour assessments in existence. The problem is that they’re all trying to measure different things, in different ways, guided by different ethics (specifically regarding eliciting aggression), using different equipment and different assessors in all different scenarios in varying parts of the world. Many have not been evaluated regarding their effectiveness. As scientists, we’d like to limit variability by producing an objective (not biased), standardised assessment which has been shown to be valid (accurate), reliable (repeatable by different people on different occasions) and is feasible (can be safely used by a range of organisations).

That sounds easy!
Does it? Awesome! What would you measure? Objectively, remember. How would you score it? What would you use in your test to prompt the behaviour that informs your assessment? Keep in mind the assessment needs to have a practical time frame to be useful in a real-world context. What would you involve in your protocol? The owner? A stranger? Another dog? A small child? Food? Cats? Penguins? Wait!

I changed my mind.
That sounds hard!
You’re right. It’s not an easy task. Tammie decided to tackle this the way we all should take on any big task – by breaking it down into manageable pieces. She started by asking “WHAT should my assessment be measuring?” Rather than just take a stab in the dark, Tammie took the question to the masses and asked the Australian public what their ‘ideal’ dog would be.

Nearly 1,000 people took her online survey and it turns out that most people seem to want dogs which are friendly, easy going, safe with children, affectionate, etc. When it comes to dogs living as companion animals, most people do not want the traditionally bred purpose-type dogs, i.e. hunting/guard/herding dogs (Oh hush your protests, this is what the data said, not what Tammie or I are personally saying). 

Instead, in these current times, most people in Australia want what a dog that can be categorised as AMICABLE.

Amicable is ideal?
The next stage of Tammie’s research involved developing a behaviour assessment specifically designed to measure the canine personality trait, amicability.

I’ll tell you more about all of that next time. But I’d love to hear your thoughts - what do you think the most common role of dog is these days? Should we be breeding dogs for beauty and behaviour in their role as modern companion animals? 

Until next time,

Mia

Further reading:

King, T., Marston, L.C. & Bennett, P.C. (2009). Describing the ideal Australian companion dog, Applied Animal Behaviour Science, 120 (1-2) 93. DOI:10.1016/j.applanim.2009.04.011

King, T., Marston, L. & Bennett, P. (2011). Development of the Monash Canine Amicablity Assessment (MCAA), Journal of Veterinary Behavior: Clinical Applications and Research, 6 (1) DOI:10.1016/j.jveb.2010.08.033

© Mia Cobb 2012
Continue Reading »
DoYouBelieveInDog
2 Comments

You Might Also Like

21 August 2012

It's all about objective multiples...

It's all about objective multiples...


sciseekclaimtoken-5036b68d5c7f8
First thoughts...
Hey Julie!

I hope you had a great weekend. Can I tell you more about assessing welfare? Hell to the yeah I can! 

(By the way, who gave you that photo of me working at 3:17am?!) 

I could probably blog every day until the next Canine Science Forum about measuring animal welfare - but there are so many other things I want to discuss with you, that simply won’t do.

In thinking how to respond to your question, I popped out to my bookcase (technically, it’s more of a book wall) and grabbed the first few books I thought of when I think of ‘understanding and assessing canine welfare’. There were 23 of them. Hmmm. And that’s before I even considered pulling up relevant scientific journal papers. So...

Interpreting and measuring animal welfare isn’t easy. There’s no litmus test for animal welfare, no smartphone app' that you can use to scan an animal and get a quick result as to whether its welfare is good, neutral or poor (but how cool would that be!).
It’s not easy, but it’s by no means impossible. 

Saliva collecting is easy with slobbery dogs
As scientists, we love an objective measure (one that requires minimal judgement by the person making the assessment, which reduces the chance of human bias and/or error) so we really love something that gives us numbers to analyse. This is where measurements of physical functions, like heart rate, weight, stress hormones and immune system function are great. No matter what mood I’m in, how much coffee I’ve drunk or what time of the night I’m reviewing my PhD data, I can’t alter the fact a salivary cortisol measure came in at 0.29µg/dL. Because that’s what the value is. It just is.

This dog obviously has 'good drive' (source)
Behavioural information is awesome because we can generally collect it without interfering with the animals, reducing any experimenter effect. It’s important that its measurement is still done objectively and this is where an ethological background (oh hey, like mine!) can be really handy. There are many industry-based terms which may mean different things to different people, or in different contexts. For example, in the working dog industry, terms like ‘drive’, ‘willingness’, ‘suspicion’ and ‘instinct’ are behavioural traits commonly referred to, but what is good drive? Has this boxer got ‘good drive’? How do we measure it? Is a livestock herding dog’s drive the same as a guide dog, police dog or racing greyhound’s drive? 

When we measure behaviour objectively using an ethogram, and look at frequencies (how often within a timeframe) or durations (length of time) of certain actions (like barking, sitting, walking, interaction with another dog, person or toy) we remove the human interpretation (and potential error in interpretation) from the data collection stage, which is SUPER important. So rather than rate the subjective term drive, a scientist would tend to measure objective behaviours or actions, like command-response time, running speed or directional tracking of eye movements.

(source)
Environment is also important as it gives context to the physiological and behavioural data. For example, if a dog’s cortisol reading in my PhD work was unusually high (usually associated with stress) and the video recording showed that dog barking incessantly in its kennel yard for an extended period of time, I might interpret that as a dog with a significant stress response to being kennelled. However, if I know that at that particular time of behavioural sampling and prior to the saliva collection there was a thunderstorm taking place, it might change how I interpret the data in front of me. It’s critical not to overlook even the simplest of environmental factors (like temperature) that have been shown to affect both animal behaviour and physiology.

This is truly just the tip of the ‘assessing animal welfare’ iceberg and there's always more to learn. I haven’t touched on the hot topics of ‘quality of life’, ‘affective states’, individual vs. population welfare, the interplay of public attitudes/perceptions and ethics with animals welfare or why there is currently an emphasis about avoiding bad welfare rather than promoting the good – lucky we have time on our side for all of that! 

Hopefully this has helped give you an idea of why multiple (physiological and behavioural) measures are so important in assessing canine welfare – the more information you have to help with the interpretation of an animal’s experience, the better – until that smartphone app' comes along anyway!

So how was your weekend, anyway?

Mia

Dreschel, N.A. & Granger, D.A. (2009). Methods of collection for salivary cortisol measurement in dogs, Hormones and Behavior, 55 (1) 168. DOI: 10.1016/j.yhbeh.2008.09.010

Martin, P. & Bateson, P. (2007) Measuring Behaviour: An Introductory Guide. (3rd Ed.) Cambridge University Press. ISBN: 9780521535632


© Mia Cobb 2012
Continue Reading »
DoYouBelieveInDog
0 Comments

You Might Also Like

16 August 2012

Approval endorsed! Now about that PhD...

Approval endorsed! Now about that PhD...


Oh wow Julie!
The things crossing your desk are pretty darn exciting, I must say! 
Your first peer-reviewed scientific journal publication is totally awesome! It’s a study that I really enjoyed reading about and especially like this video illustration of how owner scolding can influence dog behaviour – poor Denver! 

I look forward to hearing more about the research you’ve done and are currently doing.
What things are you up to at the moment?  
“I’m working on my PhD”
I like these words a lot. They are on my wall.
It feels a little like I’ve been saying that forever, but technically, it’s not forever (yet). It HAS been several years, but turns out that if you pursue part-time post-grad’ research while juggling full time work, throw in a baby for an extra degree of difficulty (if only they assessed PhD’s like Olympic diving!) and also try to maintain some sort of life (friends are important!), it’s actually quite easy not to get a PhD done in 3 years. It will be a fantastic achievement when I submit it and I have a good feeling that’s not too far away now.
So what is it anyway?  My research is looking at the effect of an enrichment program on the welfare and performance of working dogs housed in a kennel facility. This came up as something that needed further investigation when I was managing the Training Kennel & Vet Clinic Department at Guide Dogs Victoria.
Most kennel facilities are pretty typical - built to easily maintain hygiene, house lots of dogs safely and securely in a limited amount of space. Because of this, even when facilities are new and kept clean, they are often sterile and unable to meet dogs’ behavioural needs
A working dog kennel facility I visited recently - sterile, much?
<<<< Know what I mean?
  
Certain behaviours seen in kennelled dogs, such as coprophagia (eating their own or other dogs’ poo – a behaviour not many people openly talk about, but it’s widely seen in kennelled populations), barking, floor licking and excessive self-grooming, have been linked to chronic  stress in dogs, helping identify where welfare could be improved.  
Too much of a good thing?
Both social (with people or other dogs/animals) and environmental (physical/sensory) enrichment have been shown to benefit dogs housed in kennel facilities, but no one has looked at the effects of putting these elements together into a structured program. Lots of organisations have implemented enrichment programs in their facilities, but we don’t actually know if it’s benefiting the dogs. It might just be that it makes us people feel better.  There’s a chance we might be stressing the dogs by giving them too much to do! This is important, not just to the dogs themselves, but in terms of the work we are wanting them to do.
How do you do that?  There are a few pieces to my PhD’s pie. First, I showed that dogs had a physical (stress and immune system) response to entering the kennel facility after leaving their family-home foster environment. Then we placed some dogs into the structured enrichment program and others were kept in the typical kennel manner. 
We videoed their behaviour and collected saliva/blood to monitor what was going on inside their bodies that we couldn’t see. Using multiple measures (both behavioural and physiological information) is really important when trying to assess animal welfare. I’ll compare the data from the two groups (enriched and standard kennels) to find out if enrichment made a difference to their welfare.
This study occurred while the dogs were being assessed for entry to guide dog training. So as well as information about how they coped with the kennels and whether the enrichment program helped to improve their welfare, we can also see if there is a relationship between their stress levels and their performance in assessment.  I'm VERY interested in this concept of 'Canine Performance Science' in working dogs. I also ran an online survey that over 2,145 people completed about their attitudes and perceptions in regards to working dogs, welfare, kennels, enrichment and training. I am looking at how these opinions vary between general public, kennel staff and dog trainers.
I’m looking forward to my number crunching being finished so I can share my results with everyone! Helping effect change is something I love in my work and it will be satisfying to contribute towards improving the welfare of kennelled dogs who go on to help people with their amazing work.
That’s all from me for now, I look forward to hearing what you’re doing currently,

Mia 

© Mia Cobb 2012
Continue Reading »
DoYouBelieveInDog
5 Comments

You Might Also Like

[name=Do You Believe in Dog?] [img=https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEih0oTdT87wf4V9ic3qh3r4nwYEQ2IsqFtweaU5RXbfIGujIMEg7n7jBmLq88mM9ZWZZ74jemUA2tK0UDNV-mLf4Mx7UzOEv6FISOcaffwhjDIU-9DgKhUj1VILdKBCInozoneqSXX6_kPP/s100/DYBID3+SPARCS2013.jpg] [description=Do You Believe in Dog? is a popular canine science platform presented by Mia Cobb and Julie Hecht. We think it's important that everyone be able to access and understand the latest canine research.] (facebook=https://www.facebook.com/DoYouBelieveInDog/) (twitter=https://www.twitter.com/doubelieveindog/) (instagram=https://www.instagram.com/mlcobb77/) (instagram=https://www.instagram.com/dogspies/)

Follow @SunriseSunsetBlog