Start Submission Become a Reviewer

Reading: The Science Behind the Magic? The Relation of the Harry Potter “Sorting Hat Quiz” to Persona...

Download

A- A+
Alt. Display

Original research report

The Science Behind the Magic? The Relation of the Harry Potter “Sorting Hat Quiz” to Personality and Human Values

Authors:

Lea Jakob ,

Assessment Systems International, Prague, CZ
X close

Eduardo Garcia-Garzon,

Universidad Autónoma de Madrid, Madrid, ES
X close

Hannes Jarke,

RAND Europe, Cambridge, GB
X close

Fabian Dablander

Department of Psychological Methods, University of Amsterdam, NL
X close

Abstract

The Harry Potter series describes the adventures of a boy and his peers in a fictional world at the “Hogwarts School of Witchcraft and Wizardry”. In the series, pupils get appointed to one of four groups (Houses) at the beginning of their education based on their personality traits. The author of the books has constructed an online questionnaire that allows fans to find out their House affiliation. Crysel, Cook, Schember, and Webster (2015) argued that being sorted into a particular Hogwarts House through the Sorting Hat Quiz is related to empirically established personality traits. We replicated their study while improving on sample size, methods, and analysis. Although our results are similar, effect sizes are small overall, which attenuates the claims by Crysel et al. The effect vanishes when restricting the analysis to participants who desired, but were not sorted into a particular House. On a theoretical level, we extend previous research by also analysing the relation of the Hogwarts Houses to Schwartz’s Basic Human Values but find only moderate or no relations.
Subject: Psychology
How to Cite: Jakob, L., Garcia-Garzon, E., Jarke, H., & Dablander, F. (2019). The Science Behind the Magic? The Relation of the Harry Potter “Sorting Hat Quiz” to Personality and Human Values. Collabra: Psychology, 5(1), 31. DOI: http://doi.org/10.1525/collabra.240
1152
Views
52
Downloads
Altmetric
  Published on 08 Jul 2019
 Accepted on 14 Jun 2019            Submitted on 03 Mar 2019

Cultural mass phenomena such as book series can have a long-lasting effect on social attitudes, emotional perception, and personal relations (Gabriel & Young, 2011). As readers are immersed in a fictional world, they examine characters’ points-of-view, ultimately reacting and connecting with them—as well as with other fictional elements—through identification, parasocial interaction, or imitating behaviour. Specifically, identification is said to occur when readers conduct deep processing of fictional elements, aligning themselves and adopting characters’ emotions, core values, and psychological traits as a result (Cohen, 2001). Identification can be described as “being in a character’s shoes and seeing the world through its eyes” (Tal-Or & Cohen, 2010, p. 404). Although readers and spectators tend to identify with those fictional elements that are believed to be closer to one’s characteristics (Cohen, 2001; Turner, 1993), identification can lead to changes in one’s perception of the self and environment. There is ample evidence that identification processes can influence individual psychological states such as self-esteem (Turner, 1993) and well-being (Branscombe, Schmitt, & Harvey, 1999), as well as an individual’s personality (Djikic, Oatley, Zoeterman, & Peterson, 2009). Being immersed in a fictional world may affect the individual’s behaviour, influencing readers’ views on social and emotional situations which are vicariously experienced through the situations, thoughts, and emotions of characters (Das, 2013). Mar and Oatley (2008) argue that such an immersion into a narrative has not just an entertaining function. Albeit on an abstract level, it exposes readers or viewers with social situations and provides them with social knowledge. As a simulation of how the world could be, the story can provide the reader or viewer with perspectives and knowledge that inform and influence their view of the real world.

The Harry Potter book and movie series, with their worldwide impact and fan base, have been an essential part of growing up for many children and adolescents. Therefore, the Harry Potter series provides an excellent opportunity to study how readers identify with fictional elements, and how these elements could potentially influence readers’ own behaviours and perspectives (Crysel, Cook, Schember, & Webster, 2015). As such, the series has sparked interest of researchers with a variety of backgrounds (coming primarily from psychology and neuroscience; Crysel et al., 2015; Hsu, Jacobs, Citron, & Conrad, 2015; Hsu, Jacobs, & Conrad, 2015). Additionally, the series has several features that foster identification processes, such as belonging to a narrative genre, providing realistic characters with common experiences to those of the reader (including heavily stereotyped behaviour; Cohen, 2001), building a long-lasting relationship with the consumer (books and movies publications’ spanning over more than 14 years; Rubin & McHugh, 1987), and presenting characters with diverse demographic characteristics that appeal to potential readers with similarly diverse demographic characteristics (Maccoby & Wilson, 1957).

The story follows the lives of a group of young wizards and witches and their adventures. An important aspect of the main arc is that most characters attend (or have attended) a magic school called the “Hogwarts School of Witchcraft and Wizardry”. The Hogwarts House system plays a central role in the character and main arc development. In this school, incoming students are classified into distinctive Houses (Gryffindor, Slytherin, Hufflepuff, or Ravenclaw; see Table 1). Each House is described in detail by J. K. Rowling in order to represent distinctive individual characteristics, which have subsequently been associated with well-established psychological traits (Crysel et al., 2015; van der Laken, 2017). Ultimately, House assignment can provide its members with a feeling of belonging (Press, 1989; Reina, 2014).

Table 1

Distinctive traits for each House based on the first three authors’ readings of the Harry Potter books.

Hogwarts House Values

Gryffindor Bravery, helping others, and chivalry.
Hufflepuff Hard work, patience, loyalty, and fair play.
Ravenclaw Intelligence, knowledge, planning ahead, and wit.
Slytherin Ambition, cunningness, heritage, and resourcefulness.

Previous Study and Current Aim

Harry Potter fans can be assigned to one of these Houses by filling out an eight-item questionnaire (the Sorting Hat Quiz) available on the Pottermore website (https://www.pottermore.com). Crysel et al. (2015) asked Pottermore users to complete the Sorting Hat Quiz as well as to answer questions regarding their personality traits such as the Big Five (McCrae & John, 1992) and the Dark Triad (Jones & Paulhus, 2013). The authors report significant associations between personality characteristics and House affiliation in line with the depictions in the book; for instance, they found that Slytherin House members scored higher on Dark Triad traits. It is important to note that the Sorting Hat Quiz was not developed with any scientific purpose in mind, and includes items of ambiguous content such as “Dawn or Dusk?” and “Heads or Tails?”. Thus, on the face of it, the validity of the Sorting Hat Quiz seems problematic. However, we do not wish to question J.K. Rowling, as albeit opaque to us, she might have had deep reasons for including such questions; moreover, being a proprietary test, the scoring rules are not public. This viewpoint may be substantiated by the results of Crysel et al. (2015), who found that the Sorting Hat Quiz is related to established personality traits. We refer back to this tension between face validity and predictability in the discussion.

Crysel et al. (2015) were the first to study the relation between Harry Potter Houses and established personality traits. However, their study has several limitations which attenuate the strength of the authors’ conclusions. First, the overall sample size collected was low (N = 132), with certain Houses being represented by a remarkably small number of respondents (e.g., n = 23 for Gryffindor). This could have led to overestimated effect sizes, since the only way to get a significant result is by having an estimate that “overcomes” a large standard error (e.g., Yarkoni, 2009). Two main concerns were present with regards to Crysel et al.’s selection of measures. Firstly, personality scales were deemed as unreliable, with Cronbach’s alpha as low as .48 (Agreeableness) and .42 (Openness). Thus, selecting short measures of personality could pose some problems in the latter analysis. Low reliability poses problems when performing ANOVA (in terms of Type I and II errors) using observed scores (Bobko, Roth & Bobko, 2001), as measurement error—which increases as reliability decreases—directly disattenuates the squared sum of errors involved in the F-statistic computation (which would be underestimated; Liu, & Salvendy, 2009). Ultimately, this situation would also affect the classical significance test involved. Second, the choice of short versions for personality measurements may have undermined internal consistency (see Table 1 in Crysel et al., 2015) and given a less precise picture of participants’ personalities. Finally, we believe that the analysis proposed by Crysel et al. (2015) did not adequately reflect the research questions they aimed to test, and under certain circumstances could have led to wrong conclusions (see Statistical Analysis section).

In the current study, we aim to address these limitations by conducting a replication of Crysel et al. (2015). Specifically, we recruited a considerably larger sample of participants, employed measures with stronger psychometric properties, and utilized a Bayesian framework to more adequately translate theoretical predictions into statistical hypotheses (Etz, Haaf, Rouder, & Vandekerckhove, 2018; Klugkist & Hoijtink, 2007).

The Basic Human Values

On a theoretical level, we stipulate that the decisions made by the Sorting Hat are more strongly based on an individual’s values rather than on personality traits. This hypothesis is based on human values (Table 2) being more closely aligned with House descriptions as reflected in the Harry Potter books. According to Schwartz (2012), the relative importance of multiple values one holds guides actions, distinguishing the existing values by the theoretical model from one another by the goal or the motivation they express (Table 2). Therefore, we aim to investigate whether identification processes could relate to the theory of Basic Human Values (Schwartz, 1992; Schwartz & Bilsky, 1990). Additionally, values are thought to be universal across cultures, and the theory of Human Values may be a useful framework for understanding a person’s identification with fictional elements. To our knowledge, the relation between Human Values and the identification with fictional elements has not been explored in the literature before.

Table 2

Basic human values and their descriptions (Schwartz, 2012).

Basic Human Value Characteristics

Conformity Restraint of actions, inclinations, and impulses likely to upset or harm others and violate social expectations or norms.
Tradition Respect, commitment, and acceptance of the customs and ideas that one’s culture or religion provide.
Benevolence Caring for the welfare of the people with whom one is in frequent personal contact.
Universalism Understanding, appreciation, tolerance, and protection for the welfare of all people and nature.
Self-direction Independent thought and action, namely choosing, creating, and exploring.
Stimulation Excitement, novelty, and challenge.
Hedonism Pleasure and gratification of the senses.
Achievement Personal success through demonstrating competence in accordance with social standards.
Power Social status and prestige on the one hand, but also control and dominance over people and resources on the other hand.
Security Seeking safety, harmony, and stability of society, relationships, and of self, respectively.

Methods

We report how we attained our sample size, all data exclusions (if any), all manipulations, and all measures in the study (as suggested by Simmons, Nelson, & Simonsohn, 2012). Statistical analyses were performed using the R environment for statistical computing (R Development Core team, 2015). All materials including data and code can be found online at https://osf.io/rtf74/. This research was conducted in accordance to the Declaration of Helsinki, with ethical approval granted by the Department of Psychology, Centre for Croatian Studies, University of Zagreb, prior to data collection. All participants provided informed consent for survey procedure, and were informed about data handling procedures prior to their participation.

Participants

We recruited participants through social media (Facebook, Twitter, and Reddit), private contacts, and student e-mail groups. Of the 988 participants who took part in our study, 91 participants were excluded for not meeting the age criterion of 18 years, and one for indicating an age of 122. We removed 49 of the remaining participants as the Sorting Hat assigned them to multiple Houses, resulting in a total sample size of 847 (Table 3). The median age of the remaining participants was 23 with a standard deviation of 4.36. The majority of participants were women (702).

Table 3

Participants’ desired Houses and their House assignments from the Sorting Hat.

Desired House Assigned House

Gryffindor Hufflepuff Ravenclaw Slytherin Total

Gryffindor 125 27 57 8 217
Hufflepuff 34 126 48 8 216
Ravenclaw 26 17 214 12 269
Slytherin 20 14 24 87 145
Total 205 184 343 115 847

Measures

Prior to the start of this study, each participant was requested to, if they have not done so before, complete the Pottermore Sorting Hat Quiz. The items and scoring key of the Sorting Hat Quiz are not publicly available, and our multiple attempts to obtain access have not been successful. In general, the Sorting Hat Quiz uses a database of 28 questions and eight questions are displayed to each test taker. The questions have a range of possible answers and the questions seem to not always be related to a particular trait of the House members, although most have a clear relation to a certain part of the Harry Potter series and Houses described in it.

Subsequently, participants were asked for the assigned Hogwarts House membership and whether it constituted their desired House. We had no means to check whether the person was providing rightful information with regards to the House assigned by the Pottermore quiz, as we had no access to the quiz itself and thus had to trust individuals to provide sincere responses. Additionally, participants were asked to declare which House they would like to have been sorted in. Demographic data collected included age, gender, country, education level, occupation, and native language, as well as data about participants’ experience with the Harry Potter franchise (i.e., the books and movies they have read or watched).

Personality Measure

Building upon the hypotheses proposed by Crysel et al. (2015), we decided to reproduce their research design—with a few modifications. In particular, while they used the Ten-Item Personality Inventory (TIPI; Gosling, Rentfrow, & Swann, 2003) to measure the Big Five traits (Extraversion, Conscientiousness, Agreeableness, Emotional Stability, and Openness to Experience), we chose the 50-item International Personality Item Pool (IPIP 50; Goldberg et al., 2006). The IPIP 50 encompasses ten items per trait, and it provides higher reliability than other alternatives (Ypofanti et al., 2015). The items present individual descriptions measured with a 5-point Likert scale (1 = very inaccurate to 5 = very accurate).

The Dark Triad Measure

The Dark Triad encapsulates three personality traits often deemed negative (Jones & Paulhus, 2013): Psychopathy (lack of emotional warmth for others or empathy paired with sensation seeking, risk-taking behaviour, and lack of guilt); Machiavellianism (tendency to manipulate others for own gain); and Narcissism (exaggerated sense of grandiosity, importance, entitlement, and need to be admired). To improve reliability, we again replaced the original questionnaire with an alternative. While the original authors selected the Dark Triad Dirty Dozen, we selected the Short Dark Triad (SD3, Jones & Paulhus, 2013). It evaluates the three personality traits with nine items per trait on a five-point Likert-scale (1 = strongly disagree to 5 = strongly agree). Total scores for each IPIP-50 or SD3 subscale are obtained by summing the respective item scores.

The Human Values Measure

We measured participants’ values via the Portrait Values Questionnaire (PVQ-RR; Schwartz et al., 2012). The PVQ-RR uses 57 items to describe an individual’s goal held as important in their life, and the respondent is prompted to indicate to what extent he or she is similar to this fictional individual. The items are measured using a 6-point Likert-scale (1 = not like me at all to 6 = very much like me). The scores are obtained as a 10-value model following the instructions provided by Schwartz (2016), namely reversing negative items as well as obtaining mean-centred PVQ values’ scores.

Statistical Analysis

Crysel et al. (2015) hypothesized that Gryffindor would score higher on Extraversion; Ravenclaw on Intellect; Hufflepuff on Agreeableness, Emotional Stability, and Conscientiousness; and Slytherin on Machiavellianism, Narcissism, and Psychopathy. They used ANOVAs with Helmert contrasts to compare, for example, the mean score of Gryffindor against the mean score of all the other Houses. However, it is possible for Gryffindor to have significantly higher scores than the mean of the other Houses even if Ravenclaw and Slytherin have higher scores than Gryffindor. For this situation to happen, the remaining House (e.g., Hufflepuff) would only need to score substantially lower on this variable (see Appendix 1 for a simulated example). Thus, this statistical approach could provide misleading results under specific (but not unlikely) circumstances.

We decided to employ an alternative statistical approach that would allow us to test what we believe are the original authors’ (and our) specific research questions: Does Gryffindor score highest on Extraversion? Ravenclaw highest on Intellect? Hufflepuff highest on Agreeableness, Emotional Stability, and Conscientiousness? Slytherin highest on Machiavellianism, Narcissism, and Psychopathy?

We use Bayesian order-constrained inference to assess the evidence for these hypotheses. Bayesian statistics entails quantifying one’s uncertainty about the world using probability; for details, see Appendix 2. For a gentle introduction which incidentally uses Harry Potter as an example, see Etz and Vandekerckhove (2018).

Our statistical approach is as follows: for each hypothesis of interest, we compared three main models that reflected three different hypotheses regarding Houses’ means on the trait of interest. First, we specified a restricted model (Mr) that reflected our substantive hypothesis. In other words, in this model one of the House means is restricted to be higher than the alternative Houses’ means. This definition reflects our hypothesis that members of a specific House are expected to score the highest when compared with members of other Houses. Second, we estimated a full model (Mf) where the means were allowed to vary freely. In other words, this model reflects a lack of knowledge regarding which House (if any) will score higher or lower. Finally, we estimated a model (M0) in which all means were constrained to be equal. This model reflects the hypothesis that House membership is not associated with personality.

For each of our hypotheses, we tested which of the three models was supported by the data using Bayes factors. The Bayes factor formalizes how well one model (e.g., the model reflecting our hypothesis; Mr) predicts the observed data relative to another model (e.g., the model implying all Houses means to be equal; M0). Consequently, a higher Bayes factor when comparing Mr against M0 would indicate that data are supporting our hypothesis compared to the hypothesis that all Houses have the same mean. To compare all three models at once, we transform the Bayes factors into posterior model probabilities. Interpreting these posterior model probabilities requires care. First, we have assigned uniform priors to models, and readers may prefer different priors. Second, by reporting posterior model probabilities, we have effectively reduced the number of possible models to three. We are thus in the “small world of statistics” (McElreath, 2015): probability statements are conditional on the set of models (see also Morey, Romeijn, & Rouder, 2013). From a pragmatic perspective, however, we believe that the three models we focus on here are fairly exhaustive: they include a sceptic’s view, predicting that all means are equal (M0); the most flexible (Mf) model; and a substantively motivated model (Mr). We complete these analyses by estimating the variance explained for each case (Marsman, Waldorp, Dablander, & Wagenmakers, 2019). Prior information is needed in Bayesian inference. We used “default priors” for all our analyses (Rouder, Morey, Speckman, & Province, 2012); further details concerning priors and sensitivity analyses are presented in Appendix 2.

Results

Descriptive Statistics

Descriptive information regarding each House’s raw scores on personality measures is visualised in Figure 1. Overall, individuals scored higher in Intellect and Agreeableness and lower on Dark Triad traits (especially Narcissism and Psychopathy), irrespective of House membership.

Figure 1 

Raw data boxplots for the Big Five and Dark Triad scores across Houses. Agreeabl. = Agreeableness, Conscient. = Conscientiousness, EmStability = Emotional Stability, Machiav. = Machiavellianism.

Table 4 displays the descriptive statistics, the correlations among the personality traits, and Cronbach’s α, an estimate of internal consistency (Cronbach, 1951; Cronbach & Shavelson, 2004). In contrast with Crysel et al., (2015), all measures showed excellent internal consistency indices, improving scale reliability.

Table 4

Descriptive statistics and correlations for all traits.

Trait Mean SD α E A I ES C P M N

Extraversion 28.90 8.40 .90 . .22 .26 .31 .11 .16 .00 .45
Agreeableness 39.51 6.04 .78 .22 . .23 .09 .49 –.42 –.44 –.23
Intellect 40.36 5.51 .87 .26 .23 . .13 .20 .02 .03 .26
Emotional Stability 29.47 7.85 .77 .31 .09 .13 . .08 –.11 –.05 .11
Conscientiousness 35.57 5.15 .82 .11 .49 .20 .08 . –.25 –.11 .02
Psychopathy 19.14 5.46 .81 .16 –.42 .02 –.11 –.25 . .56 .53
Machiavellianism 26.65 6.38 .73 .00 –.44 .03 –.05 –.11 .56 . .54
Narcissism 23.36 5.85 .71 .45 –.23 .26 .11 .02 .53 .54 .

Note: α = Cronbach’s alpha, E = Extraversion, A = Agreeableness, I = Intellect, ES = Emotional Stability, C = Conscientiousness, P = Psychopathy, M = Machiavellianism, N = Narcissism.

Results Concerning Personality

Table 5 displays the posterior model probabilities for each hypothesis. We find that, except for the hypothesis for Emotional Stability, all our hypotheses are supported: the models in which Gryffindor scores the highest on Extraversion, Ravenclaw scores the highest on Intellect, Hufflepuff scores the highest on Agreeableness and Conscientiousness, and Slytherin scores the highest on Machiavellianism, Narcissism, and Psychopathy have the highest posterior probability, respectively.

Table 5

Results of order-constrained model comparison showing posterior model probabilities.

Trait Predicted Highest p(Mr|y) p(Mf|y) p(M0|y)

Agreeableness Hufflepuff .96 .04 .00
Conscientiousness Hufflepuff .94 .06 .00
Emotional Stability Hufflepuff .03 .01 .97
Extraversion Gryffindor .87 .04 .10
Intellect Ravenclaw .96 .04 .00
Machiavellianism Slytherin .96 .04 .00
Narcissism Slytherin .96 .04 .00
Psychopathy Slytherin .96 .04 .00

Note: Due to rounding errors, probabilities can exceed 1. p(Mr|y) = probability of model reflecting researcher’s hypothesis given the data. p(Mf|y) = probability of the full model given the data. p(M0|y) = probability of the restricted model given the data.

Figure 2 shows the posterior distribution over the mean for each dependent variable and House, together with the 87% credible interval of the posterior predictive distribution. This distribution quantifies the uncertainty about a yet unseen data point for a particular House and dependent variable, given the data we have observed. Note that there is considerable uncertainty, indicating that, if one’s (somewhat quixotic) goal is to predict a person’s personality score, House is not of particular predictive utility.

Figure 2 

Posterior distribution of the means from the unconstrained ANOVA model and 87% posterior prediction intervals for the Big Five and Dark Triad scores across Houses. Agreeabl. = Agreeableness, Conscient. = Conscientiousness, EmStability = Emotional Stability, Machiav. = Machiavellianism.

Figure 3 shows that the proportion of variance explained in each case varied across personality measures: 10% (Agreeableness), 2.9% (Conscientiousness), 0.05% (Emotional Stability), 1.4% (Extraversion), 3.8% (Intellect), 11.3% (Machiavellianism), 6.6% (Narcissism), and 6.5% (Psychopathy).

Figure 3 

On each line, shows, for different personality traits, the posterior distribution of the proportion of variance explained by assuming four distinct Houses. Note that variance explained differs substantially between, say, Emotional Stability (EmStability) with 0.05% and Machiavellianism with 11.3%.

Desired House and Personality Traits

In our study, similar as in Crysel et al. (2015), most people who were sorted into a particular House also desired that House (i.e., 60.1% of Gryffindors wanted Gryffindor, 68.5% of Hufflepuffs wanted Hufflepuff, 62.4% of Ravenclaws wanted Ravenclaw, and 75.7% of Slytherins wanted Slytherin). Conversely, most people who desired a particular House were sorted into that House (see Table 3).

Following Crysel et al. (2015), we studied what would happen if individuals would have been sorted to their desired House rather than the actual House sorting decided by the Pottermore quiz. We found a similar pattern of results for sorted and desired House, with the exception of Conscientiousness (p(Mr|y) = 0.77) and Emotional Stability (p(Mr|y) = 0.02). Thus, the desire to be sorted into a particular House—even if not sorted into that House—has very similar effects compared to being sorted into that House. What about people who have been sorted into a House that they did not desire to be sorted into? If the same pattern of results emerges, we could conclude that Crysel et al. (2015) and our finding are not due to self-selection—that is, answering questions in a self-serving way—but that the Pottermore quiz is related to personality. We tested this by restricting our analysis to participants who were sorted into the Houses they did not desire (which resulted in 92 Gryffindors, 90 Hufflepuffs, 55 Ravenclaws, and 58 Slytherins). For all but Agreeableness (p(Mr|y) = 0.90), the evidence was either equivocal or in favour of the null model (e.g., p(M0|y) = 0.90 for Psychopathy). These results suggest that Crysel et al.’s (2015) and our findings are confounded by the desire to be sorted in a particular House; that is, the association between House and personality seems not to be driven by the particular House one is sorted into, but which particular House one desires to be sorted into.

Results Concerning Human Values

We conduct a similar analysis as above for the Human Values data; Figure 4 shows the raw data. Table 6 displays the posterior model probabilities. Note that the second column indicates our confirmatory hypotheses and that our approach can be easily generalized to multiple order restrictions. For example, we predicted that both Gryffindor and Ravenclaw should score higher on the value “Achievement” than Hufflepuff and Slytherin. Such an order-constrained model is then compared against a null model (assuming no differences across Houses) and an unrestricted model (allowing the House means to vary freely). Our hypotheses for Conformity, Power, and Tradition were strongly supported and received the highest possible support. However—and similar to the personality measures—the variance explained by assuming four distinct Houses differed across values, from 1% (Hedonism) to 9.9% (Power). In particular, Figure 5 shows that the proportion of variance explained in each case varied across Human Values, but was generally low: 4.3% (Achievement), 2.7% (Benevolence), 5.1% (Conformity), 1% (Hedonism), 9.9% (Power), 1% (Security), 3.4% (Self-Enhancement), 4.6% (Stimulation), 2.8% (Tradition), 5.6% (Universalism). The variance explained by the Human Values is slightly lower (on average) than the variance explained by the personality measures.

Figure 4 

Raw data boxplots for the Human Values scores across Houses. Achiev. = Achievement, Benev. = Benevolence, Conf. = Conformity, Self. = Self-Enhancement, Stim. = Stimulation, Univ. = Universalism.

Table 6

Results of order-constrained model comparison showing posterior model probabilities.

Value Predicted Highest p(Mr|y) p(Mf|y) p(M0|y)

Achievement Gryffindor, Ravenclaw .01 .99 .00
Benevolence Hufflepuff, Slytherin .14 .84 .01
Conformity Hufflepuff .96 .04 .00
Hedonism Slytherin .53 .03 .45
Power Slytherin .96 .04 .00
Security Hufflepuff, Ravenclaw .19 .05 .76
Self-Enhancement Gryffindor, Slytherin .88 .12 .00
Stimulation Gryffindor, Ravenclaw .86 .14 .00
Tradition Gryffindor, Hufflepuff .93 .06 00
Universalism Gryffindor, Hufflepuff .55 .45 .00

Note: Due to rounding errors, probabilities could exceed 1. p(Mr|y) = probability of model reflecting researcher’s hypothesis given the data. p(Mf|y) = probability of the full model given the data. p(M0|y) = probability of the restricted model given the data.

Figure 5 

On each line, shows, for different Human Values, the posterior distribution for the proportion of variance explained by assuming four distinct Houses. Note that variance explained differs substantially between, say, Hedonism with 1% and Power with 9.9%.

Discussion

Identification with fictional elements influences an individual’s perception of their own personality characteristics and values (Cohen, 2001). Individuals seek to establish connections between fictional elements and themselves, adapting their own views depending on the characteristics and groups identities that represent the main and side characters. Against this background, Crysel et al. (2015) hypothesized that readers and viewers of the Harry Potter series would engage with elements from this work of fiction—the Hogwarts House system—that reflected distinct characteristics which could be linked to individual personality traits (i.e., the Big Five and Dark Triad traits). In other words, Crysel and colleagues (2015) investigated the possibility that Harry Potter fans identify themselves with House-specific personality traits that are congruent with their own personality traits.

We aimed to replicate Crysel et al. (2015) and to gain a more nuanced understanding of identification processes through Houses. To achieve this, we used an alternative, larger sample, and investigated whether similar processes could also be related to the theory of Basic Human Values (Schwartz, 1992). We also employed a statistical framework that allowed us to more directly map our substantive into statistical hypotheses.

Our results partially support the original claims by Crysel et al. (2015), presenting evidence for the association between respondents’ personality and the House they identified with. We also demonstrated that the proportion of variance explained was too weak in many cases to merit specific original claims made by Crysel et al. (2015). It is doubtful that the “distinct Houses appear[s] to correspond to established psychological constructs” (Crysel et al., 2015, p. 178). Both Figure 3 and the central 87% of the posterior predictions displayed as error bars in Figure 2 show that predictive uncertainty remains high. For applied contexts, this means that being a member of a particular Hogwarts House does not reliably predict the relative positioning on personality measures.1 Therefore, even though identification processes could be linked to personality traits to a minor extent, not much is to be learned about the personality of somebody who has been sorted into a particular Hogwarts House. An exception is Slytherin, which leads to a larger explained variance for Agreeableness and the Dark Triad.

On a theoretical level, we hypothesized that the Sorting Hat does not assign Houses based on personality but on values. While we also found some support for our confirmatory hypotheses concerning the theory of Basic Human Values (Schwartz & Boehnke, 2004), the overall effect sizes were again small. Similar to the results concerning personality, the variance explained differed across Human Values. Future research may look into these differences.

We echo the conclusion that an undesired House assignation had little effect on how individuals view themselves; that is, we agree with the original authors that “these findings suggest that participants who wish to be included in their respective Houses largely embodied the same traits associated with those Houses” (2015, p. 178). However, when considering House members who did not want to belong to this House (i.e., individuals who identify themselves with alternative Houses), the observed effect sizes diminished or disappeared. It seems that the desire to be assigned to a specific House acts as a confounder, inducing a relationship between the House assignment based on the Pottermore quiz and personality measures. Thus, under further scrutiny, it seems that not the House assignment per se, but the desire to be sorted into a particular House drives the association between Houses and personality.

The research presented here has various limitations. First, due to copyright restrictions, we did not have access to the individual response patterns but only to the self-reported House assignment. It could be speculated that relations between established psychological constructs and the Hogwarts Houses would be substantiated when looking at individual response patterns instead. However, glancing at the actual questions of the Sorting Hat Quiz, this is not immediately apparent. It features simplistic questions such as “Black or White?” and “Moon or Stars?”, and complex items as “If you were attending Hogwarts, which pet would you choose to take with you?”, with 15 different options to choose from. However, since the scoring rules are not public, it may well be that some of these opaquer questions are added for mere “show”, without actually being counted towards House assignment. If they do count, however, then this might seriously threaten the validity of the measure. Based on our results, it might well be that the Sorting Hat Quiz is valid only for people who have a strong desire to be sorted into a particular House, and thus are able to “game” the Quiz to result in their desired House.

A second limitation is that we analysed the mean responses instead of using latent variable techniques. It is possible that using structural equation modelling would have provided us with a more detailed picture. As we make our data publicly available (https://osf.io/rtf74/) we encourage interested researchers to engage in any additional analysis they find interesting. Lastly, future research should reproduce these results in alternative samples (specifically such that include participants not familiar with the Harry Potter series), controlling for previous knowledge of the fiction works, and potential age-related effects.

Data Accessibility Statement

We have made all our materials, including data and analysis code publicly available at the Open Science Framework (https://osf.io/rtf74/).

Additional Files

The additional files for this article can be found as follows:

Appendix 1

Simulated example of misleading results of ANOVA with Helmert contrasts. DOI: https://doi.org/10.1525/collabra.240.s1

Appendix 2

Details of Bayesian statistical analyses and sensitivity analyses. DOI: https://doi.org/10.1525/collabra.240.s2

Notes

1This seems to contradict the prediction put forward by Katie Mack that employers will soon substitute the Myers-Briggs types with Harry Potter Houses: https://twitter.com/AstroKatie/status/1029537652259913729. 

Acknowledgements

The authors would like to thank Sanja Budimir for her guidance in the initial phases of this project, Jonas Haslbeck and Peter Edelsbrunner for comments on an earlier version of this manuscript, and Alexandra Sarafoglou for her comments on the final version of the manuscript.

Competing Interests

The authors have no competing interests to declare.

Author Contributions

  • Contributed to conception and design: LJ, HJ, and EGG
  • Contributed to acquisition of data: LJ, HJ, and EGG
  • Contributed to analysis and interpretation of data: EGG and FD
  • Drafted and/or revised the article: LJ, HJ, EGG, and FD
  • Approved the submitted version for publication: LJ, HJ, EGG, and FD

References

  1. Bobko, P., Roth, P. L., & Bobko, C. (2001). Correcting the Effect Size of d for Range Restriction and Unreliability. Organizational Research Methods, 4(1), 46–61. DOI: https://doi.org/10.1177/109442810141003 

  2. Branscombe, N. R., Schmitt, M. T., & Harvey, R. D. (1999). Perceiving pervasive discrimination among African Americans: Implications for group identification and well-being. Journal of Personality and Social Psychology, 77(1), 135–149. DOI: https://doi.org/10.1037/0022-3514.77.1.135 

  3. Cohen, J. (2001). Defining Identification: A Theoretical Look at the Identification of Audiences with Media Characters. Mass Communication and Society, 4(3), 245–264. DOI: https://doi.org/10.1207/S15327825MCS0403_01 

  4. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. DOI: https://doi.org/10.1007/BF02310555 

  5. Cronbach, L. J., & Shavelson, R. J. (2004). My Current Thoughts on Coefficient Alpha and Successor Procedures. Educational and Psychological Measurement, 64(3), 391–418. DOI: https://doi.org/10.1177/0013164404266386 

  6. Crysel, L. C., Cook, C. L., Schember, T. O., & Webster, G. D. (2015). Harry Potter and the measures of personality: Extraverted Gryffindors, agreeable Hufflepuffs, clever Ravenclaws, and manipulative Slytherins. Personality and Individual Differences, 83, 174–179. DOI: https://doi.org/10.1016/j.paid.2015.04.016 

  7. Das, R. (2013). ‘To be number one in someone’s eyes …’: Children’s introspections about close relationships in reading Harry Potter. European Journal of Communication, 28(4), 454–469. DOI: https://doi.org/10.1177/0267323113483604 

  8. Djikic, M., Oatley, K., Zoeterman, S., & Peterson, J. B. (2009). On Being Moved by Art: How Reading Fiction Transforms the Self. Creativity Research Journal, 21(1), 24–29. DOI: https://doi.org/10.1080/10400410802633392 

  9. Etz, A., Haaf, J. M., Rouder, J. N., & Vandekerckhove, J. (2018). Bayesian inference and testing any hypothesis you can specify. Advances in Methods and Practices in Psychological Science, 1(2), 281–295. DOI: https://doi.org/10.1177/2515245918773087 

  10. Etz, A., & Vandekerckhove, J. (2018). Introduction to Bayesian inference for psychology. Psychonomic Bulletin & Review, 25(1), 5–34. DOI: https://doi.org/10.3758/s13423-017-1262-3 

  11. Gabriel, S., & Young, A. F. (2011). Becoming a Vampire Without Being Bitten. Psychological Science, 22(8), 990–994. DOI: https://doi.org/10.1177/0956797611415541 

  12. Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R., & Gough, H. G. (2006). The international personality item pool and the future of public-domain personality measures. Journal of Research in Personality, 40(1), 84–96. DOI: https://doi.org/10.1016/j.jrp.2005.08.007 

  13. Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003). A very brief measure of the Big-Five personality domains. Journal of Research in Personality, 37(6), 504–528. DOI: https://doi.org/10.1016/S0092-6566(03)00046-1 

  14. Hsu, C., Jacobs, A. M., Citron, F. M., & Conrad, M. (2015). The emotion potential of words and passages in reading Harry Potter – An fMRI study. Brain and Language, 142, 96–114. DOI: https://doi.org/10.1016/j.bandl.2015.01.011 

  15. Hsu, C., Jacobs, A. M., & Conrad, M. (2015). Can Harry Potter still put a spell on us in a second language? An fMRI study on reading emotion-laden literature in late bilinguals. Cortex, 63, 282–295. DOI: https://doi.org/10.1016/j.cortex.2014.09.002 

  16. Jones, D. N., & Paulhus, D. L. (2013). Introducing the Short Dark Triad (SD3). Assessment, 21(1), 28–41. DOI: https://doi.org/10.1177/1073191113514105 

  17. Klugkist, I., & Hoijtink, H. (2007). The Bayes factor for inequality and about equality constrained models. Computational Statistics & Data Analysis, 51(12), 6367–6379. DOI: https://doi.org/10.1016/j.csda.2007.01.024 

  18. Liu, Y., & Salvendy, G. (2009). Effects of measurement errors on psychometric measurements in ergonomics studies: Implications for correlations, ANOVA, linear regression, factor analysis, and linear discriminant analysis. Ergonomics, 52(5), 499–511. DOI: https://doi.org/10.1080/00140130802392999 

  19. Maccoby, E. E., & Wilson, W. C. (1957). Identification and observational learning from films. The Journal of Abnormal and Social Psychology, 55(1), 76–87. DOI: https://doi.org/10.1037/h0043015 

  20. Mar, R. A., & Oatley, K. (2008). The Function of Fiction is the Abstraction and Simulation of Social Experience. Perspectives on Psychological Science, 3(3), 173–192. DOI: https://doi.org/10.1111/j.1745-6924.2008.00073.x 

  21. Marsman, M., Waldorp, L., Dablander, F., & Wagenmakers, E.-J. (2019). Bayesian Estimation of Explained Variance in ANOVA Designs. Statistica Neerlandica, 1–22. DOI: https://doi.org/10.1111/stan.12173 

  22. McCrae, R. R., & John, O. P. (1992). An Introduction to the Five-Factor Model and Its Applications. Journal of Personality, 60(2), 175–215. DOI: https://doi.org/10.1111/j.1467-6494.1992.tb00970.x 

  23. McElreath, R. (2015). Statistical rethinking: A Bayesian course with examples in R and Stan. United Kingdom: Chapman and Hall/CRC. 

  24. Morey, R. D., Romeijn, J. W., & Rouder, J. N. (2013). The humble Bayesian: Model checking from a fully Bayesian perspective. British Journal of Mathematical and Statistical Psychology, 66(1), 68–75. DOI: https://doi.org/10.1111/j.2044-8317.2012.02067.x 

  25. Press, A. (1989). Class and gender in the hegemonic process: class differences in women’s perceptions of television realism and identification with television characters. Media, Culture & Society, 11(2), 229–251. DOI: https://doi.org/10.1177/016344389011002006 

  26. R Core Team. (2015). R: A language and environment for statistical computing. Vienna, Austria. 

  27. Reina, M. (2014). Encouraging difference at Hogwarts: Ravenclaw and Hufflepuff as the other ones. In Charming and bewitching: Considering the Harry Potter series. Bellaterra: Departament de Filologia Anglesa i de Germanística, UAB. 

  28. Rouder, J. N., Morey, R. D., Speckman, P. L., & Province, J. M. (2012). Default Bayes factors for ANOVA designs. Journal of Mathematical Psychology, 56(5), 356–374. DOI: https://doi.org/10.1016/j.jmp.2012.08.001 

  29. Rubin, R. B., & McHugh, M. P. (1987). Development of parasocial interaction relationships. Journal of Broadcasting and Electronic Media, 31, 279–292. DOI: https://doi.org/10.1080/08838158709386664 

  30. Schwartz, S. H. (1992). Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. Advances in Experimental Social Psychology, 25, 1–65. Retrieved from http://www.sciencedirect.com/science/article/pii/S0065260108602816. DOI: https://doi.org/10.1016/S0065-2601(08)60281-6 

  31. Schwartz, S. H. (2012). An overview of the Schwartz theory of basic values. Online Readings in Psychology and Culture, 2(1), 11. Retrieved from http://scholarworks.gvsu.edu/orpc/vol2/iss1/11/. DOI: https://doi.org/10.9707/2307-0919.1116 

  32. Schwartz, S. H. (2016). Coding and analyzing PVQ-RR data (instructions for the revised Portrait Values Questionnaire). DOI: https://doi.org/10.13140/RG.2.2.35393.56165 

  33. Schwartz, S. H., & Bilsky, W. (1990). Toward a theory of the universal content and structure of values: Extensions and cross-cultural replications. Journal of Personality and Social Psychology, 58(5), 878. Retrieved from http://psycnet.apa.org/journals/psp/58/5/878/. DOI: https://doi.org/10.1037/0022-3514.58.5.878 

  34. Schwartz, S. H., & Boehnke, K. (2004). Evaluating the structure of human values with confirmatory factor analysis. Journal of Research in Personality, 38(3), 230–255. Retrieved from http://www.sciencedirect.com/science/article/pii/S0092656603000692. DOI: https://doi.org/10.1016/S0092-6566(03)00069-2 

  35. Schwartz, S. H., Cieciuch, J., Vecchione, M., Davidov, E., Fischer, R., Beierlein, C., Konty, M., et al. (2012). Refining the theory of basic individual values. Journal of Personality and Social Psychology, 103, 663–688. DOI: https://doi.org/10.1037/a0029393 

  36. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2012). A 21 Word Solution. SSRN Electronic Journal. DOI: https://doi.org/10.2139/ssrn.2160588 

  37. Tal-Or, N., & Cohen, J. (2010). Understanding audience involvement: Conceptualizing and manipulating identification and transportation. Poetics, 38, 402–418. DOI: https://doi.org/10.1016/j.poetic.2010.05.004 

  38. Turner, J. R. (1993). Interpersonal and psychological predictors of parasocial interaction with different television performers. Communication Quarterly, 41, 443–453. DOI: https://doi.org/10.1080/01463379309369904 

  39. van der Laken, P. (2017). Harry Potter: Hogwarts Houses and Their Stereotypes. Available from: https://paulvanderlaken.com/2017/08/22/harry-plotter-part-2-hogwarts-houses-and-their-stereotypes/ 

  40. Yarkoni, T. (2009). Big correlations in little studies: Inflated fMRI correlations reflect low statistical power—Commentary on Vul et al. (2009). Perspectives on Psychological Science, 4(3), 294–298. DOI: https://doi.org/10.1111/j.1745-6924.2009.01127.x 

  41. Ypofanti, M., Zisi, V., Zourbanos, N., Mouchtouri, B., Tzanne, P., Theodorakis, Y., & Lyrakos, G. (2015). Psychometric properties of the International Personality Item Pool Big-Five personality questionnaire for the Greek population. Health Psychology Research, 3(2). DOI: https://doi.org/10.4081/hpr.2015.2206 

comments powered by Disqus