{"id":283,"date":"2018-05-23T07:42:18","date_gmt":"2018-05-23T14:42:18","guid":{"rendered":"http:\/\/blogs.magicjudges.org\/road-to-l3\/?p=283"},"modified":"2018-05-23T07:42:18","modified_gmt":"2018-05-23T14:42:18","slug":"gender-bias-in-the-l3-advancement-process","status":"publish","type":"post","link":"https:\/\/blogs.magicjudges.org\/road-to-l3\/2018\/05\/23\/gender-bias-in-the-l3-advancement-process\/","title":{"rendered":"Gender bias in the L3 advancement process"},"content":{"rendered":"<p><span style=\"font-weight: 400\">I would like to introduce a great analysis by Nicolette Apraez &amp; Anniek van der Peijl about the impact of gender in the L3 advancement process. The analysis is based on global data and paints a picture from a new perspective on the advancement process.<br \/>\nMatteo<\/span><\/p>\n<h1><span style=\"font-weight: 400\">Abstract <\/span><\/h1>\n<p><span style=\"font-weight: 400\">We conducted a research project to investigate whether there is gender bias in the L3 advancement process. This project covered 3 main lines of investigation:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Data from panels conducted between 2012 and 2017<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">A questionnaire asking people about their perceptions regarding gender bias.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Qualitative data from comments and statements.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">The results showed the following:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">It looks like women are more eager to attain L3 and are encouraged more to pursue L3 than men are. This is also reflected in the greater representation of women among higher judge levels.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">There are differences between the genders in the L3 qualities that candidates are rated deficient (minor or major) in.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Women on average feel that they are being treated and evaluated differently because of their gender, and consider the PEI and panel as less fair than their male counterparts.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Gender bias is a \u2018hot topic\u2019. Opinions on it appear to be strong and widely divergent. <\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">Based on these results it appears that while people feel there is gender bias in the process such that women are at a disadvantage, women actually report receiving more encouragement, and are better represented among L3 judges than among L2 judges. In short, it appears that there is no bias at work that is actually keeping women from making L3. We do suggest making the L3 process anonymized where possible to reduce possible bias and including as much transparency as possible to reduce the perception of bias.<\/span><\/p>\n<p>&nbsp;<\/p>\n<h1><span style=\"font-weight: 400\">Introduction <\/span><\/h1>\n<p><span style=\"font-weight: 400\">During a leadership meeting at a GP, the topic of potential gender bias in the L3 advancement process was raised (link to judge apps meeting report thread here). As a spin-off from that discussion, we set out to gather some data on the subject. <\/span><span style=\"font-weight: 400\">We started a research project so we could say with more certainty whether that bias indeed exists and if so, what it looks like. This project covered 3 main lines of investigation:<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">We analyzed the panel data available from the advancement committee. This can be considered as the most \u2018objective\u2019 data, since it reflects real panels taken by real people with real results.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">We ran a short questionnaire aimed at L2 and L3 judges, asking for their experiences with and views on the L3 advancement process and gender bias. This was intended to find out the subjective perception of the process.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">We collected statements from individual people who wished to share their views with us. This is responses collected in the \u2018comments\u2019 box of the questionnaire and follow-up conversations from the questionnaire. The aim of this was to get an impression of the views and concerns that are held in the community, and to make these available as feedback on the L3 process and the program.<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400\">This report contains the results of our investigation, in the order listed above. Please note that if you would like more details on any of the results (like exact numbers or standard deviations), you will find them in the Appendix.<\/span><\/p>\n<p><span style=\"font-weight: 400\">At the end, we provide an overall conclusion and suggestions to improve the L3 process.<\/span><\/p>\n<blockquote><p><em><span style=\"font-weight: 400\">*A note on the representation of people identifying as LGBTQ+: The questionnaire did allow people to indicate their identity in a number of categories other than \u2018male\u2019 and \u2018female\u2019 as well as a range of sexual orientations. However the number of respondents in some of these categories was very low, making statistical analysis less feasible, and the number of categories alone would potentially make this report overwhelmingly complex to interpret. Therefore, for this particular report you will not see results of the questionnaire split by those identity categories. However, if anyone would like to begin research into seeing if our findings carry over to non-binary groups (or indeed any other questions you\u2019d like to answer with our data), we\u2019d be happy to share an anonymized version of the survey responses we collected.<\/span><\/em><\/p><\/blockquote>\n<p>&nbsp;<\/p>\n<h1><span style=\"font-weight: 400\">Analysis of L3 panel data<\/span><\/h1>\n<p><span style=\"font-weight: 400\">We analyzed the panel data of 158 candidates that were in the advancement process between 2012 and 2017. <\/span><\/p>\n<h2><span style=\"font-weight: 400\">Representation<\/span><\/h2>\n<p><span style=\"font-weight: 400\">The percentage of female candidates in this group was 10.2%, which is higher than the representation of women at L2 (at 7%). This suggests that women are more likely to pursue L3.<\/span><\/p>\n<p><span style=\"font-weight: 400\">This data is also consistent with the observation that female representation among judges goes up among the higher levels. Based on 2017 census data collected by RCs the percentage of female judges at each level is as follows:<\/span><\/p>\n<table border=\"1\">\n<tbody>\n<tr>\n<td style=\"text-align: center\"><span style=\"font-weight: 400\">L1<\/span><\/td>\n<td style=\"text-align: center\"><span style=\"font-weight: 400\">L2<\/span><\/td>\n<td style=\"text-align: center\"><span style=\"font-weight: 400\">L3<\/span><\/td>\n<\/tr>\n<tr>\n<td style=\"text-align: center\"><span style=\"font-weight: 400\">5% female<\/span><\/td>\n<td style=\"text-align: center\"><span style=\"font-weight: 400\">7% female<\/span><\/td>\n<td style=\"text-align: center\"><span style=\"font-weight: 400\">15% female<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><span style=\"font-weight: 400\">Of 131 candidates<\/span><span style=\"font-weight: 400\"> panels (the remaining candidates were either in pre-panel state or were missing the panel member information) we had data from the \u2018other side of the table\u2019 too, allowing us to see representation of women among panel members (lead or otherwise). Among the people administering the panels during that time, there was a 9.5% chance of a panel member being female. Because a panel is made up of multiple people, the percentage of panels that had at least one female member on it was higher, at 22.1%.<\/span><\/p>\n<h2><span style=\"font-weight: 400\">Deficiencies<\/span><\/h2>\n<p><span style=\"font-weight: 400\">Below is a graph indicating how male vs. female candidates\u2019 qualities were rated by the panel. It shows which percentage of candidates received either a minor or major deficiency in each of the L3 Qualities, split by gender. Please note that due to changes in the list of Qualities during the period in which this data was collected there are some duplicate\/similar categories.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-286 size-large\" src=\"http:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture1-1024x690.png\" alt=\"\" width=\"980\" height=\"660\" srcset=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture1-1024x690.png 1024w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture1-300x202.png 300w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture1-125x84.png 125w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture1.png 1057w\" sizes=\"auto, (max-width: 980px) 100vw, 980px\" \/><\/p>\n<p><span style=\"font-weight: 400\">From this graph, we notice that there are some qualities for which no female candidates have been rated deficient while some male candidates have. <\/span><\/p>\n<p><span style=\"font-weight: 400\">This result is a bit difficult to interpret from a data perspective because the number of female candidates is low, so the result can easily be skewed. But also from a theoretical perspective this could mean multiple things: Are the gender differences there because the panel is biased, or are the differences real and potentially there because social conditioning has taught different skills to each gender?<\/span><\/p>\n<p><span style=\"font-weight: 400\">From a perspective of traditional gender stereotyping, the results are conflicting: It may be considered a stereotype that men score higher on Leadership, Presence &amp; Charisma (which is shown in these results in the shape of fewer deficiencies), but a similar stereotype that men would score better on Stress &amp; Conflict Management is not shown by our data. Indeed, the largest difference between male and female candidates is in Penalty and Policy Philosophy, which is so M:TG specific that it seems unlikely that there are societal gender stereotypes about that quality at all! However, this could be evidence of pushing and encouraging female candidates who have the leadership, logistics, etc skills without diving deep into their understanding of things like investigations or penalty and policy philosophy, as we discuss in our questionnaire analysis.<\/span><\/p>\n<p>&nbsp;<\/p>\n<h1><span style=\"font-weight: 400\">Analysis of Questionnaire data<\/span><\/h1>\n<p><span style=\"font-weight: 400\">A total of 367 judges responded to our questionnaire, of which 330 identified as male and 31 as female.<\/span><\/p>\n<h2><span style=\"font-weight: 400\">Representation and ambition<\/span><\/h2>\n<p><span style=\"font-weight: 400\">We asked people where they were on the road to L3. There are some differences of note here. Of male respondents, around 32% were L2 without interest in L3, versus 16% of female respondents. The women in our sample are more likely than the men to be working on their checklist (26% vs 15%) or still going despite having failed somewhere along the way (10% vs 2%).This data suggests that women in the judge program are more ambitious than their male counterparts: there are fewer of them with no interest in L3 whereas there are more of them actively working towards L3.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-287 size-full\" src=\"http:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture2.png\" alt=\"\" width=\"988\" height=\"565\" srcset=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture2.png 988w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture2-300x172.png 300w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture2-125x71.png 125w\" sizes=\"auto, (max-width: 988px) 100vw, 988px\" \/><\/p>\n<p><span style=\"font-weight: 400\">Part of this phenomenon could be explained by peer encouragement. We found that women report higher levels of encouragement from other judges (both L2 and L3) to pursue L3. This may translate into higher percentages of female judges having interest in L3 advancement.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-288 size-full\" src=\"http:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture3.png\" alt=\"\" width=\"1007\" height=\"553\" srcset=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture3.png 1007w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture3-300x165.png 300w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture3-125x69.png 125w\" sizes=\"auto, (max-width: 1007px) 100vw, 1007px\" \/><\/p>\n<h2><span style=\"font-weight: 400\">Perception of bias<\/span><\/h2>\n<p><span style=\"font-weight: 400\">As described in the introduction, we also wanted to get a feel for how the community perceives the L3 process in terms of gender bias. People\u2019s perceptions shape their behavior, so while perceptions are subjective, they are still important. <\/span><\/p>\n<p>&nbsp;<\/p>\n<h3><span style=\"font-weight: 400\">General bias<\/span><\/h3>\n<p><span style=\"font-weight: 400\">First of all, the results of the questionnaire showed that women feel much more than men that they are treated differently because of their gender:<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-289 size-large\" src=\"http:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture4-1024x489.png\" alt=\"\" width=\"980\" height=\"468\" srcset=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture4-1024x489.png 1024w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture4-300x143.png 300w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture4-125x60.png 125w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture4.png 1051w\" sizes=\"auto, (max-width: 980px) 100vw, 980px\" \/><\/p>\n<p><span style=\"font-weight: 400\">Please note that being treated \u2018differently\u2019 could mean positive or negative or value-neutral differences. So in the next two questions we asked whether people thought their gender was helping or hindering them in their judge career.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-290 size-large\" src=\"http:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture5-1024x369.png\" alt=\"\" width=\"980\" height=\"353\" srcset=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture5-1024x369.png 1024w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture5-300x108.png 300w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture5-125x45.png 125w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture5.png 1107w\" sizes=\"auto, (max-width: 980px) 100vw, 980px\" \/><\/p>\n<p><span style=\"font-weight: 400\">We can see that men and women feel about the same about their gender impacting their odds of getting accepted to events, which also makes sense with the fact that their answers are close to a score of 3, meaning \u2018this doesn\u2019t matter\u2019. For L3 advancement on the other hand, women feel they have a harder time because of their gender. This appears to be in conflict with the result (detailed above) that women report receiving more encouragement to pursue L3. <\/span><\/p>\n<p><span style=\"font-weight: 400\">One possible explanation is that, since the question\u2019s wording includes sexual orientation in addition to gender, sexual orientation may be a factor here. Unfortunately, only 171 participants (out of 367) ticked any of the sexual orientation categories. So if we wanted to split the answers to these questions 4 ways we would have to leave out a large number of participants and be left with one category representing as little as 3 participants. As a result, the question of sexual orientation being a factor here will remain unanswered with our current data set.<\/span><\/p>\n<h3><span style=\"font-weight: 400\">Bias in L3 advancement <\/span><\/h3>\n<p><span style=\"font-weight: 400\">Next we will look at the perception of bias in the concrete steps of the L3 advancement process, those steps being:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">The checklist verification<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">The pre-event interview (PEI)<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">The panel<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">Because we recognise that especially the PEI and panel are quite personal in nature, these are necessarily at least somewhat subjective. This does not need to mean that they are unfair or biased, so we asked questions about both the perception of fairness\/bias, and perception of objectiveness\/subjectiveness. <\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-291 size-full\" src=\"http:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture6.png\" alt=\"\" width=\"975\" height=\"681\" srcset=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture6.png 975w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture6-300x210.png 300w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture6-125x87.png 125w\" sizes=\"auto, (max-width: 975px) 100vw, 975px\" \/><\/p>\n<p><span style=\"font-weight: 400\">Within the L3 process, the checklist verification is rated most objective, followed by the PEI and the panel. This order is the same for both genders, with women rating each activity more objective than men did. The result for fairness is slightly different, with each activity being rated roughly the same in terms of fairness by men, but women rating the checklist as much more fair than the rest of the process. Also note that while women thought the PEI and panel were more objective than men did, they rate the fairness of it lower than men.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-292 size-full\" src=\"http:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture7.png\" alt=\"\" width=\"975\" height=\"681\" srcset=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture7.png 975w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture7-300x210.png 300w, https:\/\/blogs.magicjudges.org\/road-to-l3\/files\/2018\/05\/Picture7-125x87.png 125w\" sizes=\"auto, (max-width: 975px) 100vw, 975px\" \/><\/p>\n<p><span style=\"font-weight: 400\">So either women have a tendency not to equate objectivity with fairness as much as men do, or men are more optimistic that subjectivity does not compromise fairness. The latter would be consistent with the results that women perceive that there is more general gender bias.<\/span><\/p>\n<p>&nbsp;<\/p>\n<h1><span style=\"font-weight: 400\">Qualitative data<\/span><\/h1>\n<p><span style=\"font-weight: 400\">In addition to the quantitative data discussed above, we also had access to various sources of qualitative data, i.e. people\u2019s stories and opinions. For example the comments people left on the questionnaire, things people told us as a follow-up on the questionnaire, forum posts and statements about the topic. We will discuss commonly occurring themes and opinions here.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Most of the comments left on the surveys or made during follow-ups can be broken into a few different categories: Questionnaire Feedback, Positive Support, Unrelated to our Scope, or Contrary Beliefs.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Since the \u201cThanks for doing this\u201d and \u201cAdd an option for X\u201d don\u2019t currently help us, I\u2019m going to focus on contrary beliefs, as well as a few points that, while unrelated to our current scope, are worth mentioning might also cause differences in the Advancement Process for individuals.<\/span><\/p>\n<p>&nbsp;<\/p>\n<h2><span style=\"font-weight: 400\">Unrelated to our Scope<\/span><\/h2>\n<p><span style=\"font-weight: 400\">We were tasked with determining whether or not we believed that there was a systemic issue with Gender Equality in the L3 Advancement Process. A large portion of suggestions\/comments fell outside of our project\u2019s scope. Nearly 16% of our participants who left comments told us that they believed that there were other issues besides gender that we should have been looking into. The comments suggested that Racism, Societal differences, Financial Disparities, and Sexual Orientation are more likely to influence a person\u2019s Advancement Process than gender. While we would have loved to have delved deeper in our research to include information about these groups, we wanted to ensure that our original scope and purpose did not change.<\/span><\/p>\n<p>&nbsp;<\/p>\n<h2><span style=\"font-weight: 400\">Contrary Beliefs<\/span><\/h2>\n<p><span style=\"font-weight: 400\">Another 15% of participants who left comments believed that either they did not believe or had not seen women treated any differently, or that women actually experienced an easier time in the judge program. While some believed that the Program is essentially gender-blind (citing Italy as an example, due to Christiana\u2019s past and present roles in the Program), others argued that women are given more blind chances, and feel as though the program is unfairly giving opportunities to women more often than men. To those participants, we have acknowledged the discrepancy in support is tilted towards women for our study, but as we will go into below, a gender bias is extremely difficult to measure objectively. <\/span><\/p>\n<p>&nbsp;<\/p>\n<h1><span style=\"font-weight: 400\">Limitations<\/span><\/h1>\n<p><span style=\"font-weight: 400\">While we do feel we were able to get a better sense of the average female\u2019s Level 3 process, much of that data came from our questionnaire. This means it could be subject to bias, as those individuals willing to participate are likely to be those men and women who are more invested in the Judge Program. In addition, the questionnaire data reflects people\u2019s perceptions of bias, which may not fully match with actual bias. However, we do think that the perception of bias is important: What people believe to be true about the world around them affects their behavior, so if we want to understand behavior, looking at perceptions becomes inevitable.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Some questions cannot be answered with the data available. One is the pass\/fail rate of panels, since data on past failed panels is not kept by the L3 advancement team. On top of that, the overall low number of female candidates means it\u2019s difficult to identify trends in a statistically meaningful way. For example statistics on the gender of the candidate vs. genders represented on the panel just results in very small group sizes.<\/span><\/p>\n<p>&nbsp;<\/p>\n<h1><span style=\"font-weight: 400\">Conclusions and Suggestions<\/span><\/h1>\n<p><span style=\"font-weight: 400\">In summary, it appears that:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Women are more eager to attain L3 and are encouraged more to pursue L3 than men are. This is also reflected in the greater representation of women among higher judge levels.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">There are differences between the genders in the L3 qualities that candidates are rated deficient (minor or major) in.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Women on average feel that they are being treated and evaluated differently because of their gender, and consider the PEI and panel as less fair than their male counterparts.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Gender bias is a \u2018hot topic\u2019. Opinions on it appear to be strong and widely divergent. <\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">The most interesting and conflicting thing about our findings is that while women feel it\u2019s harder for them to attain L3 than men and consider the PEI and panel to be less fair than men do, at the same time they also report more encouragement to pursue L3. This is also shown in the fact that there is more female representation at L3 than any other level. It seems reasonable to speculate, then, that while there is a fairly strong perception of negative bias towards women, the end result in practice does not support the notion that women are being held back. Of course some of this can be explained by ambition, which lies with the women themselves rather than the community or the advancement system, but some credit should also go to the encouragement given to them. <\/span><\/p>\n<p><span style=\"font-weight: 400\">One matter of concern is that PEI and panel are rated as quite subjective and halfway between fair and unfair by both men and women. While women appear to consider the process on the whole as more objective than men do, the reverse is true for the perception of fairness. The L3 process could be improved in two ways. The first is to make the process more transparent, for example by providing information about how the PEI and panel are \u2018graded\u2019. This would allow candidates to get a better sense of the nature of how they are being evaluated, and give them more information to determine whether they find this process fair. The second improvement could be to make the process more gender-neutral by, for example, having as much of it as possible be done anonymously. This mostly applies to the PEI since panel have to be administered in person. Similar to the way the GP HJ applications are handled, there could be a committee that handles the administrative side of things who know the identity of the candidate, and who provide anonymized input to the person handling the PEI. \u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">However, likely the biggest disclaimer here should be obvious: The notion that there doesn\u2019t seem to be a structural gender bias problem in the L3 process does not mean that it\u2019s impossible for individuals to be treated with bias. These situations should still be taken seriously whenever they come up. <\/span><\/p>\n<p>&nbsp;<\/p>\n<h1><\/h1>\n<h1><span style=\"font-weight: 400\">Appendix &#8211; Raw Data<\/span><\/h1>\n<p><span style=\"font-weight: 400\">Panel data:<\/span><\/p>\n<table border=\"1\">\n<tbody>\n<tr>\n<td><strong>Relative percentages<\/strong><\/td>\n<td><strong>\u00a0<\/strong><\/td>\n<td><strong>\u00a0<\/strong><\/td>\n<\/tr>\n<tr>\n<td><strong>Minor or Major deficiencies<\/strong><\/td>\n<td><strong>female (n=13)<\/strong><\/td>\n<td><strong>male (n=117)<\/strong><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Rules &amp; Policy Knowledge<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">7.692307692<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Attitude &amp; Maturity<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">4.273504274<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Judge Assessment<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">12.82051282<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Mentorship<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">0.8547008547<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Teamwork and Diplomacy<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">5.128205128<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Communication<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Investigations<\/span><\/td>\n<td><span style=\"font-weight: 400\">30.76923077<\/span><\/td>\n<td><span style=\"font-weight: 400\">28.20512821<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Leadership, Presence &amp; Charisma<\/span><\/td>\n<td><span style=\"font-weight: 400\">30.76923077<\/span><\/td>\n<td><span style=\"font-weight: 400\">20.51282051<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Penalty and Policy Philosophy<\/span><\/td>\n<td><span style=\"font-weight: 400\">46.15384615<\/span><\/td>\n<td><span style=\"font-weight: 400\">27.35042735<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Program Construction &amp; Philosophy<\/span><\/td>\n<td><span style=\"font-weight: 400\">23.07692308<\/span><\/td>\n<td><span style=\"font-weight: 400\">20.51282051<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Self-Evaluation<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">9.401709402<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Stress &amp; Conflict Management<\/span><\/td>\n<td><span style=\"font-weight: 400\">15.38461538<\/span><\/td>\n<td><span style=\"font-weight: 400\">17.09401709<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Teamwork, Diplomacy and Maturity<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">12.82051282<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Development of Other Judges<\/span><\/td>\n<td><span style=\"font-weight: 400\">7.692307692<\/span><\/td>\n<td><span style=\"font-weight: 400\">16.23931624<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Logistics and Tournament Operations<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<table border=\"1\">\n<tbody>\n<tr>\n<td><strong>number of candidates<\/strong><\/td>\n<td><strong>\u00a0<\/strong><\/td>\n<td><strong>%<\/strong><\/td>\n<td><strong>number of panel members<\/strong><\/td>\n<td><strong>\u00a0<\/strong><\/td>\n<td><strong>%<\/strong><\/td>\n<td><strong>\u00a0<\/strong><\/td>\n<td><strong>panels containing at least 1 female member<\/strong><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">female<\/span><\/td>\n<td><span style=\"font-weight: 400\">16<\/span><\/td>\n<td><span style=\"font-weight: 400\">10.1910828<\/span><\/td>\n<td><span style=\"font-weight: 400\">female<\/span><\/td>\n<td><span style=\"font-weight: 400\">34<\/span><\/td>\n<td><span style=\"font-weight: 400\">9.470752089<\/span><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">total panels known<\/span><\/td>\n<td><span style=\"font-weight: 400\">131<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">male<\/span><\/td>\n<td><span style=\"font-weight: 400\">141<\/span><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">male<\/span><\/td>\n<td><span style=\"font-weight: 400\">325<\/span><\/td>\n<td><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">total panels containing female<\/span><\/td>\n<td><span style=\"font-weight: 400\">29<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">total<\/span><\/td>\n<td><span style=\"font-weight: 400\">157<\/span><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">total<\/span><\/td>\n<td><span style=\"font-weight: 400\">359<\/span><\/td>\n<td><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">percentage<\/span><\/td>\n<td><span style=\"font-weight: 400\">22.13740458<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400\">2017 Census:<\/span><\/p>\n<table border=\"1\">\n<tbody>\n<tr>\n<td><strong>\u00a0<\/strong><\/td>\n<td><strong>Total L1<\/strong><\/td>\n<td><strong>Women L1<\/strong><\/td>\n<td><strong>Total L2<\/strong><\/td>\n<td><strong>Women L2<\/strong><\/td>\n<td><strong>Total L3<\/strong><\/td>\n<td><strong>Women L3<\/strong><\/td>\n<td><strong>% female L1<\/strong><\/td>\n<td><strong>%female L2<\/strong><\/td>\n<td><strong>%female L3<\/strong><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Italy<\/span><\/td>\n<td><span style=\"font-weight: 400\">208<\/span><\/td>\n<td><span style=\"font-weight: 400\">5<\/span><\/td>\n<td><span style=\"font-weight: 400\">51<\/span><\/td>\n<td><span style=\"font-weight: 400\">3<\/span><\/td>\n<td><span style=\"font-weight: 400\">8<\/span><\/td>\n<td><span style=\"font-weight: 400\">1<\/span><\/td>\n<td><span style=\"font-weight: 400\">2%<\/span><\/td>\n<td><span style=\"font-weight: 400\">6%<\/span><\/td>\n<td><span style=\"font-weight: 400\">13%<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">EU North<\/span><\/td>\n<td><span style=\"font-weight: 400\">224<\/span><\/td>\n<td><span style=\"font-weight: 400\">5<\/span><\/td>\n<td><span style=\"font-weight: 400\">46<\/span><\/td>\n<td><span style=\"font-weight: 400\">2<\/span><\/td>\n<td><span style=\"font-weight: 400\">4<\/span><\/td>\n<td><span style=\"font-weight: 400\">2<\/span><\/td>\n<td><span style=\"font-weight: 400\">2%<\/span><\/td>\n<td><span style=\"font-weight: 400\">4%<\/span><\/td>\n<td><span style=\"font-weight: 400\">50%<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Australia<\/span><\/td>\n<td><span style=\"font-weight: 400\">160<\/span><\/td>\n<td><span style=\"font-weight: 400\">4<\/span><\/td>\n<td><span style=\"font-weight: 400\">46<\/span><\/td>\n<td><span style=\"font-weight: 400\">7<\/span><\/td>\n<td><span style=\"font-weight: 400\">3<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">3%<\/span><\/td>\n<td><span style=\"font-weight: 400\">15%<\/span><\/td>\n<td><span style=\"font-weight: 400\">0%<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Japan<\/span><\/td>\n<td><span style=\"font-weight: 400\">281<\/span><\/td>\n<td><span style=\"font-weight: 400\">5<\/span><\/td>\n<td><span style=\"font-weight: 400\">83<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">5<\/span><\/td>\n<td><span style=\"font-weight: 400\">1<\/span><\/td>\n<td><span style=\"font-weight: 400\">2%<\/span><\/td>\n<td><span style=\"font-weight: 400\">0%<\/span><\/td>\n<td><span style=\"font-weight: 400\">20%<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">BeNeLux<\/span><\/td>\n<td><span style=\"font-weight: 400\">146<\/span><\/td>\n<td><span style=\"font-weight: 400\">4<\/span><\/td>\n<td><span style=\"font-weight: 400\">22<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">10<\/span><\/td>\n<td><span style=\"font-weight: 400\">1<\/span><\/td>\n<td><span style=\"font-weight: 400\">3%<\/span><\/td>\n<td><span style=\"font-weight: 400\">0%<\/span><\/td>\n<td><span style=\"font-weight: 400\">10%<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">SE Asia<\/span><\/td>\n<td><span style=\"font-weight: 400\">151<\/span><\/td>\n<td><span style=\"font-weight: 400\">2<\/span><\/td>\n<td><span style=\"font-weight: 400\">27<\/span><\/td>\n<td><span style=\"font-weight: 400\">3<\/span><\/td>\n<td><span style=\"font-weight: 400\">5<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">1%<\/span><\/td>\n<td><span style=\"font-weight: 400\">11%<\/span><\/td>\n<td><span style=\"font-weight: 400\">0%<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">UK<\/span><\/td>\n<td><span style=\"font-weight: 400\">378<\/span><\/td>\n<td><span style=\"font-weight: 400\">20<\/span><\/td>\n<td><span style=\"font-weight: 400\">68<\/span><\/td>\n<td><span style=\"font-weight: 400\">8<\/span><\/td>\n<td><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">5%<\/span><\/td>\n<td><span style=\"font-weight: 400\">12%<\/span><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Iberia<\/span><\/td>\n<td><span style=\"font-weight: 400\">183<\/span><\/td>\n<td><span style=\"font-weight: 400\">11<\/span><\/td>\n<td><span style=\"font-weight: 400\">54<\/span><\/td>\n<td><span style=\"font-weight: 400\">5<\/span><\/td>\n<td><span style=\"font-weight: 400\">8<\/span><\/td>\n<td><span style=\"font-weight: 400\">1<\/span><\/td>\n<td><span style=\"font-weight: 400\">6%<\/span><\/td>\n<td><span style=\"font-weight: 400\">9%<\/span><\/td>\n<td><span style=\"font-weight: 400\">13%<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">USA Great Lakes<\/span><\/td>\n<td><span style=\"font-weight: 400\">295<\/span><\/td>\n<td><span style=\"font-weight: 400\">22<\/span><\/td>\n<td><span style=\"font-weight: 400\">50<\/span><\/td>\n<td><span style=\"font-weight: 400\">4<\/span><\/td>\n<td><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">7%<\/span><\/td>\n<td><span style=\"font-weight: 400\">8%<\/span><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">USA Mid-Atlantic<\/span><\/td>\n<td><span style=\"font-weight: 400\">285<\/span><\/td>\n<td><span style=\"font-weight: 400\">23<\/span><\/td>\n<td><span style=\"font-weight: 400\">87<\/span><\/td>\n<td><span style=\"font-weight: 400\">9<\/span><\/td>\n<td><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">8%<\/span><\/td>\n<td><span style=\"font-weight: 400\">10%<\/span><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">USA North<\/span><\/td>\n<td><span style=\"font-weight: 400\">153<\/span><\/td>\n<td><span style=\"font-weight: 400\">10<\/span><\/td>\n<td><span style=\"font-weight: 400\">50<\/span><\/td>\n<td><span style=\"font-weight: 400\">2<\/span><\/td>\n<td><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">7%<\/span><\/td>\n<td><span style=\"font-weight: 400\">4%<\/span><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">USA Northwest<\/span><\/td>\n<td><span style=\"font-weight: 400\">331<\/span><\/td>\n<td><span style=\"font-weight: 400\">13<\/span><\/td>\n<td><span style=\"font-weight: 400\">79<\/span><\/td>\n<td><span style=\"font-weight: 400\">5<\/span><\/td>\n<td><span style=\"font-weight: 400\">12<\/span><\/td>\n<td><span style=\"font-weight: 400\">2<\/span><\/td>\n<td><span style=\"font-weight: 400\">4%<\/span><\/td>\n<td><span style=\"font-weight: 400\">6%<\/span><\/td>\n<td><span style=\"font-weight: 400\">17%<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">USA South<\/span><\/td>\n<td><span style=\"font-weight: 400\">234<\/span><\/td>\n<td><span style=\"font-weight: 400\">14<\/span><\/td>\n<td><span style=\"font-weight: 400\">60<\/span><\/td>\n<td><span style=\"font-weight: 400\">7<\/span><\/td>\n<td><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">6%<\/span><\/td>\n<td><span style=\"font-weight: 400\">12%<\/span><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">USA Southwest<\/span><\/td>\n<td><span style=\"font-weight: 400\">300<\/span><\/td>\n<td><span style=\"font-weight: 400\">18<\/span><\/td>\n<td><span style=\"font-weight: 400\">100<\/span><\/td>\n<td><span style=\"font-weight: 400\">8<\/span><\/td>\n<td><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">6%<\/span><\/td>\n<td><span style=\"font-weight: 400\">8%<\/span><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">USA Canada<\/span><\/td>\n<td><span style=\"font-weight: 400\">307<\/span><\/td>\n<td><span style=\"font-weight: 400\">17<\/span><\/td>\n<td><span style=\"font-weight: 400\">89<\/span><\/td>\n<td><span style=\"font-weight: 400\">3<\/span><\/td>\n<td><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">6%<\/span><\/td>\n<td><span style=\"font-weight: 400\">3%<\/span><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">USA Central<\/span><\/td>\n<td><span style=\"font-weight: 400\">233<\/span><\/td>\n<td><span style=\"font-weight: 400\">12<\/span><\/td>\n<td><span style=\"font-weight: 400\">53<\/span><\/td>\n<td><span style=\"font-weight: 400\">2<\/span><\/td>\n<td><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">5%<\/span><\/td>\n<td><span style=\"font-weight: 400\">4%<\/span><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">USA Southeast<\/span><\/td>\n<td><span style=\"font-weight: 400\">245<\/span><\/td>\n<td><span style=\"font-weight: 400\">12<\/span><\/td>\n<td><span style=\"font-weight: 400\">58<\/span><\/td>\n<td><span style=\"font-weight: 400\">2<\/span><\/td>\n<td><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">5%<\/span><\/td>\n<td><span style=\"font-weight: 400\">3%<\/span><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">USA Northeast<\/span><\/td>\n<td><span style=\"font-weight: 400\">428<\/span><\/td>\n<td><span style=\"font-weight: 400\">18<\/span><\/td>\n<td><span style=\"font-weight: 400\">100<\/span><\/td>\n<td><span style=\"font-weight: 400\">5<\/span><\/td>\n<td><\/td>\n<td><\/td>\n<td><span style=\"font-weight: 400\">4%<\/span><\/td>\n<td><span style=\"font-weight: 400\">5%<\/span><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><strong>TOTAL<\/strong><\/td>\n<td><strong>4542<\/strong><\/td>\n<td><strong>215<\/strong><\/td>\n<td><strong>1123<\/strong><\/td>\n<td><strong>75<\/strong><\/td>\n<td><strong>55<\/strong><\/td>\n<td><strong>8<\/strong><\/td>\n<td><strong>5%<\/strong><\/td>\n<td><strong>7%<\/strong><\/td>\n<td><strong>15%<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400\">Questionnaire data:<\/span><\/p>\n<table border=\"1\">\n<tbody>\n<tr>\n<td><strong>\u00a0<\/strong><\/td>\n<td><strong>totals<\/strong><\/td>\n<td><strong>Level 2 &#8211; Without interest in Level 3<\/strong><\/td>\n<td><strong>Level 2 &#8211; With general interest in Level 3<\/strong><\/td>\n<td><strong>Level 2 &#8211; Working on L3 Checklist Items<\/strong><\/td>\n<td><strong>Level 2 &#8211; Currently in PEI or waiting to Panel<\/strong><\/td>\n<td><strong>Level 2 &#8211; Failed PEI, Test, or Panel, still interested in Level 3<\/strong><\/td>\n<td><strong>Level 2 &#8211; Failed PEI, Test, or Panel, no longer interested in Level 3<\/strong><\/td>\n<td><strong>Level 3 &#8211; Failed PEI, Test, or Panel but continued on to Level 3<\/strong><\/td>\n<td><strong>Level 3 &#8211; Passed through PEI, Test, and Panel on first try<\/strong><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">male<\/span><\/td>\n<td><span style=\"font-weight: 400\">330<\/span><\/td>\n<td><span style=\"font-weight: 400\">106<\/span><\/td>\n<td><span style=\"font-weight: 400\">117<\/span><\/td>\n<td><span style=\"font-weight: 400\">50<\/span><\/td>\n<td><span style=\"font-weight: 400\">5<\/span><\/td>\n<td><span style=\"font-weight: 400\">8<\/span><\/td>\n<td><span style=\"font-weight: 400\">3<\/span><\/td>\n<td><span style=\"font-weight: 400\">12<\/span><\/td>\n<td><span style=\"font-weight: 400\">29<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">female<\/span><\/td>\n<td><span style=\"font-weight: 400\">31<\/span><\/td>\n<td><span style=\"font-weight: 400\">5<\/span><\/td>\n<td><span style=\"font-weight: 400\">11<\/span><\/td>\n<td><span style=\"font-weight: 400\">8<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">3<\/span><\/td>\n<td><span style=\"font-weight: 400\">0<\/span><\/td>\n<td><span style=\"font-weight: 400\">1<\/span><\/td>\n<td><span style=\"font-weight: 400\">3<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<table border=\"1\">\n<tbody>\n<tr>\n<td><strong>average scores<\/strong><\/td>\n<td><strong>I feel that I am treated differently based on my gender identity or sexual orientation.<\/strong><\/td>\n<td><strong>My skills are evaluated differently based on my gender identity or sexual orientation.<\/strong><\/td>\n<td><strong>I receive comments or feedback related to my gender identity or sexual orientation. (For example: &#8220;You are quite [x] for a [guy\/girl]&#8221;)<\/strong><\/td>\n<td><strong>I feel that L3 advancement is _____ for people of my gender identity and\/or sexual orientation.<\/strong><\/td>\n<td><strong>I feel that getting selected to judge events I applied for is _____ for people of my gender identity and\/or sexual orientation.<\/strong><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">male<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,50764526<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,535168196<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,283536585<\/span><\/td>\n<td><span style=\"font-weight: 400\">2,657407407<\/span><\/td>\n<td><span style=\"font-weight: 400\">2,836923077<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">female<\/span><\/td>\n<td><span style=\"font-weight: 400\">3,451612903<\/span><\/td>\n<td><span style=\"font-weight: 400\">3,290322581<\/span><\/td>\n<td><span style=\"font-weight: 400\">2,35483871<\/span><\/td>\n<td><span style=\"font-weight: 400\">3,548387097<\/span><\/td>\n<td><span style=\"font-weight: 400\">2,709677419<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">male std dev<\/span><\/td>\n<td><span style=\"font-weight: 400\">0,9841237996<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,041096587<\/span><\/td>\n<td><span style=\"font-weight: 400\">0,791064582<\/span><\/td>\n<td><span style=\"font-weight: 400\">0,7567492442<\/span><\/td>\n<td><span style=\"font-weight: 400\">0,7902900762<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">female std dev<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,362319338<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,465003945<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,427080635<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,059519063<\/span><\/td>\n<td><span style=\"font-weight: 400\">0,8638498476<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<table border=\"1\">\n<tbody>\n<tr>\n<td><strong>average scores<\/strong><\/td>\n<td><strong>I think the L3 checklist verification is Fair\/Unfair<\/strong><\/td>\n<td><strong>I think the L3 checklist verification is Objective\/Subjective<\/strong><\/td>\n<td><strong>I think the Pre-Event Interview (PEI) is Fair\/Unfair<\/strong><\/td>\n<td><strong>I think the Pre-Event Interview (PEI) is Objective\/Subjective<\/strong><\/td>\n<td><strong>I think the L3 Panel is Fair\/Unfair<\/strong><\/td>\n<td><strong>I think the L3 Panel is Objective\/Subjective<\/strong><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">male<\/span><\/td>\n<td><span style=\"font-weight: 400\">3,649122807<\/span><\/td>\n<td><span style=\"font-weight: 400\">3,368421053<\/span><\/td>\n<td><span style=\"font-weight: 400\">3,596491228<\/span><\/td>\n<td><span style=\"font-weight: 400\">2,561403509<\/span><\/td>\n<td><span style=\"font-weight: 400\">3,436363636<\/span><\/td>\n<td><span style=\"font-weight: 400\">2,363636364<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">female<\/span><\/td>\n<td><span style=\"font-weight: 400\">4,285714286<\/span><\/td>\n<td><span style=\"font-weight: 400\">4,428571429<\/span><\/td>\n<td><span style=\"font-weight: 400\">3,142857143<\/span><\/td>\n<td><span style=\"font-weight: 400\">3<\/span><\/td>\n<td><span style=\"font-weight: 400\">3<\/span><\/td>\n<td><span style=\"font-weight: 400\">2,571428571<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">male standard dev<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,00873379<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,276596745<\/span><\/td>\n<td><span style=\"font-weight: 400\">0,9231090541<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,149806565<\/span><\/td>\n<td><span style=\"font-weight: 400\">0,9576908255<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,192004791<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">female standard dev<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,112697281<\/span><\/td>\n<td><span style=\"font-weight: 400\">0,5345224838<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,345185418<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,414213562<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,290994449<\/span><\/td>\n<td><span style=\"font-weight: 400\">1,272418021<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I would like to introduce a great analysis by Nicolette Apraez &amp; Anniek van der Peijl about the impact of gender in the L3 advancement process. The analysis is based on global data and paints a picture from a new perspective on the advancement process. Matteo Abstract We conducted a research project to investigate whether [&hellip;]<\/p>\n","protected":false},"author":406,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[4],"tags":[],"language":[],"class_list":["post-283","post","type-post","status-publish","format-standard","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/posts\/283","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/users\/406"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/comments?post=283"}],"version-history":[{"count":11,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/posts\/283\/revisions"}],"predecessor-version":[{"id":302,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/posts\/283\/revisions\/302"}],"wp:attachment":[{"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/media?parent=283"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/categories?post=283"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/tags?post=283"},{"taxonomy":"language","embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/language?post=283"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}