{"id":2988,"date":"2015-04-21T15:27:16","date_gmt":"2015-04-21T15:27:16","guid":{"rendered":"http:\/\/blogs.magicjudges.org\/articles\/?p=2988"},"modified":"2016-05-10T20:34:18","modified_gmt":"2016-05-10T20:34:18","slug":"a-guide-to-l1-post-test-interviews","status":"publish","type":"post","link":"https:\/\/blogs.magicjudges.org\/articles\/2015\/04\/21\/a-guide-to-l1-post-test-interviews\/","title":{"rendered":"A Guide to L1 Post-test Interviews"},"content":{"rendered":"<div class=\"wp-caption alignleft judgeimg\"><a href=\"https:\/\/apps.magicjudges.org\/judges\/dci\/1202423548\"><img src=https:\/\/apps.magicjudges.org\/dci\/avatar?dci=1202423548&size=200 alt=\"Written by Josh Feingold\"><\/a><p class=\"wp-caption-text\"><em>Written by Josh Feingold<\/em><\/p><\/div>\n<p>&nbsp;<\/p>\n<p>Taking an L1 exam\u00a0is a formative moment in a judge\u2019s career. The lessons the candidate takes away from the experience will do a lot to shape their progress in the coming months. Whether the candidate passes or fails, the post-test interview is a prime opportunity to guide this individual on to greater success and gather the information for a meaningful review.<\/p>\n<p>&nbsp;<\/p>\n<h2>Step 1: Pass\/Fail<\/h2>\n<p><p><img  style='float:right'  class='lems-mtg-cardimg' src='http:\/\/gatherer.wizards.com\/Handlers\/Image.ashx?size=small&type=card&name=Test of Faith'><\/p>Before anything else, tell the candidate whether they passed or failed the exam. Don\u2019t tell them the total score. We\u2019ll get to that later. This may seem obvious, or it may seem like a missed opportunity to hold your candidate in suspense. However, you are going to want the candidate to be able focus their attention on the tasks you are going to present. Having them\u00a0worry about passing or failing will only detract from the quality of information you would otherwise be able to obtain from the coming steps of the interview process.<\/p>\n<p>If the candidate passed, explain that passing the test is only the first step and now you need to talk about some specifics to help fill out your advancement review. If the candidate failed, let them\u00a0know that failing an L1 exam is not the end of the road. What you need then is to determine how you can give them good guidance on how to prepare for the next time they test.<\/p>\n<p>&nbsp;<\/p>\n<h2>Step 2: Uncertain Answers<\/h2>\n<p>Ask the candidate to go through the exam and point out any questions where they were uncertain about the answer. Note these questions even if the candidate chose the correct answer, as it may be useful to remind the candidate about these rules or policy issues when writing the review. You are looking for two major things during this step:<\/p>\n<p><span style=\"text-decoration: underline\">1. How many of the \u201cuncertain\u201d answers were actually missed?<\/span><\/p>\n<p>A substantial mismatch may indicate that the candidate is unable to identify areas in which their competence is limited. If a candidate misses questions that they were\u00a0certain about, the judge may confidently misunderstand a rule or policy.<\/p>\n<p><p><img  style='float:right'  class='lems-mtg-cardimg' src='http:\/\/gatherer.wizards.com\/Handlers\/Image.ashx?size=small&type=card&name=Wild Guess'><\/p><span style=\"text-decoration: underline\">2. What reasoning is the candidate applying to pick an answer in uncertain situations?<\/span><\/p>\n<p>Most L1 exam content is straightforward logic that governs the way rules and policy work. For example, at Regular REL just fix it unless you really need to DQ. The candidate should understand the basics of casting spells, combat, and steps of the turn. They should apply good fundamental knowledge in approaching unknown questions rather than making stuff up or guessing wildly.<\/p>\n<p>&nbsp;<\/p>\n<h2>Step 3: Incorrect Answers<\/h2>\n<p>After discussing \u201cuncertain\u201d questions, you can reveal the total score on the exam. Not providing that information prior to this point preserves the information you would receive in the previous step. If the candidate knows the specific number of missed questions, it may change the way they assesses confidence in the given answers.<\/p>\n<p>Your goal in reviewing incorrect answers is to uncover where they went wrong. These issues should certainly be discussed in your review of the candidate to reinforce their understanding.<\/p>\n<p>&nbsp;<\/p>\n<h2>Step 4: Goals<\/h2>\n<p>At this point, the candidate knows the outcome of the exam and has reviewed items about which they were\u00a0uncertain or incorrect. Where does the candidate go from here?<\/p>\n<p><p><img  style='float:right'  class='lems-mtg-cardimg' src='http:\/\/gatherer.wizards.com\/Handlers\/Image.ashx?size=small&type=card&name=Increasing Ambition'><\/p>If the candidate passed, what types of events are they\u00a0planning to judge? Mostly store-level Regular REL events like FNMs and pre-releases? Other store-level Competitive REL events like GPTs and Invitational Qualifiers? Do\u00a0they\u00a0want to start moving toward judging larger Competitive REL events like 10Ks? Are they making plans for L2 at some point, or happy to be an L1 for the foreseeable future?<\/p>\n<p>If the candidate failed, what rules and policy problems did you identify together? When do they want to test again? What is going to be different next time? How will they\u00a0study and prepare?<\/p>\n<p>Regardless of the outcome, you will want to direct the candidate to some resources beyond the Judge Center practice exams. Fortunately, the judge community is filled with motivated people who are willing to share their knowledge, so many such resources are out there. Here is a short (and not at all comprehensive) list by category of interest:<\/p>\n<ul>\n<li><span style=\"text-decoration: underline\">Rules<\/span>\n<ul>\n<li>Rules Tips Blog: <a href=\"http:\/\/blogs.magicjudges.org\/rulestips\/\">http:\/\/blogs.magicjudges.org\/rulestips\/<\/a><\/li>\n<li>Wizards Document Center (hosts set FAQs and the Comp Rules):<br \/>\n<a href=\"http:\/\/wpn.wizards.com\/en\/resources\/rules-documents\">http:\/\/wpn.wizards.com\/en\/resources\/rules-documents<\/a><\/li>\n<\/ul>\n<\/li>\n<li><span style=\"text-decoration: underline\">Regular REL Policy<\/span>\n<ul>\n<li>Regular REL Blog: <a href=\"http:\/\/blogs.magicjudges.org\/regular\/\">http:\/\/blogs.magicjudges.org\/regular\/<\/a><\/li>\n<li>Regular REL Forum: <a href=\"http:\/\/apps.magicjudges.org\/forum\/74\/\">http:\/\/apps.magicjudges.org\/forum\/74\/<\/a><\/li>\n<\/ul>\n<\/li>\n<li><span style=\"text-decoration: underline\">Competitive REL Policy<\/span>\n<ul>\n<li>Annotated IPG:\u00a0<a href=\"http:\/\/blogs.magicjudges.org\/rules\/ipg\/#annotated-ipg\">http:\/\/blogs.magicjudges.org\/rules\/ipg\/#annotated-ipg<\/a><\/li>\n<li>Comp REL Forum: <a href=\"http:\/\/apps.magicjudges.org\/forum\/75\/\">http:\/\/apps.magicjudges.org\/forum\/75\/<\/a><\/li>\n<li>Knowledge Pool: <a href=\"http:\/\/blogs.magicjudges.org\/knowledgepool\/\">http:\/\/blogs.magicjudges.org\/knowledgepool\/<\/a><\/li>\n<li>Policy Perspectives Blog: <a href=\"http:\/\/blogs.magicjudges.org\/telliott\/\">http:\/\/blogs.magicjudges.org\/telliott\/<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h2>Step 5: The Review<\/h2>\n<p>You didn\u2019t think you were done when the interview was over, did you? It\u2019s review time! Let\u2019s start with the basics: enter the review by DCI number, <span style=\"text-decoration: underline\">NOT THE CANDIDATE\u2019S NAME<\/span>. DCI numbers are unique. Make sure you aren\u2019t promoting the wrong \u201cJim Smith\u201d to L1! Do this also for the candidate\u2019s exam so you can reference the candidate\u2019s answer sheet for their DCI#.<\/p>\n<p><p><img  style='float:right'  class='lems-mtg-cardimg' src='http:\/\/gatherer.wizards.com\/Handlers\/Image.ashx?size=small&type=card&name=Govern the Guildless'><\/p>Just because a candidate got a passing score on the exam, you are not obligated to recommend them for L1. For example, if the candidate has excellent rules knowledge but missed every question on Regular REL policy and your interview indicates that this person would make FNM miserable for the players, you probably don\u2019t want this person as a judge. Passing the test is necessary, but not sufficient, to reach L1.<\/p>\n<p>The review is a permanent note of the things you discussed during the interview. You should repeat what was discussed in the interview. You want the candidate to be able to reference all the things you talked about. Some of those items should be:<\/p>\n<ul>\n<li>What did the candidate get right on the exam? Are there areas or rules that the candidate knows very well? <strong>(Strength)<\/strong> What did they get wrong? Are there obvious problem areas? <strong>(Area for Improvement)<\/strong><\/li>\n<li>Does the candidate really understand Regular REL policy and philosophy? <strong>(Strength)<\/strong> Did they want to impose punitive fixes? <strong>(Area for Improvement)<\/strong><\/li>\n<li>Do they have a good demeanor and rapport with players? <strong>(Strength)<\/strong> Is the ruling given in a nervous or condescending tone? <strong>(Area for Improvement)<\/strong><\/li>\n<li>Is the candidate a good listener and receptive to feedback? <strong>(Strength)<\/strong> Do they get defensive? <strong>(Area for Improvement)<\/strong><\/li>\n<li>Did the candidate\u2019s list of uncertain questions match relatively well to the list of incorrect answers? <strong>(Strength)<\/strong> Were the incorrect answers a complete surprise? <strong>(Area for Improvement)<\/strong><\/li>\n<li>Did the candidate show good reasoning on uncertain answers? <strong>(Strength)<\/strong> Did the candidate seem confused about the way things generally work? <strong>(Area for Improvement)<\/strong><\/li>\n<li>Did the candidate have clear goals following the test? <strong>(This is a Strength, but lack of goals isn\u2019t really an Area for Improvement.)<\/strong><\/li>\n<li>What are the candidates goal\u2019s, and what resources are available to help the candidate reach that goal? If the candidate is very strong, you may want to put these items in the Areas for Improvement section, since these are actually the items they\u00a0will use for immediate improvement. If the AFI section is already looking a bit hefty, you may wish to put the list of resources in the comments section, following some words of encouragement.<\/li>\n<\/ul>\n<p><p><img  style='float:right'  class='lems-mtg-cardimg' src='http:\/\/gatherer.wizards.com\/Handlers\/Image.ashx?size=small&type=card&name=Refreshing Rain'><\/p><br \/>\nOnce the review is submitted, you\u2019ve actually finished the interview process. Now you can sit back, put your feet up, and bask in the warm feeling of knowing that you\u2019ve given this judge candidate (and, hopefully, brand new judge) the most useful testing experience you could provide. As mentor and candidate, you have shared in an intimate process that will enrich both of your experiences in the Judge Program.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>L3 Joshua Feingold discusses how to maximize the yield of the interview following an L1 candidate&#8217;s exam.<\/p>\n","protected":false},"author":22,"featured_media":2454,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[113,37],"tags":[233,234,71,95],"language":[180],"class_list":["post-2988","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-community","category-education_development","tag-debrief","tag-exam","tag-joshua-feingold","tag-mentorship","language-en"],"_links":{"self":[{"href":"https:\/\/blogs.magicjudges.org\/articles\/wp-json\/wp\/v2\/posts\/2988","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.magicjudges.org\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.magicjudges.org\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/articles\/wp-json\/wp\/v2\/users\/22"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/articles\/wp-json\/wp\/v2\/comments?post=2988"}],"version-history":[{"count":20,"href":"https:\/\/blogs.magicjudges.org\/articles\/wp-json\/wp\/v2\/posts\/2988\/revisions"}],"predecessor-version":[{"id":3455,"href":"https:\/\/blogs.magicjudges.org\/articles\/wp-json\/wp\/v2\/posts\/2988\/revisions\/3455"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/articles\/wp-json\/wp\/v2\/media\/2454"}],"wp:attachment":[{"href":"https:\/\/blogs.magicjudges.org\/articles\/wp-json\/wp\/v2\/media?parent=2988"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/articles\/wp-json\/wp\/v2\/categories?post=2988"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/articles\/wp-json\/wp\/v2\/tags?post=2988"},{"taxonomy":"language","embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/articles\/wp-json\/wp\/v2\/language?post=2988"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}