{"id":366,"date":"2019-08-07T04:43:15","date_gmt":"2019-08-07T11:43:15","guid":{"rendered":"http:\/\/blogs.magicjudges.org\/road-to-l3\/?p=366"},"modified":"2019-08-07T04:43:15","modified_gmt":"2019-08-07T11:43:15","slug":"understanding-the-level-3-exams","status":"publish","type":"post","link":"https:\/\/blogs.magicjudges.org\/road-to-l3\/2019\/08\/07\/understanding-the-level-3-exams\/","title":{"rendered":"Understanding the Level 3 Exams"},"content":{"rendered":"<h4><div class=\"wp-caption alignleft judgeimg\"><a href=\"https:\/\/apps.magicjudges.org\/judges\/dci\/7102821706\"><img src=https:\/\/apps.magicjudges.org\/dci\/avatar?dci=7102821706&size=200 alt=\"\"><\/a><p class=\"wp-caption-text\"><\/p><\/div> <em>About the Author<\/em><\/h4>\n<p><em>John Brian McCarthy is a Level 3 Judge from Arlington, VA, USA. He manages the Level 3 advancement exams. You can also find him at many Grand Prix, taking appeals in burgundy or taking photos for the Judges at Work albums.<\/em><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>When you were studying to become a Level 1 Judge, you probably focused a lot on the test. When you were studying to advance to Level 2, you probably split your focus between passing the test and completing the other requirements, particularly the evaluation of your performance at a Comp REL tournament.<\/p>\n<p>Many judges preparing for Level 3 are very focused on soft requirements \u2013 gathering recommendations, embodying the qualities of a Level 3 Judge, passing the panel. They\u2019ve already taken a number of rules and policy knowledge tests, they take rulings at every tournament, and they can explain the philosophy behind policy. As a result, the Level 3 Exam can catch them off guard \u2013 they didn\u2019t know how much they didn\u2019t know. And some what they did know turned out to be apocrypha.<\/p>\n<p>I\u2019m going to give you two questions that were recently retired from the L3P as an idea of the kind of questions you can expect. Try to answer them correctly \u2013 you\u2019ll find out which answer is correct, and why, at the bottom of the article:<\/p>\n<blockquote><p>1.Anthony casts <a href=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-content\/plugins\/lems-mtg-helper\/lems-mtg-helper-cardfinder.php?find=Skeleton+Scavengers&width=223&height=310\" class=\"jTip\" name=\"\">Skeleton Scavengers<\/a>. After Skeleton Scavengers resolves, Nadine casts <a href=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-content\/plugins\/lems-mtg-helper\/lems-mtg-helper-cardfinder.php?find=Maggot+Therapy&width=223&height=310\" class=\"jTip\" name=\"\">Maggot Therapy<\/a>, targeting Skeleton Scavengers. In response, Anthony casts <a href=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-content\/plugins\/lems-mtg-helper\/lems-mtg-helper-cardfinder.php?find=Puncture+Bolt&width=223&height=310\" class=\"jTip\" name=\"\">Puncture Bolt<\/a>, targeting Skeleton Scavengers. In response to Puncture Bolt, Anthony activates Skeleton Scavengers&#8217;s activated ability twice. What happens after each instance of Skeleton Scavenger&#8217;s ability has resolved?<\/p>\n<p>A) Puncture Bolt resolves. Skeleton Scavengers is regenerated twice. Maggot Therapy resolves. Skeleton Scavengers is put into Anthony&#8217;s graveyard, then Maggot Therapy is put into Nadine&#8217;s graveyard.<br \/>\nB) Puncture Bolt resolves. Skeleton Scavengers isn&#8217;t regenerated and is put into Anthony&#8217;s graveyard. Maggot Therapy is countered and is put into Nadine&#8217;s graveyard.<br \/>\nC) Puncture Bolt resolves. Skeleton Scavengers is regenerated once. Maggot Therapy resolves. Skeleton Scavengers is put into Anthony&#8217;s graveyard, then Maggot Therapy is put into Nadine&#8217;s graveyard.<br \/>\nD) Puncture Bolt resolves. Skeleton Scavengers is regenerated once. Maggot Therapy resolves. Skeleton Scavengers remains on the battlefield.<br \/>\nE) Puncture Bolt resolves. Skeleton Scavengers is regenerated once, then is put into Anthony&#8217;s graveyard. Maggot Therapy is countered and is put into Nadine&#8217;s graveyard.<\/p><\/blockquote>\n<blockquote><p>2. Andre attacks with <a href=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-content\/plugins\/lems-mtg-helper\/lems-mtg-helper-cardfinder.php?find=Battle+Hurda&width=223&height=310\" class=\"jTip\" name=\"\">Battle Hurda<\/a> and <a href=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-content\/plugins\/lems-mtg-helper\/lems-mtg-helper-cardfinder.php?find=Stampeding+Rhino&width=223&height=310\" class=\"jTip\" name=\"\">Stampeding Rhino<\/a>. Nanette declares <a href=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-content\/plugins\/lems-mtg-helper\/lems-mtg-helper-cardfinder.php?find=Palace+Guard&width=223&height=310\" class=\"jTip\" name=\"\">Palace Guard<\/a> is blocking Stampeding Rhino and Battle Hurda, and that <a href=\"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-content\/plugins\/lems-mtg-helper\/lems-mtg-helper-cardfinder.php?find=Pillarfield+Ox&width=223&height=310\" class=\"jTip\" name=\"\">Pillarfield Ox<\/a> is blocking Stampeding Rhino. Which of the following best explains the announcement of the damage assignment order?<\/p>\n<p>A) In the declare blockers step, Nanette announces Palace Guard&#8217;s and Pillarfield Ox&#8217;s damage assignment order. Then Andre announces Stampeding Rhino&#8217;s and Battle Hurda&#8217;s damage assignment order.<br \/>\nB) In the declare blockers step, Andre announces Battle Hurda&#8217;s damage assignment order. Then Nanette announces Palace Guard&#8217;s and Pillarfield Ox&#8217;s damage assignment order. Then Andre announces Stampeding Rhino&#8217;s damage assignment order.<br \/>\nC) In the first combat damage step, Andre announces Battle Hurda&#8217;s damage assignment order. In the second combat damage step, Andre announces Stampeding Rhino&#8217;s damage assignment order. Then Nanette announces Palace Guard&#8217;s amd Pillarfield Ox&#8217;s damage assignment order.<br \/>\nD) In the first combat damage step, Andre announces Stampeding Rhino&#8217;s and Battle Hurda&#8217;s damage assignment order. Then Nanette announces Palace Guard&#8217;s amd Pillarfield Ox&#8217;s damage assignment order.<br \/>\nE) In the declare blockers step, Andre announces Stampeding Rhino&#8217;s and Battle Hurda&#8217;s damage assignment order. Then Nanette announces Palace Guard&#8217;s and Pillarfield Ox&#8217;s damage assignment order.<\/p><\/blockquote>\n<p>&nbsp;<\/p>\n<p>In this article, I\u2019m going to break down how the Level 3 Exam works, dispel some myths about it, and give you some suggestions on what to study. But first\u2026<\/p>\n<p>&nbsp;<\/p>\n<h2>A bit of history<\/h2>\n<p><p><img  style='float:right'  class='lems-mtg-cardimg' src='http:\/\/gatherer.wizards.com\/Handlers\/Image.ashx?size=small&type=card&name=Reki, the History of Kamigawa'><\/p> Before testing on JudgeApps, judges took exams on Judge Center, a Wizards-managed property. Former Level 3 Judge <span class='judge-tooltip'><a href='https:\/\/apps.magicjudges.org\/judges\/dci\/46966237' >Brian Schenck<\/a><span class='avatar'><img width='200' height='200' src='https:\/\/apps.magicjudges.org\/dci\/avatar?dci=46966237&size=200'><\/span><\/span> managed Judge Center testing for Wizards, and he put quite a bit of thought into what a Level 3 Judge test should look like. Based on conversations with the Level 5 Judges at the time, the three principles Brian used were:<\/p>\n<ol>\n<li>Level 3 Judges should be <strong>experts in rules and policy<\/strong><\/li>\n<li>Level 3 Judges should possess <strong>broad knowledge and depth of knowledge<\/strong><\/li>\n<li>Level 3 Judges can answer questions from <strong>any format<\/strong><\/li>\n<\/ol>\n<p>From these principles, Brian created the Level 3 Practice test, or L3P, and the two Level 3 Certification Exams, L3A and L3B. One innovation Brian had was that while the Level 1 and Level 2 exams included broad pools (both for repetition and test integrity reasons), the Level 3 Certification Exam would be somewhat static \u2013 most Level 3 Judges would have similar exams, to ensure that broad knowledge. For example, you can take a Level 2 exam that might happen to not include any questions on HCE or it might include several questions on HCE, but almost every Level 3 exam will include two questions on the parts of a turn.<\/p>\n<p>Every candidate for advancement to Level 3 takes the L3A. Candidates who don\u2019t pass the L3A would have a chance to re-test with the L3B. The L3B was designed to be more difficult \u2013 the program didn\u2019t want candidates just going in again without studying and guessing better the second time, but instead wanted them to really master the rules and policy knowledge areas they missed the first time and shore up anything about which they were unsure.<\/p>\n<p><strong>During the Judge Center era, a total of 155 Level 3 Certification Exams were administered, with a pass rate of 86%, a median score of 86% and only two perfect scores<\/strong> (both perfect-scoring judges are still active today!).<\/p>\n<p>&nbsp;<\/p>\n<h2>The Modern L3P test<\/h2>\n<p><p><img  style='float:left'  class='lems-mtg-cardimg' src='http:\/\/gatherer.wizards.com\/Handlers\/Image.ashx?size=small&type=card&name=Spell Snare'><\/p>Today, the L3P is a 25-question, open-book timed test. It includes 17 rules questions (from the <a href=\"https:\/\/blogs.magicjudges.org\/rules\/cr\/\">CR<\/a>) and 8 policy questions (from the <a href=\"https:\/\/blogs.magicjudges.org\/rules\/mtr\/\">MTR<\/a>, <a href=\"https:\/\/blogs.magicjudges.org\/rules\/ipg\/\">IPG<\/a> and <a href=\"https:\/\/blogs.magicjudges.org\/rules\/jar\/\">JAR<\/a>). Candidates have 100 minutes to take the test \u2013 enough time to carefully consider their answers but not enough time to scour the CR for the answer to every question. Candidates need a score of 80%, or 20 correct answers, to pass.<\/p>\n<p><strong>Since JudgeApps testing went live, more than 260 L3Ps have been administered. 74% of L3P takers passed on their first try.<\/strong><\/p>\n<p>Questions on the L3P will assume that you have access to the CR, and won\u2019t shy away from esoteric keywords whose reminder text isn\u2019t helpful (looking at you, <a href=\"https:\/\/blogs.magicjudges.org\/rules\/cr702\/#94\">Soulbond<\/a>). They also generally can\u2019t be answered by looking at the oracle notes for the cards involved.<\/p>\n<p>There are presently almost 240 questions in the L3P pool, so we do have room for candidates to retake it (which is common, due to the lag between a candidate\u2019s TLTP qualification and advancement checklist submission), but we don\u2019t have enough questions for you to spam it. After failing an L3P, candidates are expected to study up on the things they missed before going to their mentor for another try.<\/p>\n<p>Of the 10 L3P questions that <strong>judges most often missed<\/strong>, topics include:<\/p>\n<ul>\n<li>Copy effects<\/li>\n<li>State-based actions<\/li>\n<li>Replacement effects<\/li>\n<li>Keywords<\/li>\n<li>Steps of casting a spell<\/li>\n<li>State-based actions again<\/li>\n<li>Tournament errors<\/li>\n<li>Layers<\/li>\n<li>Parts of a turn<\/li>\n<li>Even more State-based actions<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h2>The L3A and the L3B tests<\/h2>\n<p><p><img  style='float:right'  class='lems-mtg-cardimg' src='http:\/\/gatherer.wizards.com\/Handlers\/Image.ashx?size=small&type=card&name=Frantic Search&set=VMA'><\/p>The L3A and L3B are each 50 questions including 35 rules questions and 15 policy questions. Unlike the L3P, these tests are taken on paper, and are untimed.<\/p>\n<p>While you need to take this exam with a Level 3 Judge as proctor, that doesn\u2019t mean you need to do so at a Grand Prix \u2013 I took my L3A in <span class='judge-tooltip'><a href='https:\/\/apps.magicjudges.org\/judges\/dci\/30010274' >Ryan Stapleton<\/a><span class='avatar'><img width='200' height='200' src='https:\/\/apps.magicjudges.org\/dci\/avatar?dci=30010274&size=200'><\/span><\/span>\u2019s kitchen while he made guacamole. Of course, not everyone is lucky enough to have a Level 3 Judge in their metro area, so taking your test off-shift at a large event or conference is also a possibility. Don\u2019t plan on testing and paneling at the same event \u2013 you\u2019ll want to take the time to thoroughly prepare for both, and the stress will make you perform worse.<\/p>\n<p><strong>Since exams moved to JudgeApps, 16 judges have taken L3 Certification Exams with a pass rate of 75% and a median score of 83%.<\/strong> These are difficult tests, and it\u2019s important to study hard for them.<\/p>\n<p>The Level 3 Certification Exams particularly focus on rules and policy that comes up at tournaments. While we want your knowledge of the comprehensive rules to be comprehensive, we\u2019re not going to test you on subgames, because there are no tournament-legal cards that create them. We\u2019re looking for judges who can serve as experts at tournaments, not win <a href=\"http:\/\/judgetower.org\/\">Judge Tower<\/a>.<\/p>\n<p>&nbsp;<\/p>\n<h2>Where do new questions come from?<\/h2>\n<p><p><img  style='float:left'  class='lems-mtg-cardimg' src='http:\/\/gatherer.wizards.com\/Handlers\/Image.ashx?size=small&type=card&name=Censor'><\/p>If you take a Level 3 exam today, you\u2019ll see a mix of questions about older and newer cards and rules. New content is being added to the L3P, L3A and L3B every quarter, with almost all of it <strong>coming from the L3 Update Quizzes<\/strong>. With each expansion, <span class='judge-tooltip'><a href='https:\/\/apps.magicjudges.org\/judges\/dci\/7766' >Steven Zwanger<\/a><span class='avatar'><img width='200' height='200' src='https:\/\/apps.magicjudges.org\/dci\/avatar?dci=7766&size=200'><\/span><\/span>\u2019s <a href=\"https:\/\/apps.magicjudges.org\/projects\/59\/\">Update Quiz project<\/a> creates a couple dozen questions to test the current Level 3 Judges to ensure their rules and policy knowledge remains up to date. These quizzes are a required part of <a href=\"https:\/\/blogs.magicjudges.org\/o\/judge-levels\/#level-3-judge\">Level 3 Maintenance<\/a>, so you know that judges taking the quiz are putting in a real effort to answer correctly.<\/p>\n<p>The response rates from the L3 Update guide which questions migrate to various other exams. We don\u2019t want to create questions on the Certification exams to be too easy or too hard, nor do we want questions that are entirely answered by knowing new keywords or reading <a href=\"https:\/\/blogs.magicjudges.org\/telliott\/\">Toby\u2019s blog<\/a>. However, as policy and rules change, questions can become outdated \u2013 for example, <a href=\"https:\/\/blogs.magicjudges.org\/telliott\/2019\/01\/21\/policy-changes-for-ravnica-allegiance\/\">the change to Bribery and IDAW<\/a> broke a number of questions.<\/p>\n<p>In addition, I regularly monitor the pass rates on individual questions, and will flag a question for replacement if the response rate is too high or too low. We don\u2019t want too much variance on the test or a candidate could get all easy questions or all hard questions, making it a poor gauge of whether the candidate is ready for advancement. The questions at the beginning of this article were both removed from the L3P \u2013 one had a 100% pass rate, the other had a 33% pass rate. Try to guess which was which!<\/p>\n<p>&nbsp;<\/p>\n<h2>Study Guide<\/h2>\n<p><p><img  style='float:right'  class='lems-mtg-cardimg' src='http:\/\/gatherer.wizards.com\/Handlers\/Image.ashx?size=small&type=card&name=Negate&set=ORI'><\/p>Taking an L3A or L3B means being expected to have outstanding knowledge of Magic rules and policy. After all, we expect someone passing these exams to be ready to back up judges on the floor of a Grand Prix, take calls on camera at the Mythic Championship, or Head Judge a StarCityGames.com Open.<\/p>\n<p>While the <a href=\"http:\/\/blogs.magicjudges.org\/o\/judge-testing\/the-level-1-exam\/\">L1<\/a> and <a href=\"http:\/\/blogs.magicjudges.org\/o\/judge-testing\/the-level-2-exam\/\">L2<\/a> tests have excellent study guides, the L3 tests do not. Instead, almost everything is fair game. However, here is a list of topics you won\u2019t find on the L3 tests:<\/p>\n<ul>\n<li>Anything related to silver-border cards<\/li>\n<li>Anything related to Vanguard<\/li>\n<li>Ante<\/li>\n<li>Conspiracies, schemes, phenomena and planes<\/li>\n<li>Subgames<\/li>\n<li>Everything in CR 8 except for two-headed giant<\/li>\n<li>Everything in CR 9<\/li>\n<li>Rochester Draft<\/li>\n<li>Everything in MTR 10<\/li>\n<li>MTR Appendices A, C, D, E and F<\/li>\n<\/ul>\n<p>When taking the L3P, it\u2019s okay to consult the documents online. But remember that you\u2019re up against the clock, and that you won\u2019t be able to do so on your certification exam. So consider making note of questions where you had to look up a rule so you can study that area in depth later.<\/p>\n<p>You may find more multi-select questions on the L3P, L3A and L3B than you did on previous exams. In many cases, these questions are there to test not only how well you know the answer to the question, but also why that answer is correct.<\/p>\n<p>&nbsp;<\/p>\n<h2>Conclusion<\/h2>\n<p><p><img  style='float:left'  class='lems-mtg-cardimg' src='http:\/\/gatherer.wizards.com\/Handlers\/Image.ashx?size=small&type=card&name=Squirrel Dealer'><\/p>I hope this was a helpful introduction to the Level 3 exams. If you asked players what their number one expectation of judges is, I suspect the answer would be \u201cAnswer rules and policy questions correctly,\u201d and that\u2019s even more true for Level 3 Judges. While studying for your advancement exam can be an additional stress in an already stressful process, <strong>testing is an important tool to ensure the quality of Level 3 Judges<\/strong> remains high and we continue to earn players\u2019 and tournament organizers\u2019 trust.<\/p>\n<p>If you have feedback on a question on any exam, please click on the question number after you\u2019ve taken your test and submit it via the form. These comments are emailed to all the admins of that exam, and stay attached to the question so even if we don\u2019t make a change immediately, we\u2019ll keep an eye on it.<\/p>\n<p>Lastly, as promised, the answers to the questions from the beginning:<\/p>\n<blockquote><p>1) <strong>B. Puncture Bolt resolves. Skeleton Scavengers isn&#8217;t regenerated and is put into Anthony&#8217;s graveyard. Maggot Therapy is countered and is put into Nadine&#8217;s graveyard.<\/strong><\/p>\n<p>When Puncture Bolt resolves, 1 damage is dealt to Skeleton Scavengers and one -1\/-1 counter is put onto Skeleton Scavengers. Since Skeleton Scavengers has toughness 0, it isn&#8217;t regenerated and Skeleton Scavengers is put into Anthony&#8217;s graveyard when state-based actions are checked. [CR 704.5f][CR 704.5g] Maggot Therapy is countered on resolution and is put into Nadine&#8217;s graveyard. [CR 608.2b]<\/p><\/blockquote>\n<blockquote><p>2) <strong>E. In the declare blockers step, Andre announces Stampeding Rhino&#8217;s and Battle Hurda&#8217;s damage assignment order. Then Nanette announces Palace Guard&#8217;s and Pillarfield Ox&#8217;s damage assignment order.<\/strong><\/p>\n<p>After blocking creatures are declared, the damage assignment order for each creature is announced in the declare blockers step. Andre announces Stampeding Rhino&#8217;s and Battle Hurda&#8217;s damage assignment order. [CR 509.2] Then Nanette announces Palace Guard&#8217;s amd Pillarfield Ox&#8217;s damage assignment order. [CR 509.3] While Battle Hurda has first strike, that does not affect when its damage assignment order is announced. [CR 509.4]<\/p><\/blockquote>\n<p>&nbsp;<\/p>\n<h2>A Note about the Future<\/h2>\n<p>This article was started before the Judge Academy announcement, and we don\u2019t yet know what the Level 3 Exam is going to look like in the future. However, it will hopefully help candidates no matter when they take the exam, or at least provide some historical context as changes roll out.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>About the Author John Brian McCarthy is a Level 3 Judge from Arlington, VA, USA. He manages the Level 3 advancement exams. You can also find him at many Grand Prix, taking appeals in burgundy or taking photos for the Judges at Work albums. &nbsp; &nbsp; When you were studying to become a Level 1 [&hellip;]<\/p>\n","protected":false},"author":406,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[12],"tags":[],"language":[],"class_list":["post-366","post","type-post","status-publish","format-standard","hentry","category-test"],"_links":{"self":[{"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/posts\/366","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/users\/406"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/comments?post=366"}],"version-history":[{"count":18,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/posts\/366\/revisions"}],"predecessor-version":[{"id":384,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/posts\/366\/revisions\/384"}],"wp:attachment":[{"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/media?parent=366"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/categories?post=366"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/tags?post=366"},{"taxonomy":"language","embeddable":true,"href":"https:\/\/blogs.magicjudges.org\/road-to-l3\/wp-json\/wp\/v2\/language?post=366"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}