***  Notes - Discrimination Correct/Incorrect Report - 2-out-of-5   ***


  2-out-of-5 Testing Notes
  ------------------------

    Two-Out-of-Five Test is a discrimination test presenting 5 products to the judge among which 2 are from one group and 3 are from another group. 2A 3B. 

    Judges are asked to group the products into 2 groups usually based on similarity. Also known as a 2 Among 5 test, this test is used less often than the Triangle Test, Duo-Trio Test, or the paired-comparison tests.

    Similar to a Two-Out-of-Four, aka Tetrad Test, a discrimination test presenting 4 products to the judge among which 2 are from one group and 2 are from another group. 2A 2B. 


    Two-Out-of-Five test is generally not suitable for food products and flavors. Are you testing food or flavors?

    Guess probability is 10%.  For the unspecified tetrad test.

      Unspecified 2-out-of-5 test vs specified 2-out-of-5 test.  More common type of 2-out-of-5 test is the unspecified 2-out-of-5 test.
        Unspecified 2-out-of-5 test:
          Acccessors are not given any specific instructions about attributes to focus on.
          Acccessors task is simply to group the products with out regard for order or intensity.
          Guess probability is 10%.
          SIMS Reports assume the unspecifed tetrad test.
        Specified 2-out-of-5 test:
          Acccessors are given a specific attribute to focus on.
          Acccessors task is to group the products in the correct intensity order, usually low to high, week to strong, etc.
          Guess probability is 5%.  Adjust Excel line for 'Probability of a Correct Guess:', and recount correct/incorrect.



    2-out-of-5 Test Setup:
      See examples on SIMS Webpage:  http://www.SIMS2000.com/Questionnaire-Tetrad.asp
        SIMS Software Express Package file examples are available on the webpage for quick Set up on your SIMS System.

      Your Affective SIMS Ballot must include:
        1 Instruction Box for the Group A and Group B Column headings, use <WEBTEXTGRID; Tag for this, copy from examples.
        5 Hedonics, 2 choices each, return values 1 and 2 referring to Group A and Group B.
        Each of the 5 Hedonic export labels  = "Relative Sample Order #" , where # is 1 to 5.
        Each of the 5 Hedonic questions text = "Sample <RELATIVE_SAMPLE_#_BLINDING_CODE>" , where # is 1 to 5.

        Only ONE 2-out-of-5 group of 5 can be built into the ballot.
          If you need multiple 2-out-of-5 groups then please use separate SIMS tests and use Test Linking for the panelist session.
          Reps, multiple Reps are supported.

      During your test, SIMS will be able to identify and detect the 2-out-of-5 Test page and validate the 3 x 2 responses for Group A & Group B.


    2-out-of-5 special ballot detection criteria for Reports:
      In order to properly identify 2-out-of-5 Ballots and Tests,
      SIMS looks for ballots with exactly 5 Hedonics where Attribute Seen With = Relative Last Sample, and the Export Label contains word 'Relative'
      These guidelines are needed to best handle the new complexity of 2-out-of-5 designs and may be adjusted in the future.


    2-out-of-5 Experimental Design:
      Because this test is a little different than a typical discrimination test, the experimental design will also be a little different in setup.
      You have 2 unique samples, and will be presenting 5 samples to each panelist, comprising 6 possible blinding codes/.
      Setup a 6C5R1 SIMS Experimental Design with 6 sample descriptions such as:  Prototype, Prototype, Prototype, Control, Control and Control.
      Your actual unique sample 1 (Prototype) is 1-2-3 and your actual unique sample 2 (Control) is 4-5-6.
      Use the built-in SIMS Experimental Plan named 06050006 for mathematical Combinations 6C5, t=6, k=5, b=6, r=1.
      The 6 blocks are: 1-2-3-4-5  1-2-3-4-6   1-2-3-5-6  1-2-4-5-6  1-3-4-5-6  2-3-4-5-6.
      There are 20 different sample combinations (three 1's and three 2's)
      11122 22211 11212 22121 12112 21221 21112 12221 11221 22112 12121 21212 21121 12212 12211 21122 21211 12122 22111 11222
      AAABB BBBAA AABAB BBABA ABAAB BABBA BAAAB ABBBA AABBA BBAAB ABABA BABAB BAABA ABBAB ABBAA BAABB BABAA ABABB BBAAA AABBB
      See print screen examples on website: https://www.sims2000.com/Questionnaire-2-Out-of-5.asp


    2-out-of-5 Test Definition:
      Review your Test Rotation plan for accuracy.
 

    2-out-of-5 Reports:
      Stats, similar to Tetrad Test.
        See complete statistical Table 17.14 Critical Number of Correct Responses in Two-out-of-Five Test,
        Sensory Evaluation Techniques, 4th Edition, by Meilgaard, Civille, and Carr, page 439. 

     Report:  The SIMS 2-out-of-5 Report is located at:  SIMS Main Menu | Reports | Discrimination Reports | Discrimination Correct/Incorrect Report - Tetrad / 2-out-of-5
      Most other SIMS reports will not provide meaningful information, please use the one report mentioned above.

      SIMS Reports assume the unspecifed 2-out-of-5 test.


    Stats: Two-Out-of-Five Test
      In the partial chart below 'n' signifies the number of assessments in the test, and .1/.05 represents the a-risk, 
      match the a-risk you want with the number of assessments you have performed to find the minimum number of correct responses needed to show significance. 
      For example, for 20 assessments at an a-risk of 0.05, you’d need 5 or more correct responses to show a significant difference.
 
              alpha
         n  0.1 0.05    n  0.1 0.05    n  0.1 0.05    n  0.1 0.05
         3   2   2      10  3   4      17  4   5      24  5   6
         4   2   3      11  3   4      18  4   5      25  5   6
         5   2   3      12  4   4      19  5   5      30  6   7
         6   3   3      13  4   4      20  5   5      60  10  11
         7   3   3      14  4   4      21  5   6     
         8   3   3      15  4   5      22  5   6     
         9   3   4      16  4   5      23  5   6

    See complete statistical Table 17.14 Critical Number of Correct Responses in Two-out-of-Five Test,
      Sensory Evaluation Techniques, 4th Edition, by Meilgaard, Civille, and Carr, page 439. 


    Pros & cons:
      Statistically robust, since the chances of guessing the 2/5 samples correctly is 1/10, rather than 1/3 as in the Triangle Test. 
      Fewer panelists are often needed due to this boost in power – as few as 5 or 6 panelists can be used when expected differences are large enough. 
      But not a good choice when carry-over and lingering aftertastes is an issue due to the high number of samples that need to be tasted.


    Where's my 2-out-of-5 Test?:
      Likely your ballot didn't match the detection criteria discussed above.  Contact the Sensory Computer Systems support staff and they'll assist.


    References:
      Sensory Evaluation Techniques, Civille & Carr, 4th Edition, Chapter 6 Overall Difference Tests, page 80

    More information:
      https://www.sensorysociety.org/knowledge/sspwiki/Pages/Two-out-of-five%20Test.aspx
      https://www.sims2000.com/Questionnaire-2-Out-of-5.asp

    Download:
      Fast track to a SIMS 2-out-of-5 test completely setup in your SIMS systsm via the SIMS software express package file: 2-OUT-OF-5.SIMS2000ExpressPackage.sql.ZIP