{"id":591,"date":"2020-09-22T02:29:23","date_gmt":"2020-09-22T02:29:23","guid":{"rendered":"https:\/\/support.boyidata.cn\/en\/index.php\/docs\/divominer-user-manual-2\/reliability-test\/reliability-calculation\/"},"modified":"2021-09-01T03:23:31","modified_gmt":"2021-09-01T03:23:31","slug":"reliability-calculation","status":"publish","type":"docs","link":"https:\/\/support.boyidata.cn\/en\/docs\/divominer-user-manual\/reliability-test\/reliability-calculation\/","title":{"rendered":"Reliability Calculation"},"content":{"rendered":"\n<p><span lang=\"EN-US\">After precoding, click \u201cReliability Calculation\u201d to check the&nbsp;reliability between coders overall&nbsp;and on specific categories. The reliability coefficient is calculated to observe whether different coders have reached an acceptable level of agreement with a consistent coding scheme. If the desired reliability level is not reached, coders need to be trained and instructed again to ensure the desired level of reliability. After that, you can start formal coding. In the following reliability test results, the Composite Reliability represents the overall reliability results of all categories. Click \u201c+\u201d to view the reliability results of specific options under each category.<\/span><\/p>\n\n\n\n<p><span lang=\"EN-US\">The platform currently provides four commonly used reliability test formulas: Holsti\u2019s Coefficient, Cohen\u2019s Kappa (k), Scott\u2019s Pi, and Krippendorff\u2019s alpha. The application of the formula greatly improves the authority of the reliability test. The platform can directly check the inter-coder reliability on each category question, convenient for coding correction and supervision.<\/span><\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" width=\"1024\" height=\"292\" src=\"https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/97\u4fe1\u5ea6\u8ba1\u7b97-1024x292.png\" alt=\"\" class=\"wp-image-8379\" srcset=\"https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/97\u4fe1\u5ea6\u8ba1\u7b97-1024x292.png 1024w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/97\u4fe1\u5ea6\u8ba1\u7b97-300x86.png 300w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/97\u4fe1\u5ea6\u8ba1\u7b97-768x219.png 768w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/97\u4fe1\u5ea6\u8ba1\u7b97-50x14.png 50w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/97\u4fe1\u5ea6\u8ba1\u7b97-1536x439.png 1536w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/97\u4fe1\u5ea6\u8ba1\u7b97-920x263.png 920w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/97\u4fe1\u5ea6\u8ba1\u7b97-600x171.png 600w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/97\u4fe1\u5ea6\u8ba1\u7b97-320x91.png 320w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/97\u4fe1\u5ea6\u8ba1\u7b97.png 1590w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><span lang=\"EN-US\">After coding, if you want to view the coding result of each coder, click \u201cExport Testing Data\u201d to download the coding results of the coder.<\/span><\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" width=\"1024\" height=\"325\" src=\"https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/98\u4fe1\u5ea6\u8ba1\u7b97-1024x325.png\" alt=\"\" class=\"wp-image-8380\" srcset=\"https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/98\u4fe1\u5ea6\u8ba1\u7b97-1024x325.png 1024w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/98\u4fe1\u5ea6\u8ba1\u7b97-300x95.png 300w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/98\u4fe1\u5ea6\u8ba1\u7b97-768x243.png 768w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/98\u4fe1\u5ea6\u8ba1\u7b97-50x16.png 50w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/98\u4fe1\u5ea6\u8ba1\u7b97-1536x487.png 1536w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/98\u4fe1\u5ea6\u8ba1\u7b97-920x292.png 920w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/98\u4fe1\u5ea6\u8ba1\u7b97-600x190.png 600w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/98\u4fe1\u5ea6\u8ba1\u7b97-320x101.png 320w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/98\u4fe1\u5ea6\u8ba1\u7b97.png 1587w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><span lang=\"EN-US\">If you want to evaluate the accuracy of machine coding results, click \u201cUpdate machine code reliability test results\u201d, then compare the machine coding results with the manual coding results.<\/span><\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" width=\"1024\" height=\"444\" src=\"https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/99\u4fe1\u5ea6\u8ba1\u7b97-1024x444.png\" alt=\"\" class=\"wp-image-8381\" srcset=\"https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/99\u4fe1\u5ea6\u8ba1\u7b97-1024x444.png 1024w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/99\u4fe1\u5ea6\u8ba1\u7b97-300x130.png 300w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/99\u4fe1\u5ea6\u8ba1\u7b97-768x333.png 768w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/99\u4fe1\u5ea6\u8ba1\u7b97-50x22.png 50w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/99\u4fe1\u5ea6\u8ba1\u7b97-920x399.png 920w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/99\u4fe1\u5ea6\u8ba1\u7b97-600x260.png 600w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/99\u4fe1\u5ea6\u8ba1\u7b97-320x139.png 320w, https:\/\/support.boyidata.cn\/en\/wp-content\/uploads\/2021\/09\/99\u4fe1\u5ea6\u8ba1\u7b97.png 1389w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n","protected":false},"featured_media":0,"parent":563,"menu_order":1,"comment_status":"open","ping_status":"closed","template":"","doc_tag":[],"_links":{"self":[{"href":"https:\/\/support.boyidata.cn\/en\/wp-json\/wp\/v2\/docs\/591"}],"collection":[{"href":"https:\/\/support.boyidata.cn\/en\/wp-json\/wp\/v2\/docs"}],"about":[{"href":"https:\/\/support.boyidata.cn\/en\/wp-json\/wp\/v2\/types\/docs"}],"replies":[{"embeddable":true,"href":"https:\/\/support.boyidata.cn\/en\/wp-json\/wp\/v2\/comments?post=591"}],"version-history":[{"count":34,"href":"https:\/\/support.boyidata.cn\/en\/wp-json\/wp\/v2\/docs\/591\/revisions"}],"predecessor-version":[{"id":8382,"href":"https:\/\/support.boyidata.cn\/en\/wp-json\/wp\/v2\/docs\/591\/revisions\/8382"}],"up":[{"embeddable":true,"href":"https:\/\/support.boyidata.cn\/en\/wp-json\/wp\/v2\/docs\/563"}],"next":[{"title":"Tracking","link":"https:\/\/support.boyidata.cn\/en\/docs\/divominer-user-manual\/reliability-test\/code-tracking\/","href":"https:\/\/support.boyidata.cn\/en\/wp-json\/wp\/v2\/docs\/593"}],"prev":[{"title":"Precoding","link":"https:\/\/support.boyidata.cn\/en\/docs\/divominer-user-manual\/reliability-test\/coding-test\/","href":"https:\/\/support.boyidata.cn\/en\/wp-json\/wp\/v2\/docs\/589"}],"wp:attachment":[{"href":"https:\/\/support.boyidata.cn\/en\/wp-json\/wp\/v2\/media?parent=591"}],"wp:term":[{"taxonomy":"doc_tag","embeddable":true,"href":"https:\/\/support.boyidata.cn\/en\/wp-json\/wp\/v2\/doc_tag?post=591"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}