A fuzzy set theory based computational model to represent the quality of inter-rater agreement
Abstract In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profil...
Ausführliche Beschreibung
Autor*in: |
Ciavolino, Enrico [verfasserIn] |
---|
Format: |
Artikel |
---|---|
Sprache: |
Englisch |
Erschienen: |
2013 |
---|
Schlagwörter: |
---|
Anmerkung: |
© Springer Science+Business Media Dordrecht 2013 |
---|
Übergeordnetes Werk: |
Enthalten in: Quality & quantity - Springer Netherlands, 1967, 48(2013), 4 vom: 06. Juli, Seite 2225-2240 |
---|---|
Übergeordnetes Werk: |
volume:48 ; year:2013 ; number:4 ; day:06 ; month:07 ; pages:2225-2240 |
Links: |
---|
DOI / URN: |
10.1007/s11135-013-9888-3 |
---|
Katalog-ID: |
OLC2063495432 |
---|
LEADER | 01000caa a22002652 4500 | ||
---|---|---|---|
001 | OLC2063495432 | ||
003 | DE-627 | ||
005 | 20230504020044.0 | ||
007 | tu | ||
008 | 200820s2013 xx ||||| 00| ||eng c | ||
024 | 7 | |a 10.1007/s11135-013-9888-3 |2 doi | |
035 | |a (DE-627)OLC2063495432 | ||
035 | |a (DE-He213)s11135-013-9888-3-p | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a eng | ||
082 | 0 | 4 | |a 050 |q VZ |
084 | |a 3,4 |2 ssgn | ||
100 | 1 | |a Ciavolino, Enrico |e verfasserin |4 aut | |
245 | 1 | 0 | |a A fuzzy set theory based computational model to represent the quality of inter-rater agreement |
264 | 1 | |c 2013 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a ohne Hilfsmittel zu benutzen |b n |2 rdamedia | ||
338 | |a Band |b nc |2 rdacarrier | ||
500 | |a © Springer Science+Business Media Dordrecht 2013 | ||
520 | |a Abstract In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study. | ||
650 | 4 | |a Inter-rater agreement | |
650 | 4 | |a Fuzzy set theory based models | |
650 | 4 | |a Performance measurement | |
650 | 4 | |a Quality measurement | |
700 | 1 | |a Salvatore, Sergio |4 aut | |
700 | 1 | |a Calcagnì, Antonio |4 aut | |
773 | 0 | 8 | |i Enthalten in |t Quality & quantity |d Springer Netherlands, 1967 |g 48(2013), 4 vom: 06. Juli, Seite 2225-2240 |w (DE-627)129084328 |w (DE-600)4140-3 |w (DE-576)014417715 |x 0033-5177 |7 nnns |
773 | 1 | 8 | |g volume:48 |g year:2013 |g number:4 |g day:06 |g month:07 |g pages:2225-2240 |
856 | 4 | 1 | |u https://doi.org/10.1007/s11135-013-9888-3 |z lizenzpflichtig |3 Volltext |
912 | |a GBV_USEFLAG_A | ||
912 | |a SYSFLAG_A | ||
912 | |a GBV_OLC | ||
912 | |a SSG-OLC-SOW | ||
912 | |a GBV_ILN_11 | ||
912 | |a GBV_ILN_65 | ||
912 | |a GBV_ILN_2012 | ||
912 | |a GBV_ILN_4012 | ||
912 | |a GBV_ILN_4029 | ||
912 | |a GBV_ILN_4325 | ||
912 | |a GBV_ILN_4700 | ||
951 | |a AR | ||
952 | |d 48 |j 2013 |e 4 |b 06 |c 07 |h 2225-2240 |
author_variant |
e c ec s s ss a c ac |
---|---|
matchkey_str |
article:00335177:2013----::fzyeterbsdopttoamdloersnteulto |
hierarchy_sort_str |
2013 |
publishDate |
2013 |
allfields |
10.1007/s11135-013-9888-3 doi (DE-627)OLC2063495432 (DE-He213)s11135-013-9888-3-p DE-627 ger DE-627 rakwb eng 050 VZ 3,4 ssgn Ciavolino, Enrico verfasserin aut A fuzzy set theory based computational model to represent the quality of inter-rater agreement 2013 Text txt rdacontent ohne Hilfsmittel zu benutzen n rdamedia Band nc rdacarrier © Springer Science+Business Media Dordrecht 2013 Abstract In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study. Inter-rater agreement Fuzzy set theory based models Performance measurement Quality measurement Salvatore, Sergio aut Calcagnì, Antonio aut Enthalten in Quality & quantity Springer Netherlands, 1967 48(2013), 4 vom: 06. Juli, Seite 2225-2240 (DE-627)129084328 (DE-600)4140-3 (DE-576)014417715 0033-5177 nnns volume:48 year:2013 number:4 day:06 month:07 pages:2225-2240 https://doi.org/10.1007/s11135-013-9888-3 lizenzpflichtig Volltext GBV_USEFLAG_A SYSFLAG_A GBV_OLC SSG-OLC-SOW GBV_ILN_11 GBV_ILN_65 GBV_ILN_2012 GBV_ILN_4012 GBV_ILN_4029 GBV_ILN_4325 GBV_ILN_4700 AR 48 2013 4 06 07 2225-2240 |
spelling |
10.1007/s11135-013-9888-3 doi (DE-627)OLC2063495432 (DE-He213)s11135-013-9888-3-p DE-627 ger DE-627 rakwb eng 050 VZ 3,4 ssgn Ciavolino, Enrico verfasserin aut A fuzzy set theory based computational model to represent the quality of inter-rater agreement 2013 Text txt rdacontent ohne Hilfsmittel zu benutzen n rdamedia Band nc rdacarrier © Springer Science+Business Media Dordrecht 2013 Abstract In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study. Inter-rater agreement Fuzzy set theory based models Performance measurement Quality measurement Salvatore, Sergio aut Calcagnì, Antonio aut Enthalten in Quality & quantity Springer Netherlands, 1967 48(2013), 4 vom: 06. Juli, Seite 2225-2240 (DE-627)129084328 (DE-600)4140-3 (DE-576)014417715 0033-5177 nnns volume:48 year:2013 number:4 day:06 month:07 pages:2225-2240 https://doi.org/10.1007/s11135-013-9888-3 lizenzpflichtig Volltext GBV_USEFLAG_A SYSFLAG_A GBV_OLC SSG-OLC-SOW GBV_ILN_11 GBV_ILN_65 GBV_ILN_2012 GBV_ILN_4012 GBV_ILN_4029 GBV_ILN_4325 GBV_ILN_4700 AR 48 2013 4 06 07 2225-2240 |
allfields_unstemmed |
10.1007/s11135-013-9888-3 doi (DE-627)OLC2063495432 (DE-He213)s11135-013-9888-3-p DE-627 ger DE-627 rakwb eng 050 VZ 3,4 ssgn Ciavolino, Enrico verfasserin aut A fuzzy set theory based computational model to represent the quality of inter-rater agreement 2013 Text txt rdacontent ohne Hilfsmittel zu benutzen n rdamedia Band nc rdacarrier © Springer Science+Business Media Dordrecht 2013 Abstract In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study. Inter-rater agreement Fuzzy set theory based models Performance measurement Quality measurement Salvatore, Sergio aut Calcagnì, Antonio aut Enthalten in Quality & quantity Springer Netherlands, 1967 48(2013), 4 vom: 06. Juli, Seite 2225-2240 (DE-627)129084328 (DE-600)4140-3 (DE-576)014417715 0033-5177 nnns volume:48 year:2013 number:4 day:06 month:07 pages:2225-2240 https://doi.org/10.1007/s11135-013-9888-3 lizenzpflichtig Volltext GBV_USEFLAG_A SYSFLAG_A GBV_OLC SSG-OLC-SOW GBV_ILN_11 GBV_ILN_65 GBV_ILN_2012 GBV_ILN_4012 GBV_ILN_4029 GBV_ILN_4325 GBV_ILN_4700 AR 48 2013 4 06 07 2225-2240 |
allfieldsGer |
10.1007/s11135-013-9888-3 doi (DE-627)OLC2063495432 (DE-He213)s11135-013-9888-3-p DE-627 ger DE-627 rakwb eng 050 VZ 3,4 ssgn Ciavolino, Enrico verfasserin aut A fuzzy set theory based computational model to represent the quality of inter-rater agreement 2013 Text txt rdacontent ohne Hilfsmittel zu benutzen n rdamedia Band nc rdacarrier © Springer Science+Business Media Dordrecht 2013 Abstract In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study. Inter-rater agreement Fuzzy set theory based models Performance measurement Quality measurement Salvatore, Sergio aut Calcagnì, Antonio aut Enthalten in Quality & quantity Springer Netherlands, 1967 48(2013), 4 vom: 06. Juli, Seite 2225-2240 (DE-627)129084328 (DE-600)4140-3 (DE-576)014417715 0033-5177 nnns volume:48 year:2013 number:4 day:06 month:07 pages:2225-2240 https://doi.org/10.1007/s11135-013-9888-3 lizenzpflichtig Volltext GBV_USEFLAG_A SYSFLAG_A GBV_OLC SSG-OLC-SOW GBV_ILN_11 GBV_ILN_65 GBV_ILN_2012 GBV_ILN_4012 GBV_ILN_4029 GBV_ILN_4325 GBV_ILN_4700 AR 48 2013 4 06 07 2225-2240 |
allfieldsSound |
10.1007/s11135-013-9888-3 doi (DE-627)OLC2063495432 (DE-He213)s11135-013-9888-3-p DE-627 ger DE-627 rakwb eng 050 VZ 3,4 ssgn Ciavolino, Enrico verfasserin aut A fuzzy set theory based computational model to represent the quality of inter-rater agreement 2013 Text txt rdacontent ohne Hilfsmittel zu benutzen n rdamedia Band nc rdacarrier © Springer Science+Business Media Dordrecht 2013 Abstract In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study. Inter-rater agreement Fuzzy set theory based models Performance measurement Quality measurement Salvatore, Sergio aut Calcagnì, Antonio aut Enthalten in Quality & quantity Springer Netherlands, 1967 48(2013), 4 vom: 06. Juli, Seite 2225-2240 (DE-627)129084328 (DE-600)4140-3 (DE-576)014417715 0033-5177 nnns volume:48 year:2013 number:4 day:06 month:07 pages:2225-2240 https://doi.org/10.1007/s11135-013-9888-3 lizenzpflichtig Volltext GBV_USEFLAG_A SYSFLAG_A GBV_OLC SSG-OLC-SOW GBV_ILN_11 GBV_ILN_65 GBV_ILN_2012 GBV_ILN_4012 GBV_ILN_4029 GBV_ILN_4325 GBV_ILN_4700 AR 48 2013 4 06 07 2225-2240 |
language |
English |
source |
Enthalten in Quality & quantity 48(2013), 4 vom: 06. Juli, Seite 2225-2240 volume:48 year:2013 number:4 day:06 month:07 pages:2225-2240 |
sourceStr |
Enthalten in Quality & quantity 48(2013), 4 vom: 06. Juli, Seite 2225-2240 volume:48 year:2013 number:4 day:06 month:07 pages:2225-2240 |
format_phy_str_mv |
Article |
institution |
findex.gbv.de |
topic_facet |
Inter-rater agreement Fuzzy set theory based models Performance measurement Quality measurement |
dewey-raw |
050 |
isfreeaccess_bool |
false |
container_title |
Quality & quantity |
authorswithroles_txt_mv |
Ciavolino, Enrico @@aut@@ Salvatore, Sergio @@aut@@ Calcagnì, Antonio @@aut@@ |
publishDateDaySort_date |
2013-07-06T00:00:00Z |
hierarchy_top_id |
129084328 |
dewey-sort |
250 |
id |
OLC2063495432 |
language_de |
englisch |
fullrecord |
<?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01000caa a22002652 4500</leader><controlfield tag="001">OLC2063495432</controlfield><controlfield tag="003">DE-627</controlfield><controlfield tag="005">20230504020044.0</controlfield><controlfield tag="007">tu</controlfield><controlfield tag="008">200820s2013 xx ||||| 00| ||eng c</controlfield><datafield tag="024" ind1="7" ind2=" "><subfield code="a">10.1007/s11135-013-9888-3</subfield><subfield code="2">doi</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-627)OLC2063495432</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-He213)s11135-013-9888-3-p</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-627</subfield><subfield code="b">ger</subfield><subfield code="c">DE-627</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1=" " ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="082" ind1="0" ind2="4"><subfield code="a">050</subfield><subfield code="q">VZ</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">3,4</subfield><subfield code="2">ssgn</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Ciavolino, Enrico</subfield><subfield code="e">verfasserin</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">A fuzzy set theory based computational model to represent the quality of inter-rater agreement</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="c">2013</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="a">Text</subfield><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="a">ohne Hilfsmittel zu benutzen</subfield><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="a">Band</subfield><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">© Springer Science+Business Media Dordrecht 2013</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">Abstract In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study.</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Inter-rater agreement</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Fuzzy set theory based models</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Performance measurement</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Quality measurement</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Salvatore, Sergio</subfield><subfield code="4">aut</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Calcagnì, Antonio</subfield><subfield code="4">aut</subfield></datafield><datafield tag="773" ind1="0" ind2="8"><subfield code="i">Enthalten in</subfield><subfield code="t">Quality & quantity</subfield><subfield code="d">Springer Netherlands, 1967</subfield><subfield code="g">48(2013), 4 vom: 06. Juli, Seite 2225-2240</subfield><subfield code="w">(DE-627)129084328</subfield><subfield code="w">(DE-600)4140-3</subfield><subfield code="w">(DE-576)014417715</subfield><subfield code="x">0033-5177</subfield><subfield code="7">nnns</subfield></datafield><datafield tag="773" ind1="1" ind2="8"><subfield code="g">volume:48</subfield><subfield code="g">year:2013</subfield><subfield code="g">number:4</subfield><subfield code="g">day:06</subfield><subfield code="g">month:07</subfield><subfield code="g">pages:2225-2240</subfield></datafield><datafield tag="856" ind1="4" ind2="1"><subfield code="u">https://doi.org/10.1007/s11135-013-9888-3</subfield><subfield code="z">lizenzpflichtig</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_USEFLAG_A</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">SYSFLAG_A</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_OLC</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">SSG-OLC-SOW</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_11</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_65</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_2012</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_4012</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_4029</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_4325</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_4700</subfield></datafield><datafield tag="951" ind1=" " ind2=" "><subfield code="a">AR</subfield></datafield><datafield tag="952" ind1=" " ind2=" "><subfield code="d">48</subfield><subfield code="j">2013</subfield><subfield code="e">4</subfield><subfield code="b">06</subfield><subfield code="c">07</subfield><subfield code="h">2225-2240</subfield></datafield></record></collection>
|
author |
Ciavolino, Enrico |
spellingShingle |
Ciavolino, Enrico ddc 050 ssgn 3,4 misc Inter-rater agreement misc Fuzzy set theory based models misc Performance measurement misc Quality measurement A fuzzy set theory based computational model to represent the quality of inter-rater agreement |
authorStr |
Ciavolino, Enrico |
ppnlink_with_tag_str_mv |
@@773@@(DE-627)129084328 |
format |
Article |
dewey-ones |
050 - General serial publications |
delete_txt_mv |
keep |
author_role |
aut aut aut |
collection |
OLC |
remote_str |
false |
illustrated |
Not Illustrated |
issn |
0033-5177 |
topic_title |
050 VZ 3,4 ssgn A fuzzy set theory based computational model to represent the quality of inter-rater agreement Inter-rater agreement Fuzzy set theory based models Performance measurement Quality measurement |
topic |
ddc 050 ssgn 3,4 misc Inter-rater agreement misc Fuzzy set theory based models misc Performance measurement misc Quality measurement |
topic_unstemmed |
ddc 050 ssgn 3,4 misc Inter-rater agreement misc Fuzzy set theory based models misc Performance measurement misc Quality measurement |
topic_browse |
ddc 050 ssgn 3,4 misc Inter-rater agreement misc Fuzzy set theory based models misc Performance measurement misc Quality measurement |
format_facet |
Aufsätze Gedruckte Aufsätze |
format_main_str_mv |
Text Zeitschrift/Artikel |
carriertype_str_mv |
nc |
hierarchy_parent_title |
Quality & quantity |
hierarchy_parent_id |
129084328 |
dewey-tens |
050 - Magazines, journals & serials |
hierarchy_top_title |
Quality & quantity |
isfreeaccess_txt |
false |
familylinks_str_mv |
(DE-627)129084328 (DE-600)4140-3 (DE-576)014417715 |
title |
A fuzzy set theory based computational model to represent the quality of inter-rater agreement |
ctrlnum |
(DE-627)OLC2063495432 (DE-He213)s11135-013-9888-3-p |
title_full |
A fuzzy set theory based computational model to represent the quality of inter-rater agreement |
author_sort |
Ciavolino, Enrico |
journal |
Quality & quantity |
journalStr |
Quality & quantity |
lang_code |
eng |
isOA_bool |
false |
dewey-hundreds |
000 - Computer science, information & general works |
recordtype |
marc |
publishDateSort |
2013 |
contenttype_str_mv |
txt |
container_start_page |
2225 |
author_browse |
Ciavolino, Enrico Salvatore, Sergio Calcagnì, Antonio |
container_volume |
48 |
class |
050 VZ 3,4 ssgn |
format_se |
Aufsätze |
author-letter |
Ciavolino, Enrico |
doi_str_mv |
10.1007/s11135-013-9888-3 |
dewey-full |
050 |
title_sort |
a fuzzy set theory based computational model to represent the quality of inter-rater agreement |
title_auth |
A fuzzy set theory based computational model to represent the quality of inter-rater agreement |
abstract |
Abstract In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study. © Springer Science+Business Media Dordrecht 2013 |
abstractGer |
Abstract In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study. © Springer Science+Business Media Dordrecht 2013 |
abstract_unstemmed |
Abstract In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study. © Springer Science+Business Media Dordrecht 2013 |
collection_details |
GBV_USEFLAG_A SYSFLAG_A GBV_OLC SSG-OLC-SOW GBV_ILN_11 GBV_ILN_65 GBV_ILN_2012 GBV_ILN_4012 GBV_ILN_4029 GBV_ILN_4325 GBV_ILN_4700 |
container_issue |
4 |
title_short |
A fuzzy set theory based computational model to represent the quality of inter-rater agreement |
url |
https://doi.org/10.1007/s11135-013-9888-3 |
remote_bool |
false |
author2 |
Salvatore, Sergio Calcagnì, Antonio |
author2Str |
Salvatore, Sergio Calcagnì, Antonio |
ppnlink |
129084328 |
mediatype_str_mv |
n |
isOA_txt |
false |
hochschulschrift_bool |
false |
doi_str |
10.1007/s11135-013-9888-3 |
up_date |
2024-07-03T19:15:17.243Z |
_version_ |
1803586494532681728 |
fullrecord_marcxml |
<?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01000caa a22002652 4500</leader><controlfield tag="001">OLC2063495432</controlfield><controlfield tag="003">DE-627</controlfield><controlfield tag="005">20230504020044.0</controlfield><controlfield tag="007">tu</controlfield><controlfield tag="008">200820s2013 xx ||||| 00| ||eng c</controlfield><datafield tag="024" ind1="7" ind2=" "><subfield code="a">10.1007/s11135-013-9888-3</subfield><subfield code="2">doi</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-627)OLC2063495432</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-He213)s11135-013-9888-3-p</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-627</subfield><subfield code="b">ger</subfield><subfield code="c">DE-627</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1=" " ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="082" ind1="0" ind2="4"><subfield code="a">050</subfield><subfield code="q">VZ</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">3,4</subfield><subfield code="2">ssgn</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Ciavolino, Enrico</subfield><subfield code="e">verfasserin</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">A fuzzy set theory based computational model to represent the quality of inter-rater agreement</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="c">2013</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="a">Text</subfield><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="a">ohne Hilfsmittel zu benutzen</subfield><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="a">Band</subfield><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">© Springer Science+Business Media Dordrecht 2013</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">Abstract In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study.</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Inter-rater agreement</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Fuzzy set theory based models</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Performance measurement</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Quality measurement</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Salvatore, Sergio</subfield><subfield code="4">aut</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Calcagnì, Antonio</subfield><subfield code="4">aut</subfield></datafield><datafield tag="773" ind1="0" ind2="8"><subfield code="i">Enthalten in</subfield><subfield code="t">Quality & quantity</subfield><subfield code="d">Springer Netherlands, 1967</subfield><subfield code="g">48(2013), 4 vom: 06. Juli, Seite 2225-2240</subfield><subfield code="w">(DE-627)129084328</subfield><subfield code="w">(DE-600)4140-3</subfield><subfield code="w">(DE-576)014417715</subfield><subfield code="x">0033-5177</subfield><subfield code="7">nnns</subfield></datafield><datafield tag="773" ind1="1" ind2="8"><subfield code="g">volume:48</subfield><subfield code="g">year:2013</subfield><subfield code="g">number:4</subfield><subfield code="g">day:06</subfield><subfield code="g">month:07</subfield><subfield code="g">pages:2225-2240</subfield></datafield><datafield tag="856" ind1="4" ind2="1"><subfield code="u">https://doi.org/10.1007/s11135-013-9888-3</subfield><subfield code="z">lizenzpflichtig</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_USEFLAG_A</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">SYSFLAG_A</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_OLC</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">SSG-OLC-SOW</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_11</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_65</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_2012</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_4012</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_4029</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_4325</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_ILN_4700</subfield></datafield><datafield tag="951" ind1=" " ind2=" "><subfield code="a">AR</subfield></datafield><datafield tag="952" ind1=" " ind2=" "><subfield code="d">48</subfield><subfield code="j">2013</subfield><subfield code="e">4</subfield><subfield code="b">06</subfield><subfield code="c">07</subfield><subfield code="h">2225-2240</subfield></datafield></record></collection>
|
score |
7.4005213 |