Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching
Abstract Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwes...
Ausführliche Beschreibung
Autor*in: |
Blankenberger, Bob [verfasserIn] |
---|
Format: |
Artikel |
---|---|
Sprache: |
Englisch |
Erschienen: |
2021 |
---|
Schlagwörter: |
---|
Anmerkung: |
© The Author(s) 2021. corrected publication 2021 |
---|
Übergeordnetes Werk: |
Enthalten in: Research in higher education - Springer Netherlands, 1973, 62(2021), 8 vom: 10. Apr., Seite 1248-1275 |
---|---|
Übergeordnetes Werk: |
volume:62 ; year:2021 ; number:8 ; day:10 ; month:04 ; pages:1248-1275 |
Links: |
---|
DOI / URN: |
10.1007/s11162-021-09632-0 |
---|
Katalog-ID: |
OLC2077355638 |
---|
LEADER | 01000caa a22002652 4500 | ||
---|---|---|---|
001 | OLC2077355638 | ||
003 | DE-627 | ||
005 | 20230505144154.0 | ||
007 | tu | ||
008 | 221220s2021 xx ||||| 00| ||eng c | ||
024 | 7 | |a 10.1007/s11162-021-09632-0 |2 doi | |
035 | |a (DE-627)OLC2077355638 | ||
035 | |a (DE-He213)s11162-021-09632-0-p | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a eng | ||
082 | 0 | 4 | |a 370 |q VZ |
084 | |a 24,2 |a 5,3 |2 ssgn | ||
100 | 1 | |a Blankenberger, Bob |e verfasserin |0 (orcid)0000-0002-5025-4880 |4 aut | |
245 | 1 | 0 | |a Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching |
264 | 1 | |c 2021 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a ohne Hilfsmittel zu benutzen |b n |2 rdamedia | ||
338 | |a Band |b nc |2 rdacarrier | ||
500 | |a © The Author(s) 2021. corrected publication 2021 | ||
520 | |a Abstract Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we compared analysis approaches using basic descriptive analyses, regression, standard propensity score matching (PSM), and a mixture of PSM with continuous variables, coarsened exact matching, and exact matching on categorical variables. We used three examples of program evaluations: a freshman seminar, an upper division general education program intended to improve cultural awareness and respect for diverse groups, and multiple living learning communities. We describe how these evaluations were conducted, compare the different results for each type of method employed, and discuss the strengths and weaknesses of each in the context of program evaluation. | ||
650 | 4 | |a Propensity score matching | |
650 | 4 | |a Exact matching | |
650 | 4 | |a Coarsened exact matching | |
650 | 4 | |a Program evaluation | |
650 | 4 | |a Assessment | |
700 | 1 | |a Gehlhausen Anderson, Sophia |4 aut | |
700 | 1 | |a Lichtenberger, Eric |4 aut | |
773 | 0 | 8 | |i Enthalten in |t Research in higher education |d Springer Netherlands, 1973 |g 62(2021), 8 vom: 10. Apr., Seite 1248-1275 |w (DE-627)129445762 |w (DE-600)196017-9 |w (DE-576)9129445760 |x 0361-0365 |7 nnns |
773 | 1 | 8 | |g volume:62 |g year:2021 |g number:8 |g day:10 |g month:04 |g pages:1248-1275 |
856 | 4 | 1 | |u https://doi.org/10.1007/s11162-021-09632-0 |z lizenzpflichtig |3 Volltext |
912 | |a GBV_USEFLAG_A | ||
912 | |a SYSFLAG_A | ||
912 | |a GBV_OLC | ||
912 | |a SSG-OLC-HSW | ||
951 | |a AR | ||
952 | |d 62 |j 2021 |e 8 |b 10 |c 04 |h 1248-1275 |
author_variant |
b b bb a s g as asg e l el |
---|---|
matchkey_str |
article:03610365:2021----::mrvnisiuinlvlainehdcmaigheeautossnpmx |
hierarchy_sort_str |
2021 |
publishDate |
2021 |
allfields |
10.1007/s11162-021-09632-0 doi (DE-627)OLC2077355638 (DE-He213)s11162-021-09632-0-p DE-627 ger DE-627 rakwb eng 370 VZ 24,2 5,3 ssgn Blankenberger, Bob verfasserin (orcid)0000-0002-5025-4880 aut Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching 2021 Text txt rdacontent ohne Hilfsmittel zu benutzen n rdamedia Band nc rdacarrier © The Author(s) 2021. corrected publication 2021 Abstract Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we compared analysis approaches using basic descriptive analyses, regression, standard propensity score matching (PSM), and a mixture of PSM with continuous variables, coarsened exact matching, and exact matching on categorical variables. We used three examples of program evaluations: a freshman seminar, an upper division general education program intended to improve cultural awareness and respect for diverse groups, and multiple living learning communities. We describe how these evaluations were conducted, compare the different results for each type of method employed, and discuss the strengths and weaknesses of each in the context of program evaluation. Propensity score matching Exact matching Coarsened exact matching Program evaluation Assessment Gehlhausen Anderson, Sophia aut Lichtenberger, Eric aut Enthalten in Research in higher education Springer Netherlands, 1973 62(2021), 8 vom: 10. Apr., Seite 1248-1275 (DE-627)129445762 (DE-600)196017-9 (DE-576)9129445760 0361-0365 nnns volume:62 year:2021 number:8 day:10 month:04 pages:1248-1275 https://doi.org/10.1007/s11162-021-09632-0 lizenzpflichtig Volltext GBV_USEFLAG_A SYSFLAG_A GBV_OLC SSG-OLC-HSW AR 62 2021 8 10 04 1248-1275 |
spelling |
10.1007/s11162-021-09632-0 doi (DE-627)OLC2077355638 (DE-He213)s11162-021-09632-0-p DE-627 ger DE-627 rakwb eng 370 VZ 24,2 5,3 ssgn Blankenberger, Bob verfasserin (orcid)0000-0002-5025-4880 aut Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching 2021 Text txt rdacontent ohne Hilfsmittel zu benutzen n rdamedia Band nc rdacarrier © The Author(s) 2021. corrected publication 2021 Abstract Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we compared analysis approaches using basic descriptive analyses, regression, standard propensity score matching (PSM), and a mixture of PSM with continuous variables, coarsened exact matching, and exact matching on categorical variables. We used three examples of program evaluations: a freshman seminar, an upper division general education program intended to improve cultural awareness and respect for diverse groups, and multiple living learning communities. We describe how these evaluations were conducted, compare the different results for each type of method employed, and discuss the strengths and weaknesses of each in the context of program evaluation. Propensity score matching Exact matching Coarsened exact matching Program evaluation Assessment Gehlhausen Anderson, Sophia aut Lichtenberger, Eric aut Enthalten in Research in higher education Springer Netherlands, 1973 62(2021), 8 vom: 10. Apr., Seite 1248-1275 (DE-627)129445762 (DE-600)196017-9 (DE-576)9129445760 0361-0365 nnns volume:62 year:2021 number:8 day:10 month:04 pages:1248-1275 https://doi.org/10.1007/s11162-021-09632-0 lizenzpflichtig Volltext GBV_USEFLAG_A SYSFLAG_A GBV_OLC SSG-OLC-HSW AR 62 2021 8 10 04 1248-1275 |
allfields_unstemmed |
10.1007/s11162-021-09632-0 doi (DE-627)OLC2077355638 (DE-He213)s11162-021-09632-0-p DE-627 ger DE-627 rakwb eng 370 VZ 24,2 5,3 ssgn Blankenberger, Bob verfasserin (orcid)0000-0002-5025-4880 aut Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching 2021 Text txt rdacontent ohne Hilfsmittel zu benutzen n rdamedia Band nc rdacarrier © The Author(s) 2021. corrected publication 2021 Abstract Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we compared analysis approaches using basic descriptive analyses, regression, standard propensity score matching (PSM), and a mixture of PSM with continuous variables, coarsened exact matching, and exact matching on categorical variables. We used three examples of program evaluations: a freshman seminar, an upper division general education program intended to improve cultural awareness and respect for diverse groups, and multiple living learning communities. We describe how these evaluations were conducted, compare the different results for each type of method employed, and discuss the strengths and weaknesses of each in the context of program evaluation. Propensity score matching Exact matching Coarsened exact matching Program evaluation Assessment Gehlhausen Anderson, Sophia aut Lichtenberger, Eric aut Enthalten in Research in higher education Springer Netherlands, 1973 62(2021), 8 vom: 10. Apr., Seite 1248-1275 (DE-627)129445762 (DE-600)196017-9 (DE-576)9129445760 0361-0365 nnns volume:62 year:2021 number:8 day:10 month:04 pages:1248-1275 https://doi.org/10.1007/s11162-021-09632-0 lizenzpflichtig Volltext GBV_USEFLAG_A SYSFLAG_A GBV_OLC SSG-OLC-HSW AR 62 2021 8 10 04 1248-1275 |
allfieldsGer |
10.1007/s11162-021-09632-0 doi (DE-627)OLC2077355638 (DE-He213)s11162-021-09632-0-p DE-627 ger DE-627 rakwb eng 370 VZ 24,2 5,3 ssgn Blankenberger, Bob verfasserin (orcid)0000-0002-5025-4880 aut Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching 2021 Text txt rdacontent ohne Hilfsmittel zu benutzen n rdamedia Band nc rdacarrier © The Author(s) 2021. corrected publication 2021 Abstract Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we compared analysis approaches using basic descriptive analyses, regression, standard propensity score matching (PSM), and a mixture of PSM with continuous variables, coarsened exact matching, and exact matching on categorical variables. We used three examples of program evaluations: a freshman seminar, an upper division general education program intended to improve cultural awareness and respect for diverse groups, and multiple living learning communities. We describe how these evaluations were conducted, compare the different results for each type of method employed, and discuss the strengths and weaknesses of each in the context of program evaluation. Propensity score matching Exact matching Coarsened exact matching Program evaluation Assessment Gehlhausen Anderson, Sophia aut Lichtenberger, Eric aut Enthalten in Research in higher education Springer Netherlands, 1973 62(2021), 8 vom: 10. Apr., Seite 1248-1275 (DE-627)129445762 (DE-600)196017-9 (DE-576)9129445760 0361-0365 nnns volume:62 year:2021 number:8 day:10 month:04 pages:1248-1275 https://doi.org/10.1007/s11162-021-09632-0 lizenzpflichtig Volltext GBV_USEFLAG_A SYSFLAG_A GBV_OLC SSG-OLC-HSW AR 62 2021 8 10 04 1248-1275 |
allfieldsSound |
10.1007/s11162-021-09632-0 doi (DE-627)OLC2077355638 (DE-He213)s11162-021-09632-0-p DE-627 ger DE-627 rakwb eng 370 VZ 24,2 5,3 ssgn Blankenberger, Bob verfasserin (orcid)0000-0002-5025-4880 aut Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching 2021 Text txt rdacontent ohne Hilfsmittel zu benutzen n rdamedia Band nc rdacarrier © The Author(s) 2021. corrected publication 2021 Abstract Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we compared analysis approaches using basic descriptive analyses, regression, standard propensity score matching (PSM), and a mixture of PSM with continuous variables, coarsened exact matching, and exact matching on categorical variables. We used three examples of program evaluations: a freshman seminar, an upper division general education program intended to improve cultural awareness and respect for diverse groups, and multiple living learning communities. We describe how these evaluations were conducted, compare the different results for each type of method employed, and discuss the strengths and weaknesses of each in the context of program evaluation. Propensity score matching Exact matching Coarsened exact matching Program evaluation Assessment Gehlhausen Anderson, Sophia aut Lichtenberger, Eric aut Enthalten in Research in higher education Springer Netherlands, 1973 62(2021), 8 vom: 10. Apr., Seite 1248-1275 (DE-627)129445762 (DE-600)196017-9 (DE-576)9129445760 0361-0365 nnns volume:62 year:2021 number:8 day:10 month:04 pages:1248-1275 https://doi.org/10.1007/s11162-021-09632-0 lizenzpflichtig Volltext GBV_USEFLAG_A SYSFLAG_A GBV_OLC SSG-OLC-HSW AR 62 2021 8 10 04 1248-1275 |
language |
English |
source |
Enthalten in Research in higher education 62(2021), 8 vom: 10. Apr., Seite 1248-1275 volume:62 year:2021 number:8 day:10 month:04 pages:1248-1275 |
sourceStr |
Enthalten in Research in higher education 62(2021), 8 vom: 10. Apr., Seite 1248-1275 volume:62 year:2021 number:8 day:10 month:04 pages:1248-1275 |
format_phy_str_mv |
Article |
institution |
findex.gbv.de |
topic_facet |
Propensity score matching Exact matching Coarsened exact matching Program evaluation Assessment |
dewey-raw |
370 |
isfreeaccess_bool |
false |
container_title |
Research in higher education |
authorswithroles_txt_mv |
Blankenberger, Bob @@aut@@ Gehlhausen Anderson, Sophia @@aut@@ Lichtenberger, Eric @@aut@@ |
publishDateDaySort_date |
2021-04-10T00:00:00Z |
hierarchy_top_id |
129445762 |
dewey-sort |
3370 |
id |
OLC2077355638 |
language_de |
englisch |
fullrecord |
<?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01000caa a22002652 4500</leader><controlfield tag="001">OLC2077355638</controlfield><controlfield tag="003">DE-627</controlfield><controlfield tag="005">20230505144154.0</controlfield><controlfield tag="007">tu</controlfield><controlfield tag="008">221220s2021 xx ||||| 00| ||eng c</controlfield><datafield tag="024" ind1="7" ind2=" "><subfield code="a">10.1007/s11162-021-09632-0</subfield><subfield code="2">doi</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-627)OLC2077355638</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-He213)s11162-021-09632-0-p</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-627</subfield><subfield code="b">ger</subfield><subfield code="c">DE-627</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1=" " ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="082" ind1="0" ind2="4"><subfield code="a">370</subfield><subfield code="q">VZ</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">24,2</subfield><subfield code="a">5,3</subfield><subfield code="2">ssgn</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Blankenberger, Bob</subfield><subfield code="e">verfasserin</subfield><subfield code="0">(orcid)0000-0002-5025-4880</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="c">2021</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="a">Text</subfield><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="a">ohne Hilfsmittel zu benutzen</subfield><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="a">Band</subfield><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">© The Author(s) 2021. corrected publication 2021</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">Abstract Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we compared analysis approaches using basic descriptive analyses, regression, standard propensity score matching (PSM), and a mixture of PSM with continuous variables, coarsened exact matching, and exact matching on categorical variables. We used three examples of program evaluations: a freshman seminar, an upper division general education program intended to improve cultural awareness and respect for diverse groups, and multiple living learning communities. We describe how these evaluations were conducted, compare the different results for each type of method employed, and discuss the strengths and weaknesses of each in the context of program evaluation.</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Propensity score matching</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Exact matching</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Coarsened exact matching</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Program evaluation</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Assessment</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Gehlhausen Anderson, Sophia</subfield><subfield code="4">aut</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Lichtenberger, Eric</subfield><subfield code="4">aut</subfield></datafield><datafield tag="773" ind1="0" ind2="8"><subfield code="i">Enthalten in</subfield><subfield code="t">Research in higher education</subfield><subfield code="d">Springer Netherlands, 1973</subfield><subfield code="g">62(2021), 8 vom: 10. Apr., Seite 1248-1275</subfield><subfield code="w">(DE-627)129445762</subfield><subfield code="w">(DE-600)196017-9</subfield><subfield code="w">(DE-576)9129445760</subfield><subfield code="x">0361-0365</subfield><subfield code="7">nnns</subfield></datafield><datafield tag="773" ind1="1" ind2="8"><subfield code="g">volume:62</subfield><subfield code="g">year:2021</subfield><subfield code="g">number:8</subfield><subfield code="g">day:10</subfield><subfield code="g">month:04</subfield><subfield code="g">pages:1248-1275</subfield></datafield><datafield tag="856" ind1="4" ind2="1"><subfield code="u">https://doi.org/10.1007/s11162-021-09632-0</subfield><subfield code="z">lizenzpflichtig</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_USEFLAG_A</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">SYSFLAG_A</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_OLC</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">SSG-OLC-HSW</subfield></datafield><datafield tag="951" ind1=" " ind2=" "><subfield code="a">AR</subfield></datafield><datafield tag="952" ind1=" " ind2=" "><subfield code="d">62</subfield><subfield code="j">2021</subfield><subfield code="e">8</subfield><subfield code="b">10</subfield><subfield code="c">04</subfield><subfield code="h">1248-1275</subfield></datafield></record></collection>
|
author |
Blankenberger, Bob |
spellingShingle |
Blankenberger, Bob ddc 370 ssgn 24,2 misc Propensity score matching misc Exact matching misc Coarsened exact matching misc Program evaluation misc Assessment Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching |
authorStr |
Blankenberger, Bob |
ppnlink_with_tag_str_mv |
@@773@@(DE-627)129445762 |
format |
Article |
dewey-ones |
370 - Education |
delete_txt_mv |
keep |
author_role |
aut aut aut |
collection |
OLC |
remote_str |
false |
illustrated |
Not Illustrated |
issn |
0361-0365 |
topic_title |
370 VZ 24,2 5,3 ssgn Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching Propensity score matching Exact matching Coarsened exact matching Program evaluation Assessment |
topic |
ddc 370 ssgn 24,2 misc Propensity score matching misc Exact matching misc Coarsened exact matching misc Program evaluation misc Assessment |
topic_unstemmed |
ddc 370 ssgn 24,2 misc Propensity score matching misc Exact matching misc Coarsened exact matching misc Program evaluation misc Assessment |
topic_browse |
ddc 370 ssgn 24,2 misc Propensity score matching misc Exact matching misc Coarsened exact matching misc Program evaluation misc Assessment |
format_facet |
Aufsätze Gedruckte Aufsätze |
format_main_str_mv |
Text Zeitschrift/Artikel |
carriertype_str_mv |
nc |
hierarchy_parent_title |
Research in higher education |
hierarchy_parent_id |
129445762 |
dewey-tens |
370 - Education |
hierarchy_top_title |
Research in higher education |
isfreeaccess_txt |
false |
familylinks_str_mv |
(DE-627)129445762 (DE-600)196017-9 (DE-576)9129445760 |
title |
Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching |
ctrlnum |
(DE-627)OLC2077355638 (DE-He213)s11162-021-09632-0-p |
title_full |
Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching |
author_sort |
Blankenberger, Bob |
journal |
Research in higher education |
journalStr |
Research in higher education |
lang_code |
eng |
isOA_bool |
false |
dewey-hundreds |
300 - Social sciences |
recordtype |
marc |
publishDateSort |
2021 |
contenttype_str_mv |
txt |
container_start_page |
1248 |
author_browse |
Blankenberger, Bob Gehlhausen Anderson, Sophia Lichtenberger, Eric |
container_volume |
62 |
class |
370 VZ 24,2 5,3 ssgn |
format_se |
Aufsätze |
author-letter |
Blankenberger, Bob |
doi_str_mv |
10.1007/s11162-021-09632-0 |
normlink |
(ORCID)0000-0002-5025-4880 |
normlink_prefix_str_mv |
(orcid)0000-0002-5025-4880 |
dewey-full |
370 |
title_sort |
improving institutional evaluation methods: comparing three evaluations using psm, exact and coarsened exact matching |
title_auth |
Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching |
abstract |
Abstract Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we compared analysis approaches using basic descriptive analyses, regression, standard propensity score matching (PSM), and a mixture of PSM with continuous variables, coarsened exact matching, and exact matching on categorical variables. We used three examples of program evaluations: a freshman seminar, an upper division general education program intended to improve cultural awareness and respect for diverse groups, and multiple living learning communities. We describe how these evaluations were conducted, compare the different results for each type of method employed, and discuss the strengths and weaknesses of each in the context of program evaluation. © The Author(s) 2021. corrected publication 2021 |
abstractGer |
Abstract Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we compared analysis approaches using basic descriptive analyses, regression, standard propensity score matching (PSM), and a mixture of PSM with continuous variables, coarsened exact matching, and exact matching on categorical variables. We used three examples of program evaluations: a freshman seminar, an upper division general education program intended to improve cultural awareness and respect for diverse groups, and multiple living learning communities. We describe how these evaluations were conducted, compare the different results for each type of method employed, and discuss the strengths and weaknesses of each in the context of program evaluation. © The Author(s) 2021. corrected publication 2021 |
abstract_unstemmed |
Abstract Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we compared analysis approaches using basic descriptive analyses, regression, standard propensity score matching (PSM), and a mixture of PSM with continuous variables, coarsened exact matching, and exact matching on categorical variables. We used three examples of program evaluations: a freshman seminar, an upper division general education program intended to improve cultural awareness and respect for diverse groups, and multiple living learning communities. We describe how these evaluations were conducted, compare the different results for each type of method employed, and discuss the strengths and weaknesses of each in the context of program evaluation. © The Author(s) 2021. corrected publication 2021 |
collection_details |
GBV_USEFLAG_A SYSFLAG_A GBV_OLC SSG-OLC-HSW |
container_issue |
8 |
title_short |
Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching |
url |
https://doi.org/10.1007/s11162-021-09632-0 |
remote_bool |
false |
author2 |
Gehlhausen Anderson, Sophia Lichtenberger, Eric |
author2Str |
Gehlhausen Anderson, Sophia Lichtenberger, Eric |
ppnlink |
129445762 |
mediatype_str_mv |
n |
isOA_txt |
false |
hochschulschrift_bool |
false |
doi_str |
10.1007/s11162-021-09632-0 |
up_date |
2024-07-03T15:07:14.984Z |
_version_ |
1803570889340485632 |
fullrecord_marcxml |
<?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01000caa a22002652 4500</leader><controlfield tag="001">OLC2077355638</controlfield><controlfield tag="003">DE-627</controlfield><controlfield tag="005">20230505144154.0</controlfield><controlfield tag="007">tu</controlfield><controlfield tag="008">221220s2021 xx ||||| 00| ||eng c</controlfield><datafield tag="024" ind1="7" ind2=" "><subfield code="a">10.1007/s11162-021-09632-0</subfield><subfield code="2">doi</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-627)OLC2077355638</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-He213)s11162-021-09632-0-p</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-627</subfield><subfield code="b">ger</subfield><subfield code="c">DE-627</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1=" " ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="082" ind1="0" ind2="4"><subfield code="a">370</subfield><subfield code="q">VZ</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">24,2</subfield><subfield code="a">5,3</subfield><subfield code="2">ssgn</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Blankenberger, Bob</subfield><subfield code="e">verfasserin</subfield><subfield code="0">(orcid)0000-0002-5025-4880</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="c">2021</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="a">Text</subfield><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="a">ohne Hilfsmittel zu benutzen</subfield><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="a">Band</subfield><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">© The Author(s) 2021. corrected publication 2021</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">Abstract Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we compared analysis approaches using basic descriptive analyses, regression, standard propensity score matching (PSM), and a mixture of PSM with continuous variables, coarsened exact matching, and exact matching on categorical variables. We used three examples of program evaluations: a freshman seminar, an upper division general education program intended to improve cultural awareness and respect for diverse groups, and multiple living learning communities. We describe how these evaluations were conducted, compare the different results for each type of method employed, and discuss the strengths and weaknesses of each in the context of program evaluation.</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Propensity score matching</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Exact matching</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Coarsened exact matching</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Program evaluation</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Assessment</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Gehlhausen Anderson, Sophia</subfield><subfield code="4">aut</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Lichtenberger, Eric</subfield><subfield code="4">aut</subfield></datafield><datafield tag="773" ind1="0" ind2="8"><subfield code="i">Enthalten in</subfield><subfield code="t">Research in higher education</subfield><subfield code="d">Springer Netherlands, 1973</subfield><subfield code="g">62(2021), 8 vom: 10. Apr., Seite 1248-1275</subfield><subfield code="w">(DE-627)129445762</subfield><subfield code="w">(DE-600)196017-9</subfield><subfield code="w">(DE-576)9129445760</subfield><subfield code="x">0361-0365</subfield><subfield code="7">nnns</subfield></datafield><datafield tag="773" ind1="1" ind2="8"><subfield code="g">volume:62</subfield><subfield code="g">year:2021</subfield><subfield code="g">number:8</subfield><subfield code="g">day:10</subfield><subfield code="g">month:04</subfield><subfield code="g">pages:1248-1275</subfield></datafield><datafield tag="856" ind1="4" ind2="1"><subfield code="u">https://doi.org/10.1007/s11162-021-09632-0</subfield><subfield code="z">lizenzpflichtig</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_USEFLAG_A</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">SYSFLAG_A</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_OLC</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">SSG-OLC-HSW</subfield></datafield><datafield tag="951" ind1=" " ind2=" "><subfield code="a">AR</subfield></datafield><datafield tag="952" ind1=" " ind2=" "><subfield code="d">62</subfield><subfield code="j">2021</subfield><subfield code="e">8</subfield><subfield code="b">10</subfield><subfield code="c">04</subfield><subfield code="h">1248-1275</subfield></datafield></record></collection>
|
score |
7.3995867 |