Class-Balanced Modulation for Facial Expression Recognition
Facial expression recognition (FER) aims at determining the types of facial expressions for given facial images, which has a broad application prospect in psychological diagnosis, human-computer interaction, etc. In practical tasks, various databases tend to have imbalanced data distributions among...
Ausführliche Beschreibung
Autor*in: |
LIU Chengguang, WANG Shanmin, LIU Qingshan [verfasserIn] |
---|
Format: |
E-Artikel |
---|---|
Sprache: |
Chinesisch |
Erschienen: |
2023 |
---|
Schlagwörter: |
---|
Übergeordnetes Werk: |
In: Jisuanji kexue yu tansuo - Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press, 2021, 17(2023), 12, Seite 3029-3038 |
---|---|
Übergeordnetes Werk: |
volume:17 ; year:2023 ; number:12 ; pages:3029-3038 |
Links: |
---|
DOI / URN: |
10.3778/j.issn.1673-9418.2210079 |
---|
Katalog-ID: |
DOAJ100126871 |
---|
LEADER | 01000naa a22002652 4500 | ||
---|---|---|---|
001 | DOAJ100126871 | ||
003 | DE-627 | ||
005 | 20240414065718.0 | ||
007 | cr uuu---uuuuu | ||
008 | 240414s2023 xx |||||o 00| ||chi c | ||
024 | 7 | |a 10.3778/j.issn.1673-9418.2210079 |2 doi | |
035 | |a (DE-627)DOAJ100126871 | ||
035 | |a (DE-599)DOAJ0fe63b7e717446a8ae88d703f9d85364 | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a chi | ||
050 | 0 | |a QA75.5-76.95 | |
100 | 0 | |a LIU Chengguang, WANG Shanmin, LIU Qingshan |e verfasserin |4 aut | |
245 | 1 | 0 | |a Class-Balanced Modulation for Facial Expression Recognition |
264 | 1 | |c 2023 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a Computermedien |b c |2 rdamedia | ||
338 | |a Online-Ressource |b cr |2 rdacarrier | ||
520 | |a Facial expression recognition (FER) aims at determining the types of facial expressions for given facial images, which has a broad application prospect in psychological diagnosis, human-computer interaction, etc. In practical tasks, various databases tend to have imbalanced data distributions among basic facial expressions. Such an issue has caused imbalanced feature distribution and inconsistent classifier optimization for various facial expressions, seriously affecting the performance of expression recognition models. To solve this issue, this paper proposes a class-balanced modulation mechanism for facial expression recognition (CBM-Net), which attempts to address the imbalanced data distribution problem by modulating the FER model in feature learning and classifier optimization stages. CBM-Net includes two modules of feature modulation and gradient modulation. The feature modulation module struggles to balance feature distributions for all facial expressions by increasing the separability between classes and the tightness within classes in the feature direction. The gradient modulation module uses the statistical information of batch training samples to reversely adjust the optimization gradient of each classifier to ensure that the convergence speed of each classifier is consistent, so that the performance of each classifier can be optimal at the same time. Qualitative and quantitative experiments on four popular datasets show that CBM-Net is effective in class-balanced modulation, and its effect is quite good compared with many advanced methods. | ||
650 | 4 | |a facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation | |
653 | 0 | |a Electronic computers. Computer science | |
773 | 0 | 8 | |i In |t Jisuanji kexue yu tansuo |d Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press, 2021 |g 17(2023), 12, Seite 3029-3038 |w (DE-627)DOAJ078619211 |x 16739418 |7 nnns |
773 | 1 | 8 | |g volume:17 |g year:2023 |g number:12 |g pages:3029-3038 |
856 | 4 | 0 | |u https://doi.org/10.3778/j.issn.1673-9418.2210079 |z kostenfrei |
856 | 4 | 0 | |u https://doaj.org/article/0fe63b7e717446a8ae88d703f9d85364 |z kostenfrei |
856 | 4 | 0 | |u http://fcst.ceaj.org/fileup/1673-9418/PDF/2210079.pdf |z kostenfrei |
856 | 4 | 2 | |u https://doaj.org/toc/1673-9418 |y Journal toc |z kostenfrei |
912 | |a GBV_USEFLAG_A | ||
912 | |a SYSFLAG_A | ||
912 | |a GBV_DOAJ | ||
951 | |a AR | ||
952 | |d 17 |j 2023 |e 12 |h 3029-3038 |
author_variant |
c w s l q l cwslq cwslql |
---|---|
matchkey_str |
article:16739418:2023----::lsblnemdltofrailxrs |
hierarchy_sort_str |
2023 |
callnumber-subject-code |
QA |
publishDate |
2023 |
allfields |
10.3778/j.issn.1673-9418.2210079 doi (DE-627)DOAJ100126871 (DE-599)DOAJ0fe63b7e717446a8ae88d703f9d85364 DE-627 ger DE-627 rakwb chi QA75.5-76.95 LIU Chengguang, WANG Shanmin, LIU Qingshan verfasserin aut Class-Balanced Modulation for Facial Expression Recognition 2023 Text txt rdacontent Computermedien c rdamedia Online-Ressource cr rdacarrier Facial expression recognition (FER) aims at determining the types of facial expressions for given facial images, which has a broad application prospect in psychological diagnosis, human-computer interaction, etc. In practical tasks, various databases tend to have imbalanced data distributions among basic facial expressions. Such an issue has caused imbalanced feature distribution and inconsistent classifier optimization for various facial expressions, seriously affecting the performance of expression recognition models. To solve this issue, this paper proposes a class-balanced modulation mechanism for facial expression recognition (CBM-Net), which attempts to address the imbalanced data distribution problem by modulating the FER model in feature learning and classifier optimization stages. CBM-Net includes two modules of feature modulation and gradient modulation. The feature modulation module struggles to balance feature distributions for all facial expressions by increasing the separability between classes and the tightness within classes in the feature direction. The gradient modulation module uses the statistical information of batch training samples to reversely adjust the optimization gradient of each classifier to ensure that the convergence speed of each classifier is consistent, so that the performance of each classifier can be optimal at the same time. Qualitative and quantitative experiments on four popular datasets show that CBM-Net is effective in class-balanced modulation, and its effect is quite good compared with many advanced methods. facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation Electronic computers. Computer science In Jisuanji kexue yu tansuo Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press, 2021 17(2023), 12, Seite 3029-3038 (DE-627)DOAJ078619211 16739418 nnns volume:17 year:2023 number:12 pages:3029-3038 https://doi.org/10.3778/j.issn.1673-9418.2210079 kostenfrei https://doaj.org/article/0fe63b7e717446a8ae88d703f9d85364 kostenfrei http://fcst.ceaj.org/fileup/1673-9418/PDF/2210079.pdf kostenfrei https://doaj.org/toc/1673-9418 Journal toc kostenfrei GBV_USEFLAG_A SYSFLAG_A GBV_DOAJ AR 17 2023 12 3029-3038 |
spelling |
10.3778/j.issn.1673-9418.2210079 doi (DE-627)DOAJ100126871 (DE-599)DOAJ0fe63b7e717446a8ae88d703f9d85364 DE-627 ger DE-627 rakwb chi QA75.5-76.95 LIU Chengguang, WANG Shanmin, LIU Qingshan verfasserin aut Class-Balanced Modulation for Facial Expression Recognition 2023 Text txt rdacontent Computermedien c rdamedia Online-Ressource cr rdacarrier Facial expression recognition (FER) aims at determining the types of facial expressions for given facial images, which has a broad application prospect in psychological diagnosis, human-computer interaction, etc. In practical tasks, various databases tend to have imbalanced data distributions among basic facial expressions. Such an issue has caused imbalanced feature distribution and inconsistent classifier optimization for various facial expressions, seriously affecting the performance of expression recognition models. To solve this issue, this paper proposes a class-balanced modulation mechanism for facial expression recognition (CBM-Net), which attempts to address the imbalanced data distribution problem by modulating the FER model in feature learning and classifier optimization stages. CBM-Net includes two modules of feature modulation and gradient modulation. The feature modulation module struggles to balance feature distributions for all facial expressions by increasing the separability between classes and the tightness within classes in the feature direction. The gradient modulation module uses the statistical information of batch training samples to reversely adjust the optimization gradient of each classifier to ensure that the convergence speed of each classifier is consistent, so that the performance of each classifier can be optimal at the same time. Qualitative and quantitative experiments on four popular datasets show that CBM-Net is effective in class-balanced modulation, and its effect is quite good compared with many advanced methods. facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation Electronic computers. Computer science In Jisuanji kexue yu tansuo Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press, 2021 17(2023), 12, Seite 3029-3038 (DE-627)DOAJ078619211 16739418 nnns volume:17 year:2023 number:12 pages:3029-3038 https://doi.org/10.3778/j.issn.1673-9418.2210079 kostenfrei https://doaj.org/article/0fe63b7e717446a8ae88d703f9d85364 kostenfrei http://fcst.ceaj.org/fileup/1673-9418/PDF/2210079.pdf kostenfrei https://doaj.org/toc/1673-9418 Journal toc kostenfrei GBV_USEFLAG_A SYSFLAG_A GBV_DOAJ AR 17 2023 12 3029-3038 |
allfields_unstemmed |
10.3778/j.issn.1673-9418.2210079 doi (DE-627)DOAJ100126871 (DE-599)DOAJ0fe63b7e717446a8ae88d703f9d85364 DE-627 ger DE-627 rakwb chi QA75.5-76.95 LIU Chengguang, WANG Shanmin, LIU Qingshan verfasserin aut Class-Balanced Modulation for Facial Expression Recognition 2023 Text txt rdacontent Computermedien c rdamedia Online-Ressource cr rdacarrier Facial expression recognition (FER) aims at determining the types of facial expressions for given facial images, which has a broad application prospect in psychological diagnosis, human-computer interaction, etc. In practical tasks, various databases tend to have imbalanced data distributions among basic facial expressions. Such an issue has caused imbalanced feature distribution and inconsistent classifier optimization for various facial expressions, seriously affecting the performance of expression recognition models. To solve this issue, this paper proposes a class-balanced modulation mechanism for facial expression recognition (CBM-Net), which attempts to address the imbalanced data distribution problem by modulating the FER model in feature learning and classifier optimization stages. CBM-Net includes two modules of feature modulation and gradient modulation. The feature modulation module struggles to balance feature distributions for all facial expressions by increasing the separability between classes and the tightness within classes in the feature direction. The gradient modulation module uses the statistical information of batch training samples to reversely adjust the optimization gradient of each classifier to ensure that the convergence speed of each classifier is consistent, so that the performance of each classifier can be optimal at the same time. Qualitative and quantitative experiments on four popular datasets show that CBM-Net is effective in class-balanced modulation, and its effect is quite good compared with many advanced methods. facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation Electronic computers. Computer science In Jisuanji kexue yu tansuo Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press, 2021 17(2023), 12, Seite 3029-3038 (DE-627)DOAJ078619211 16739418 nnns volume:17 year:2023 number:12 pages:3029-3038 https://doi.org/10.3778/j.issn.1673-9418.2210079 kostenfrei https://doaj.org/article/0fe63b7e717446a8ae88d703f9d85364 kostenfrei http://fcst.ceaj.org/fileup/1673-9418/PDF/2210079.pdf kostenfrei https://doaj.org/toc/1673-9418 Journal toc kostenfrei GBV_USEFLAG_A SYSFLAG_A GBV_DOAJ AR 17 2023 12 3029-3038 |
allfieldsGer |
10.3778/j.issn.1673-9418.2210079 doi (DE-627)DOAJ100126871 (DE-599)DOAJ0fe63b7e717446a8ae88d703f9d85364 DE-627 ger DE-627 rakwb chi QA75.5-76.95 LIU Chengguang, WANG Shanmin, LIU Qingshan verfasserin aut Class-Balanced Modulation for Facial Expression Recognition 2023 Text txt rdacontent Computermedien c rdamedia Online-Ressource cr rdacarrier Facial expression recognition (FER) aims at determining the types of facial expressions for given facial images, which has a broad application prospect in psychological diagnosis, human-computer interaction, etc. In practical tasks, various databases tend to have imbalanced data distributions among basic facial expressions. Such an issue has caused imbalanced feature distribution and inconsistent classifier optimization for various facial expressions, seriously affecting the performance of expression recognition models. To solve this issue, this paper proposes a class-balanced modulation mechanism for facial expression recognition (CBM-Net), which attempts to address the imbalanced data distribution problem by modulating the FER model in feature learning and classifier optimization stages. CBM-Net includes two modules of feature modulation and gradient modulation. The feature modulation module struggles to balance feature distributions for all facial expressions by increasing the separability between classes and the tightness within classes in the feature direction. The gradient modulation module uses the statistical information of batch training samples to reversely adjust the optimization gradient of each classifier to ensure that the convergence speed of each classifier is consistent, so that the performance of each classifier can be optimal at the same time. Qualitative and quantitative experiments on four popular datasets show that CBM-Net is effective in class-balanced modulation, and its effect is quite good compared with many advanced methods. facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation Electronic computers. Computer science In Jisuanji kexue yu tansuo Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press, 2021 17(2023), 12, Seite 3029-3038 (DE-627)DOAJ078619211 16739418 nnns volume:17 year:2023 number:12 pages:3029-3038 https://doi.org/10.3778/j.issn.1673-9418.2210079 kostenfrei https://doaj.org/article/0fe63b7e717446a8ae88d703f9d85364 kostenfrei http://fcst.ceaj.org/fileup/1673-9418/PDF/2210079.pdf kostenfrei https://doaj.org/toc/1673-9418 Journal toc kostenfrei GBV_USEFLAG_A SYSFLAG_A GBV_DOAJ AR 17 2023 12 3029-3038 |
allfieldsSound |
10.3778/j.issn.1673-9418.2210079 doi (DE-627)DOAJ100126871 (DE-599)DOAJ0fe63b7e717446a8ae88d703f9d85364 DE-627 ger DE-627 rakwb chi QA75.5-76.95 LIU Chengguang, WANG Shanmin, LIU Qingshan verfasserin aut Class-Balanced Modulation for Facial Expression Recognition 2023 Text txt rdacontent Computermedien c rdamedia Online-Ressource cr rdacarrier Facial expression recognition (FER) aims at determining the types of facial expressions for given facial images, which has a broad application prospect in psychological diagnosis, human-computer interaction, etc. In practical tasks, various databases tend to have imbalanced data distributions among basic facial expressions. Such an issue has caused imbalanced feature distribution and inconsistent classifier optimization for various facial expressions, seriously affecting the performance of expression recognition models. To solve this issue, this paper proposes a class-balanced modulation mechanism for facial expression recognition (CBM-Net), which attempts to address the imbalanced data distribution problem by modulating the FER model in feature learning and classifier optimization stages. CBM-Net includes two modules of feature modulation and gradient modulation. The feature modulation module struggles to balance feature distributions for all facial expressions by increasing the separability between classes and the tightness within classes in the feature direction. The gradient modulation module uses the statistical information of batch training samples to reversely adjust the optimization gradient of each classifier to ensure that the convergence speed of each classifier is consistent, so that the performance of each classifier can be optimal at the same time. Qualitative and quantitative experiments on four popular datasets show that CBM-Net is effective in class-balanced modulation, and its effect is quite good compared with many advanced methods. facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation Electronic computers. Computer science In Jisuanji kexue yu tansuo Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press, 2021 17(2023), 12, Seite 3029-3038 (DE-627)DOAJ078619211 16739418 nnns volume:17 year:2023 number:12 pages:3029-3038 https://doi.org/10.3778/j.issn.1673-9418.2210079 kostenfrei https://doaj.org/article/0fe63b7e717446a8ae88d703f9d85364 kostenfrei http://fcst.ceaj.org/fileup/1673-9418/PDF/2210079.pdf kostenfrei https://doaj.org/toc/1673-9418 Journal toc kostenfrei GBV_USEFLAG_A SYSFLAG_A GBV_DOAJ AR 17 2023 12 3029-3038 |
language |
Chinese |
source |
In Jisuanji kexue yu tansuo 17(2023), 12, Seite 3029-3038 volume:17 year:2023 number:12 pages:3029-3038 |
sourceStr |
In Jisuanji kexue yu tansuo 17(2023), 12, Seite 3029-3038 volume:17 year:2023 number:12 pages:3029-3038 |
format_phy_str_mv |
Article |
institution |
findex.gbv.de |
topic_facet |
facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation Electronic computers. Computer science |
isfreeaccess_bool |
true |
container_title |
Jisuanji kexue yu tansuo |
authorswithroles_txt_mv |
LIU Chengguang, WANG Shanmin, LIU Qingshan @@aut@@ |
publishDateDaySort_date |
2023-01-01T00:00:00Z |
hierarchy_top_id |
DOAJ078619211 |
id |
DOAJ100126871 |
language_de |
chinesisch |
fullrecord |
<?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01000naa a22002652 4500</leader><controlfield tag="001">DOAJ100126871</controlfield><controlfield tag="003">DE-627</controlfield><controlfield tag="005">20240414065718.0</controlfield><controlfield tag="007">cr uuu---uuuuu</controlfield><controlfield tag="008">240414s2023 xx |||||o 00| ||chi c</controlfield><datafield tag="024" ind1="7" ind2=" "><subfield code="a">10.3778/j.issn.1673-9418.2210079</subfield><subfield code="2">doi</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-627)DOAJ100126871</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)DOAJ0fe63b7e717446a8ae88d703f9d85364</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-627</subfield><subfield code="b">ger</subfield><subfield code="c">DE-627</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1=" " ind2=" "><subfield code="a">chi</subfield></datafield><datafield tag="050" ind1=" " ind2="0"><subfield code="a">QA75.5-76.95</subfield></datafield><datafield tag="100" ind1="0" ind2=" "><subfield code="a">LIU Chengguang, WANG Shanmin, LIU Qingshan</subfield><subfield code="e">verfasserin</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Class-Balanced Modulation for Facial Expression Recognition</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="c">2023</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="a">Text</subfield><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="a">Computermedien</subfield><subfield code="b">c</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="a">Online-Ressource</subfield><subfield code="b">cr</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">Facial expression recognition (FER) aims at determining the types of facial expressions for given facial images, which has a broad application prospect in psychological diagnosis, human-computer interaction, etc. In practical tasks, various databases tend to have imbalanced data distributions among basic facial expressions. Such an issue has caused imbalanced feature distribution and inconsistent classifier optimization for various facial expressions, seriously affecting the performance of expression recognition models. To solve this issue, this paper proposes a class-balanced modulation mechanism for facial expression recognition (CBM-Net), which attempts to address the imbalanced data distribution problem by modulating the FER model in feature learning and classifier optimization stages. CBM-Net includes two modules of feature modulation and gradient modulation. The feature modulation module struggles to balance feature distributions for all facial expressions by increasing the separability between classes and the tightness within classes in the feature direction. The gradient modulation module uses the statistical information of batch training samples to reversely adjust the optimization gradient of each classifier to ensure that the convergence speed of each classifier is consistent, so that the performance of each classifier can be optimal at the same time. Qualitative and quantitative experiments on four popular datasets show that CBM-Net is effective in class-balanced modulation, and its effect is quite good compared with many advanced methods.</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation</subfield></datafield><datafield tag="653" ind1=" " ind2="0"><subfield code="a">Electronic computers. Computer science</subfield></datafield><datafield tag="773" ind1="0" ind2="8"><subfield code="i">In</subfield><subfield code="t">Jisuanji kexue yu tansuo</subfield><subfield code="d">Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press, 2021</subfield><subfield code="g">17(2023), 12, Seite 3029-3038</subfield><subfield code="w">(DE-627)DOAJ078619211</subfield><subfield code="x">16739418</subfield><subfield code="7">nnns</subfield></datafield><datafield tag="773" ind1="1" ind2="8"><subfield code="g">volume:17</subfield><subfield code="g">year:2023</subfield><subfield code="g">number:12</subfield><subfield code="g">pages:3029-3038</subfield></datafield><datafield tag="856" ind1="4" ind2="0"><subfield code="u">https://doi.org/10.3778/j.issn.1673-9418.2210079</subfield><subfield code="z">kostenfrei</subfield></datafield><datafield tag="856" ind1="4" ind2="0"><subfield code="u">https://doaj.org/article/0fe63b7e717446a8ae88d703f9d85364</subfield><subfield code="z">kostenfrei</subfield></datafield><datafield tag="856" ind1="4" ind2="0"><subfield code="u">http://fcst.ceaj.org/fileup/1673-9418/PDF/2210079.pdf</subfield><subfield code="z">kostenfrei</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="u">https://doaj.org/toc/1673-9418</subfield><subfield code="y">Journal toc</subfield><subfield code="z">kostenfrei</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_USEFLAG_A</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">SYSFLAG_A</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_DOAJ</subfield></datafield><datafield tag="951" ind1=" " ind2=" "><subfield code="a">AR</subfield></datafield><datafield tag="952" ind1=" " ind2=" "><subfield code="d">17</subfield><subfield code="j">2023</subfield><subfield code="e">12</subfield><subfield code="h">3029-3038</subfield></datafield></record></collection>
|
callnumber-first |
Q - Science |
author |
LIU Chengguang, WANG Shanmin, LIU Qingshan |
spellingShingle |
LIU Chengguang, WANG Shanmin, LIU Qingshan misc QA75.5-76.95 misc facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation misc Electronic computers. Computer science Class-Balanced Modulation for Facial Expression Recognition |
authorStr |
LIU Chengguang, WANG Shanmin, LIU Qingshan |
ppnlink_with_tag_str_mv |
@@773@@(DE-627)DOAJ078619211 |
format |
electronic Article |
delete_txt_mv |
keep |
author_role |
aut |
collection |
DOAJ |
remote_str |
true |
callnumber-label |
QA75 |
illustrated |
Not Illustrated |
issn |
16739418 |
topic_title |
QA75.5-76.95 Class-Balanced Modulation for Facial Expression Recognition facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation |
topic |
misc QA75.5-76.95 misc facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation misc Electronic computers. Computer science |
topic_unstemmed |
misc QA75.5-76.95 misc facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation misc Electronic computers. Computer science |
topic_browse |
misc QA75.5-76.95 misc facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation misc Electronic computers. Computer science |
format_facet |
Elektronische Aufsätze Aufsätze Elektronische Ressource |
format_main_str_mv |
Text Zeitschrift/Artikel |
carriertype_str_mv |
cr |
hierarchy_parent_title |
Jisuanji kexue yu tansuo |
hierarchy_parent_id |
DOAJ078619211 |
hierarchy_top_title |
Jisuanji kexue yu tansuo |
isfreeaccess_txt |
true |
familylinks_str_mv |
(DE-627)DOAJ078619211 |
title |
Class-Balanced Modulation for Facial Expression Recognition |
ctrlnum |
(DE-627)DOAJ100126871 (DE-599)DOAJ0fe63b7e717446a8ae88d703f9d85364 |
title_full |
Class-Balanced Modulation for Facial Expression Recognition |
author_sort |
LIU Chengguang, WANG Shanmin, LIU Qingshan |
journal |
Jisuanji kexue yu tansuo |
journalStr |
Jisuanji kexue yu tansuo |
callnumber-first-code |
Q |
lang_code |
chi |
isOA_bool |
true |
recordtype |
marc |
publishDateSort |
2023 |
contenttype_str_mv |
txt |
container_start_page |
3029 |
author_browse |
LIU Chengguang, WANG Shanmin, LIU Qingshan |
container_volume |
17 |
class |
QA75.5-76.95 |
format_se |
Elektronische Aufsätze |
author-letter |
LIU Chengguang, WANG Shanmin, LIU Qingshan |
doi_str_mv |
10.3778/j.issn.1673-9418.2210079 |
title_sort |
class-balanced modulation for facial expression recognition |
callnumber |
QA75.5-76.95 |
title_auth |
Class-Balanced Modulation for Facial Expression Recognition |
abstract |
Facial expression recognition (FER) aims at determining the types of facial expressions for given facial images, which has a broad application prospect in psychological diagnosis, human-computer interaction, etc. In practical tasks, various databases tend to have imbalanced data distributions among basic facial expressions. Such an issue has caused imbalanced feature distribution and inconsistent classifier optimization for various facial expressions, seriously affecting the performance of expression recognition models. To solve this issue, this paper proposes a class-balanced modulation mechanism for facial expression recognition (CBM-Net), which attempts to address the imbalanced data distribution problem by modulating the FER model in feature learning and classifier optimization stages. CBM-Net includes two modules of feature modulation and gradient modulation. The feature modulation module struggles to balance feature distributions for all facial expressions by increasing the separability between classes and the tightness within classes in the feature direction. The gradient modulation module uses the statistical information of batch training samples to reversely adjust the optimization gradient of each classifier to ensure that the convergence speed of each classifier is consistent, so that the performance of each classifier can be optimal at the same time. Qualitative and quantitative experiments on four popular datasets show that CBM-Net is effective in class-balanced modulation, and its effect is quite good compared with many advanced methods. |
abstractGer |
Facial expression recognition (FER) aims at determining the types of facial expressions for given facial images, which has a broad application prospect in psychological diagnosis, human-computer interaction, etc. In practical tasks, various databases tend to have imbalanced data distributions among basic facial expressions. Such an issue has caused imbalanced feature distribution and inconsistent classifier optimization for various facial expressions, seriously affecting the performance of expression recognition models. To solve this issue, this paper proposes a class-balanced modulation mechanism for facial expression recognition (CBM-Net), which attempts to address the imbalanced data distribution problem by modulating the FER model in feature learning and classifier optimization stages. CBM-Net includes two modules of feature modulation and gradient modulation. The feature modulation module struggles to balance feature distributions for all facial expressions by increasing the separability between classes and the tightness within classes in the feature direction. The gradient modulation module uses the statistical information of batch training samples to reversely adjust the optimization gradient of each classifier to ensure that the convergence speed of each classifier is consistent, so that the performance of each classifier can be optimal at the same time. Qualitative and quantitative experiments on four popular datasets show that CBM-Net is effective in class-balanced modulation, and its effect is quite good compared with many advanced methods. |
abstract_unstemmed |
Facial expression recognition (FER) aims at determining the types of facial expressions for given facial images, which has a broad application prospect in psychological diagnosis, human-computer interaction, etc. In practical tasks, various databases tend to have imbalanced data distributions among basic facial expressions. Such an issue has caused imbalanced feature distribution and inconsistent classifier optimization for various facial expressions, seriously affecting the performance of expression recognition models. To solve this issue, this paper proposes a class-balanced modulation mechanism for facial expression recognition (CBM-Net), which attempts to address the imbalanced data distribution problem by modulating the FER model in feature learning and classifier optimization stages. CBM-Net includes two modules of feature modulation and gradient modulation. The feature modulation module struggles to balance feature distributions for all facial expressions by increasing the separability between classes and the tightness within classes in the feature direction. The gradient modulation module uses the statistical information of batch training samples to reversely adjust the optimization gradient of each classifier to ensure that the convergence speed of each classifier is consistent, so that the performance of each classifier can be optimal at the same time. Qualitative and quantitative experiments on four popular datasets show that CBM-Net is effective in class-balanced modulation, and its effect is quite good compared with many advanced methods. |
collection_details |
GBV_USEFLAG_A SYSFLAG_A GBV_DOAJ |
container_issue |
12 |
title_short |
Class-Balanced Modulation for Facial Expression Recognition |
url |
https://doi.org/10.3778/j.issn.1673-9418.2210079 https://doaj.org/article/0fe63b7e717446a8ae88d703f9d85364 http://fcst.ceaj.org/fileup/1673-9418/PDF/2210079.pdf https://doaj.org/toc/1673-9418 |
remote_bool |
true |
ppnlink |
DOAJ078619211 |
callnumber-subject |
QA - Mathematics |
mediatype_str_mv |
c |
isOA_txt |
true |
hochschulschrift_bool |
false |
doi_str |
10.3778/j.issn.1673-9418.2210079 |
callnumber-a |
QA75.5-76.95 |
up_date |
2024-07-04T01:39:47.658Z |
_version_ |
1803610685607772160 |
fullrecord_marcxml |
<?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01000naa a22002652 4500</leader><controlfield tag="001">DOAJ100126871</controlfield><controlfield tag="003">DE-627</controlfield><controlfield tag="005">20240414065718.0</controlfield><controlfield tag="007">cr uuu---uuuuu</controlfield><controlfield tag="008">240414s2023 xx |||||o 00| ||chi c</controlfield><datafield tag="024" ind1="7" ind2=" "><subfield code="a">10.3778/j.issn.1673-9418.2210079</subfield><subfield code="2">doi</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-627)DOAJ100126871</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)DOAJ0fe63b7e717446a8ae88d703f9d85364</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-627</subfield><subfield code="b">ger</subfield><subfield code="c">DE-627</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1=" " ind2=" "><subfield code="a">chi</subfield></datafield><datafield tag="050" ind1=" " ind2="0"><subfield code="a">QA75.5-76.95</subfield></datafield><datafield tag="100" ind1="0" ind2=" "><subfield code="a">LIU Chengguang, WANG Shanmin, LIU Qingshan</subfield><subfield code="e">verfasserin</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Class-Balanced Modulation for Facial Expression Recognition</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="c">2023</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="a">Text</subfield><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="a">Computermedien</subfield><subfield code="b">c</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="a">Online-Ressource</subfield><subfield code="b">cr</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">Facial expression recognition (FER) aims at determining the types of facial expressions for given facial images, which has a broad application prospect in psychological diagnosis, human-computer interaction, etc. In practical tasks, various databases tend to have imbalanced data distributions among basic facial expressions. Such an issue has caused imbalanced feature distribution and inconsistent classifier optimization for various facial expressions, seriously affecting the performance of expression recognition models. To solve this issue, this paper proposes a class-balanced modulation mechanism for facial expression recognition (CBM-Net), which attempts to address the imbalanced data distribution problem by modulating the FER model in feature learning and classifier optimization stages. CBM-Net includes two modules of feature modulation and gradient modulation. The feature modulation module struggles to balance feature distributions for all facial expressions by increasing the separability between classes and the tightness within classes in the feature direction. The gradient modulation module uses the statistical information of batch training samples to reversely adjust the optimization gradient of each classifier to ensure that the convergence speed of each classifier is consistent, so that the performance of each classifier can be optimal at the same time. Qualitative and quantitative experiments on four popular datasets show that CBM-Net is effective in class-balanced modulation, and its effect is quite good compared with many advanced methods.</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">facial expression recognition (fer); class imbalance; class balance modulation; feature modulation; gradient modulation</subfield></datafield><datafield tag="653" ind1=" " ind2="0"><subfield code="a">Electronic computers. Computer science</subfield></datafield><datafield tag="773" ind1="0" ind2="8"><subfield code="i">In</subfield><subfield code="t">Jisuanji kexue yu tansuo</subfield><subfield code="d">Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press, 2021</subfield><subfield code="g">17(2023), 12, Seite 3029-3038</subfield><subfield code="w">(DE-627)DOAJ078619211</subfield><subfield code="x">16739418</subfield><subfield code="7">nnns</subfield></datafield><datafield tag="773" ind1="1" ind2="8"><subfield code="g">volume:17</subfield><subfield code="g">year:2023</subfield><subfield code="g">number:12</subfield><subfield code="g">pages:3029-3038</subfield></datafield><datafield tag="856" ind1="4" ind2="0"><subfield code="u">https://doi.org/10.3778/j.issn.1673-9418.2210079</subfield><subfield code="z">kostenfrei</subfield></datafield><datafield tag="856" ind1="4" ind2="0"><subfield code="u">https://doaj.org/article/0fe63b7e717446a8ae88d703f9d85364</subfield><subfield code="z">kostenfrei</subfield></datafield><datafield tag="856" ind1="4" ind2="0"><subfield code="u">http://fcst.ceaj.org/fileup/1673-9418/PDF/2210079.pdf</subfield><subfield code="z">kostenfrei</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="u">https://doaj.org/toc/1673-9418</subfield><subfield code="y">Journal toc</subfield><subfield code="z">kostenfrei</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_USEFLAG_A</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">SYSFLAG_A</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">GBV_DOAJ</subfield></datafield><datafield tag="951" ind1=" " ind2=" "><subfield code="a">AR</subfield></datafield><datafield tag="952" ind1=" " ind2=" "><subfield code="d">17</subfield><subfield code="j">2023</subfield><subfield code="e">12</subfield><subfield code="h">3029-3038</subfield></datafield></record></collection>
|
score |
7.401105 |