Automatically Detecting Image-Text Mismatch on Instagram with Deep Learning

Cited 15 time in webofscience Cited 8 time in scopus
  • Hit : 229
  • Download : 331
DC FieldValueLanguage
dc.contributor.authorHa, Yuiko
dc.contributor.authorPark, Kunwooko
dc.contributor.authorKim, Su Jungko
dc.contributor.authorJoo, Jungseockko
dc.contributor.authorCha, Meeyoungko
dc.date.accessioned2021-03-04T06:50:32Z-
dc.date.available2021-03-04T06:50:32Z-
dc.date.created2021-01-27-
dc.date.issued2020-11-
dc.identifier.citationJOURNAL OF ADVERTISING, v.50, no.1, pp.52 - 62-
dc.identifier.issn0091-3367-
dc.identifier.urihttp://hdl.handle.net/10203/281209-
dc.description.abstractVisual social media have emerged as an essential brand communication channel for advertisers and brands. The active use of hashtags has enabled advertisers to identify customers interested in their brands and better understand their consumers. However, some users post brand-incongruent content-for example, posts composed of brand-irrelevant images with brand-relevant hashtags. Such visual information mismatch can be problematic because it hinders other consumers' information search processes and advertisers' insight generation from consumer-initiated social media data. This study aims to characterize visually mismatched content in brand-related posts on Instagram and builds a visual information mismatch detection model using computer vision. We propose a machine-learning model based on three cues: image, text, and metadata. Our analysis shows the effectiveness of deep learning and the importance of combining text and image features for mismatch detection. We discuss the advantages of machine-learning methods as a novel research tool for advertising research and conclude with implications of our findings.-
dc.languageEnglish-
dc.publisherROUTLEDGE JOURNALS, TAYLOR & FRANCIS LTD-
dc.titleAutomatically Detecting Image-Text Mismatch on Instagram with Deep Learning-
dc.typeArticle-
dc.identifier.wosid000606931200001-
dc.identifier.scopusid2-s2.0-85099369194-
dc.type.rimsART-
dc.citation.volume50-
dc.citation.issue1-
dc.citation.beginningpage52-
dc.citation.endingpage62-
dc.citation.publicationnameJOURNAL OF ADVERTISING-
dc.identifier.doi10.1080/00913367.2020.1843091-
dc.contributor.localauthorCha, Meeyoung-
dc.contributor.nonIdAuthorHa, Yui-
dc.contributor.nonIdAuthorPark, Kunwoo-
dc.contributor.nonIdAuthorKim, Su Jung-
dc.contributor.nonIdAuthorJoo, Jungseock-
dc.description.isOpenAccessY-
dc.type.journalArticleArticle-
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 15 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0