Research on Digital Media Installations of Emotional Interaction Based on Visual Communication Design
DOI:
https://doi.org/10.53469/jsshl.2024.07(06).20Keywords:
Digital Media Installations, Emotional Interaction, Visual CommunicationAbstract
Many studies have highlighted how digital media installations encourage sensory engagement, fostering emotional connections with audiences. However, scant literature delves into the profound emotions within these installations or whether viewers can extract emotional worth from the visual components. Consequently, this study aims to explore the emotional interaction between digital media installations and viewers and how viewers can derive emotional value from them, based on the perspective of visual communication design. This study encompasses two primary objectives: firstly, analysing digital media installations that can be experienced in person, focusing on the visual elements in the installations to capture emotional interaction and value; secondly, probing the correlation between the level of visual design and the emotional interplay between viewers and the underlying concepts intended by the artist's creation. Data collection employed three techniques, with participants categorized based on artistic and non-artistic backgrounds. Firstly, using cyber ethnography on the Instagram platform, posts and comments related to the target digital media installation of the study were observed to analyse their sentiments towards the corresponding work. Subsequently, 10 local London participants were recruited on WeChat for an on-site experience of the digital media installations, followed by semi-structured interviews conducted by the researcher to explore their assessments of emotional interactions and values elicited by specific visual elements within the installations. Finally, participants engaged in a drawing workshop, providing a more direct avenue to visualize emotions and delve deeper into the emotional value of the digital media installation from the viewer's perspective. The findings reveal that visual elements in digital media installations can help viewers understand the concept of the work and interact emotionally, with generating emotional value depending more on whether the conceptual mood of the work preset by the artist is positive or not. This essay provides a comprehensive literature review concerning the connections among digital media installations, visual communication design components, emotional interactions, and emotional values. In addition, Chapter Three describes three methods of research design and data collection: cyber ethnography, semi-structured interviews and drawing workshops. Chapter Four describes the main research findings while Chapter Five merges these findings with theoretical literature for a critical discussion and analysis. Finally, Chapter Six summarises the main findings, limitations and recommendations for future research.
References
Adrianholme (2023) [Instagram] 1 June, available at: https://www.instagram.com/p/Cs9UtkvoPSk/?img_index=1 (Accessed: 5 August 2023)
Ahmed, S.U. (2018). Interaction and Interactivity: in the Context of Digital Interactive Art Installation. Lecture Notes in Computer Science, pp.241–257. doi: https://doi.org/10.1007/978-3-319-91244-8_20.
Barlow, J. and Maul, D. (2000). Emotional Value. Berrett-Koehler Publishers.
Bergh, Z.C. and Geldenhuys, D. (2013). Psychology in the Work Context. Cape Town: Oxford University Press.
Black, M. (2016). Cyber ethnography: a Critical Tool for the Department of Defense? Comparative Strategy, 35(2), pp.103–113. doi: https://doi.org/10.1080/01495933.2016.1176456.
Boxedin_pictures (2023) [Instagram] 4 August, available at: https://www.instagram.com/p/CvgDMBHI4lG/?img_index=1 (Accessed: 10 August 2023)
Butcher, L., Phau, I. and Teah, M. (2016). Brand Prominence in Luxury consumption: Will Emotional Value Adjudicate Our Longing for status? Journal of Brand Management, 23(6), pp.701–715. doi: https://doi.org/10.1057/s41262-016-0010-8.
Carlton, N.R. (2014). Digital Culture and Art Therapy. The Arts in Psychotherapy, 41(1), pp.41–45. doi: https://doi.org/10.1016/j.aip.2013.11.006.
Chilvers, I. and Oxford (2004). The Oxford Dictionary of Art. Oxford; New York: Oxford University Press.
Chriswilliamsonarchitect (2023) [Instagram] 20 May, available at: https://www.instagram.com/p/CsdGAcKsZL2/?img_index=1(Accessed: 10 August 2023)
Degner, M., Moser, S. and Lewalter, D. (2022). Digital Media in Institutional Informal Learning places: a Systematic Literature Review. Computers and Education Open, 3, p.100068. doi: https://doi.org/10.1016/j.caeo.2021.100068.
Dewdney, A. and Ride, P. (2014). The Digital Media Handbook. London: Routledge.
Dincelli, E. and Yayla, A. (2022). Immersive Virtual Reality in the Age of the Metaverse: a hybrid-narrative Review Based on the Technology Affordance Perspective. The Journal of Strategic Information Systems, 31(2), p.101717. doi :https://doi.org/10.1016/j.jsis.2022.101717.
Edensor, T. (2015). Light Design and Atmosphere. Visual Communication, 14(3), pp.331–350. doi: https://doi.org/10.1177/1470357215579975.
Gameiro, S., de Guevara, B.B., El Refaie, E. and Payson, A. (2018). DrawingOut - an Innovative Drawing Workshop Method to Support the Generation and Dissemination of Research Findings. Plos One, 13(9), p.e0203197. doi: https://doi.org/10.1371/journal.pone.0203197.
Garner, R.L. (2017). Digital Art Therapy: Material, Methods and Applications. London; Philadelphia: Jessica Kingsley Publishers.
Geismar, H. (2021). Museum + Digital =? In: H. Geismar and H. Knox, eds., Digital Anthropology. [online] Routledge. Available at: https://doi.org/10.4324/9781003087885.
Gere, C. (2008). New Media Art and the Gallery in the Digital Age. [online] eprints.lancs.ac.uk. Available at: https://eprints.lancs.ac.uk/id/eprint/55527 [Accessed 15 Jul. 2023].
Gilroy, S.W., Cavazza, M., Rémi Chaignon, Satu-Marja Mäkelä, Niranen, M., André, E., Vogt, T., Urbain, J., Billinghurst, M., Seichter, H. and M. Benayoun (2008). E-Tree: Emotionally Driven Augmented Reality Art. doi: https://doi.org/10.1145/1459359.1459529.
Giulio Jacucci, Spagnolli, A., Alessandro Chalambalakis, Morrison, A., Liikkanen, L.A., S. Roveda and Bertoncini, M. (2009). Bodily Explorations in Space: Social Experience of a Multimodal Art Installation. Lecture Notes in Computer Science, pp.62–75. doi: https://doi.org/10.1007/978-3-642-03658-3_11.
Gong, Y. (2021). Application of Virtual Reality Teaching Method and Artificial Intelligence Technology in Digital Media Art Creation. Ecological Informatics, 63, p.101304. doi: https://doi.org/10.1016/j.ecoinf.2021.101304.
Gu, S., Ye, L., Kong, Y., Huang, J. and Xu, W. (2021). Diversifying Emotional Experience by Layered Interfaces in Affective Interactive Installations. pp.221–230. doi: https://doi.org/10.1007/978-981-16-5983-6_21.
Hockney, D. (2023). Bigger & Closer (Not Smaller & Further Away).
Hornecker, E. and Stifter, M. (2006). Learning from Interactive Museum Installations about Interaction Design for Public Settings. Proceedings of the 20th Conference of the Computer-human Interaction Special Interest Group (CHISIG) of Australia on Computer-human interaction: Design: Activities, Artefacts and Environments - OZCHI ’06. doi: https://doi.org/10.1145/1228175.1228201.
Hu, J., Le, D., Funk, M., Wang, F. and Rauterberg, M. (2013). Attractiveness of an Interactive Public Art Installation. Distributed, Ambient, and Pervasive Interactions, pp.430–438. doi: https://doi.org/10.1007/978-3-642-39351-8_47.
Ilgaleimanis (2023) [Instagram] 21 May, available at: https://www.instagram.com/p/CshLY4EIEx_/?index=1 (Accessed: 15 July 2023)
Jamerson, J.L. (2013). Expressive Remix Therapy: Using Digital Media Art in Therapeutic Group Sessions with Children and Adolescents. Creative Nursing, 19(4), pp.182–188. doi: https://doi.org/10.1891/1078-4535.19.4.182.
Kallio, H., Pietilä, A.-M., Johnson, M. and Kangasniemi, M. (2016). Systematic Methodological review: Developing a Framework for a Qualitative semi-structured Interview Guide. Journal of Advanced Nursing, 72(12), pp.2954–2965. doi: https://doi.org/10.1111/jan.13031.
Kang, X., Chen, W. and Kang, J. (2019). Art in the Age of Social Media: Interaction Behavior Analysis of Instagram Art Accounts. Informatics, 6(4), p.52. doi: https://doi.org/10.3390/informatics6040052.
Katja Kwastek and Dieter Daniels (2015). Aesthetics of Interaction in Digital Art. Cambridge, Massachusetts: The Mit Press.
Kawulich, B.B. (2005). Participant Observation as a Data Collection Method. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, [online] 6(2). doi: https://doi.org/10.17169/fqs-6.2.466.
Kaya, N. and Epps, H.H. (2004). Relationship between Color and emotion: a Study of College Students. College Student Journal, [online] 38(3), pp.396–406. Available at: https://link.gale.com/apps/doc/A123321897/AONE?u=googlescholar&sid=bookmark-AONE&xid=96b09980.
Kelly, N.A. (2010). What is Installation Art?
Leder, H., Gerger, G., Dressler, S.G. and Schabmann, A. (2012). How Art Is Appreciated. PSYCHOLOGY OF AESTHETICS CREATIVITY AND THE ARTS, [online] 6(1), pp.2–10. doi: https://doi.org/10.1037/a0026396.
Lightroom. (2023). David Hockney: Bigger & Closer. [online] Available at: https://lightroom.uk/whats-on/david-hockney/.
Liu, W. (2021). Research on the Application of Multimedia Elements in Visual Communication Art under the Internet Background. Mobile Information Systems, 2021, pp.1–10. doi:https: //doi.org/10.1155/2021/5525648.
Londontheinside and London.travelers (2023) [Instagram] 21 February, available at: https://www.instagram.com/reel/Co7fBfPIVU0/ (Accessed: 10 August 2023)
Madden, T.J., Hewett, K. and Roth, M.S. (2000). Managing Images in Different Cultures: A Cross-National Study of Color Meanings and Preferences. Journal of International Marketing, 8(4), pp.90–107. doi: https://doi.org/10.1509/jimk.8.4.90.19795.
Makransky, G. and Lilleholt, L. (2018). A Structural Equation Modeling Investigation of the Emotional Value of Immersive Virtual Reality in Education. Educational Technology Research and Development, [online] 66(5), pp.1141–1164. doi: https://doi.org/10.1007/s11423-018-9581-2.
McCarthy, J. and Wright, P. (2004). Technology as Experience. Interactions, 11(5), p.42. doi: https://doi.org/10.1145/1015530.1015549.
Melnikovas, A. (2018). Towards an Explicit Research Methodology: Adapting Research Onion Model for Futures Studies. Journal of Futures Studies, [online] 23(2). doi:https: //doi.org/10.6531/JFS.201812_23(2).0003.
Nummenmaa, L., Glerean, E., Hari, R. and Hietanen, J.K. (2013). Bodily Maps of Emotions. Proceedings of the National Academy of Sciences, 111(2), pp.646–651. doi:https: //doi.org/10.1073/pnas.1321664111.
Paul, C. (2023). Digital Art. Thames and Hudson Ltd; Fourth Edition (2 Mar. 2023).
Pelowski, M., Leder, H., Mitschke, V., Specker, E., Gerger, G., Tinio, P.P.L., Vaporova, E., Bieg, T. and Husslein-Arco, A. (2018). Capturing Aesthetic Experiences with Installation Art: An Empirical Assessment of Emotion, Evaluations, and Mobile Eye Tracking in Olafur Eliasson’s ‘Baroque, Baroque!’ Frontiers in Psychology, 9. doi: https://doi.org/10.3389/fpsyg.2018.01255.
Pelowski, M., Specker, E., Gerger, G., Leder, H. and Weingarden, L.S. (2020). Do You Feel like I do? a Study of Spontaneous and Deliberate Emotion Sharing and Understanding between Artists and Perceivers of Installation art. Psychology of Aesthetics, Creativity, and the Arts, 14(3), pp.276–293. doi: https://doi.org/10.1037/aca0000201.
Peppler, K.A. (2010). Media Arts: Arts Education for a Digital Age. Teachers College Record: The Voice of Scholarship in Education, 112(8), pp.2118–2153. doi: https://doi.org/10.1177/016146811011200806.
Plass, J.L. and Kaplan, U. (2016). Emotional Design in Digital Media for Learning. Emotions, Technology, Design, and Learning, pp.131–161. doi: https://doi.org/10.1016/b978-0-12-801856-9.00007-4.
Plutchik, R. (1980). A General Psychoevolutionary Theory of Emotion. Theories of Emotion, 1, pp.3–33. doi: https://doi.org/10.1016/b978-0-12-558701-3.50007-7.
Purkis, H. (2015). Making Contact in an Exhibition zone: Displaying Contemporary Cultural Diversity in Donegal, Ireland, through an Installation of Visual and Material Portraits. Museum and Society, 11(1), pp.50–67. doi: https://doi.org/10.29311/mas.v11i1.222.
Reiss, J. (2001). From Margin to Center: the Spaces of Installation Art. Cambridge (Mass.) ; London: Mit Press, Cop.
Richard.e.grant (2023) [Instagram] 22 February, available at: https://www.instagram.com/reel/Co9yfGTjETD/ (Accessed: 10 August 2023)
Rikke, Ø. and Levinsen, K.T. (2017). Workshops as a Research Methodology. The Electronic Journal of e-Learning, [online] 15(1), pp.70–81. Available at: www.ejel.org [Accessed 6 Aug. 2023].
Rinehart, R. (2007). The Media Art Notation System: Documenting and Preserving Digital/Media Art. Leonardo, [online] 40(2), pp.181–187. Available at: https://www.jstor.org/stable/20206382 [Accessed 21 Jul. 2023].
Saldaña, J. (2013). The Coding Manual for Qualitative Researchers. Los Angeles: Sage.
Sandelowski, M. (2000). Whatever Happened to Qualitative description? Research in Nursing & Health, 23(4), pp.334–340.
Saunders, M.N.K., Thornhill, A. and Lewis, P. (2009). Research Methods for Business Students. Harlow, Essex: Pearson Education Limited.
Schmitt, B. (1999). Experiential Marketing. Journal of Marketing Management, 15(1-3), pp.53–67. doi: https://doi.org/10.1362/026725799784870496.
Scholz, J. and Smith, A.N. (2016). Augmented reality: Designing Immersive Experiences That Maximize Consumer Engagement. Business Horizons, 59(2), pp.149–161. doi: https://doi.org/10.1016/j.bushor.2015.10.003.
Searle, A. (2023). Sarah Sze: the Waiting Room Review - Astonishing Kaleidoscopic Slideshow for the Smartphone Age. The Guardian. [online] 18 May. Available at: https://www.theguardian.com/artanddesign/2023/may/18/sarah-sze-the-waiting-room-review-peckham-rye-station-london.
Sokolowsky, J. (2017). Art in the Instagram age: How Social Media Is Shaping Art and How You Experience It. [online] The Seattle Times. Available at: https://www.seattletimes.com/entertainment/visual-arts/art-in-the-instagram-age-how-social-media-is-shaping-art-and-how-you-experience-it/.
Song, X. and Gu, Y. (2022). Research on Art Design of Digital Media Interactive Installation Based on Green Design. doi: https://doi.org/10.1117/12.2659085.
Stark, J. (2021) [Instagram] 13 November, available at: https://www.instagram.com/reel/CWOxFbWhgao/ (Accessed: 10 August 2023)
Stark, J. (2023). Digital Paint. Available at: https://www.digitalpaint.io/.
Stark, J. (2023) [Instagram] 3 February, available at: https://www.instagram.com/reel/CoLcD98rAfO/ (Accessed: 10 August 2023)
Stark, J. (2023) [Instagram] 15 February, available at: https://www.instagram.com/reel/CosjSnyr5_r/ (Accessed: 10 August 2023)
Suderburg, E. (2008). Space, site, Intervention: Situating Installation Art. Minneapolis: University of Minnesota Press.
Sze, S. (2023). The Waiting Room.
Thinkingmuseum (2023) [Instagram] 9 June, available at: https://www.instagram.com/reel/CudzUK3Irqc/ (Accessed: 10 August 2023)
Underhereyes_fashion (2023) [Instagram] 19 June, available at: https://www.instagram.com/p/CtrUykZoDqo/?img_index=1 (Accessed: 10 August 2023)
Verstand, N. (2017). Aura.
Wands, B. (2007). Art of the Digital Age. London: Thames & Hudson.