Effectiveness of the Auditory and Visual effects of Chinese e-Magazine on the Graduate Students’ Reading Process

Authors

  • Bing Zhang Autonomous University of Barcelona
  • Elena Añaños Autonomous University of Barcelona
  • Min Zhang University of Shanghai for Science and Technology

Abstract

We are in a digital society where new technologies are constantly emerging and old technologies are being upgraded faster than we can blink. Digital reading has become an important means of reading, but the visual process for digital and paper reading are different. With eye tracking technique, orthogonal design and regression model, this paper, analyzed audiences’ eye movement when reading Chinese e-magazine under visual and auditory stimulations. An experimental e-magazine was created and 80 graduate students were randomly selected. All participants underwent the same setup but under different stimuli; they had to read short sentences while an eye tracker records their eye movement; after completion, participants answer a comprehension questionnaire. The most important results, analyzed in terms of eye fixations, are that text dubbing and background colors have a significant effect on reading comprehension, which means that with text dubbing and cool colors, it can lead to a better reading comprehension. The findings obtained reveal a better knowledge of the e-magazine reading behavior and it can be applied to the design of digital magazines. However, it is necessary to perform specific cross-cultural studies and to unify the units of measurement of eye tracker and the units of measure of reading effectiveness.

 

Keywords

e-magazines, attention, eye tracker, digital context, reading, multimedia resources

References

AÑAÑOS, E. (2011). “Visual impact and eye fixation of non conventional advertising (NCA) on television among young people and the elderly”. Quaderns del Consell de l'Audiovisual de Catalunya (CAC). Vol. XIV. Issue 2, pp. 77-88.

AÑAÑOS, E.; ASTALS, A. (2013). “¿Imagen o texto? El poder de captar la atención de los elementos gráficos analizado con el Eye Tracker”. Gráfica. Vol. 1. Issue 2. pp. 87-98.

BAKKER, N. (2009). Een literatuuronderzoek naar bet lezen van literaire teksten in een digitaal tijdperk. Amsterdam: Stichting Lezen.

BENNET, S.; MATON, K.; KEVIN, L. (2008). “The ‘digital natives’ debate: A critical review of the evidence”. British Journal of Educational Technology. Vol. 5. Issue 39. pp. 775-786. <http://dx.doi.org/10.1111/j.1467-8535.2007.00793.x>

BRUHN, K. (2010). “The sounds of media: An interdisciplinary review of research of sound as communication”. Comunicar. Vol. XVII. Issue 31. pp. 15-23. <http://dx.doi.org/10.3916/C34-2010-02-01>

CANAVILHAS, J. (2007). Webnoticia: propuesta de modelo periodístico para www. Salamanca: Livros LabCom.

CASSASSUS, B. (2015). Digital sales ‘worth 25% of market by 2015’. [online document]. The Bookseller. [Accessed: 09/10/2015]. <http://www.thebookseller.com/news/digital-sales-worth-25-market-2015.html>

CHEN, D.; SUI X.; WANG, X. [et al.] (2008). “Musical influence on college students reading with eye tracking technique”. Psychological Science. Vol. 2. Issue 31. pp. 385-388.

DE AGUILERA, M.; ADELL, J.E. (2010). “Mediations in the New Digital Landscape. Music and screens”. Comunicar. Vol. XVII. Issue 34. pp. 10-13. <http://dx.doi.org/10.3916/C34-2010-02-03>

DING. J.; WANG. J.; ZHANG, Q. (2005). “Eye tracking study on processing differences on print advertising’s graphics and text”. Psychological Science. Vol. 4. Issue 24. pp. 30-34.

DONALD, D. R. (1979). “Effects of illustrations on early oral reading accuracy, strategies and comprehension”. British Journal of Educational Psychology. Vol. 3. Issue 49. pp. 282-289. <http://dx.doi.org/10.1111/j.2044-8279.1979.tb02427.x>

DONALD, D.R. (1983). “The use and value of illustrations as contextual information for readers at different progress and developmental levels”. British Journal of Educational Psychology. Vol. 2. Issue 53. pp. 175-185. <http://dx.doi.org/10.1111/j.2044-8279.1983.tb02548.x>

GAO, X.-P.; XIN, J. H. (2006), “Investigation of human's emotional responses on colors”. Color Research and Application. Vol 31. Issue 5. Pp. 411–417. <http://dx.doi.org/10.1002/col.20246>

GIFFARD, A. (2009). Des lectures industrielles. Pour en finir avec la décroissance. Paris: Flammarion.

HAN, Y.; REN, G. (2003). “Effective study on math textbook illustration for the first grade with eye tracking technique”. Psychology. Vol. 6. Issue 35. pp. 818-822.

JIANG, B. (2007). “College students’ eye movement studies on column design during reading”. Doctoral dissertation. Nanjing: Nanjing University.

JUST, M. A.; CARPENTER, P.A. (1993). “The intensity dimension of thought: pupillometric indices of sentence processing”. Canadian Journal of Psychology. Vol. 2I. Issue 47. pp. 310. <http://dx.doi.org/10.1037/h0078820>

LANDOW, G. P. (1992). Hypertext: The Convergence of Technology and Contemporary Critical Theory. Baltimore: Johns Hopkins University Press.

LANHAM, R. A. (1993). The Electronic Word: Technology, Democracy, and the Arts. Chicago: University of Chicago Press.

LANHAM, R. A. (1994). The Electronic Word: Democracy, Technology, and the Arts. Chicago: University of Chicago Press. <http://dx.doi.org/10.7208/chicago/9780226469126.001.0001>

MARTINEZ-SALANOVA, E. (2013). “Visual stories: From the entertainment society to the knowledge society”. Comunicar. Vol. XXI. Issue 41. pp. 216-219.

MCLUHAN, M. (1994). Understanding media: The extensions of man. Boston: MIT Press.

MILAJOVIC, A.; KLEUT, J.; NINKOVIC, D. (2013). “Methodological approaches to study on interactivity in communication journals”. Comunicar. Vol. XXI. Issue 41. pp. 93-102. <http://dx.doi.org/10.3916/C41-2013-09>

MINELLI, J.; CAMACHO, M.; GISBERT, M. (2014). “Exploring student and teacher perception of e-textbooks in a primary school”. Comunicar. Vol. XXI. Issue 42. pp. 87-95. <http://dx.doi.org/10.3916/C42-2014-08>

MURPHY, P. K.; LONG, J. F.; HOLLERAN, T. A. [et al.] (2003). “Persuasion online or on paper: a new take on an old issue”. Learning and Instruction. Vol. 13, Issue 5, pp. 511-532. <http://dx.doi.org/10.1016/S0959-4752(02)00041-5>

MURRAY, J.H. (1997). Hamlet on the Holodeck: The Future of Narrative in Cyberspace. Boston: MIT Press.

NELSON, D.L.; CASTANO, D. (1984). “Mental representations for pictures and words: same or different?”. American Journal of Psychology. Vol. 97. Issue 1. pp. 1-15. <http://dx.doi.org/10.2307/1422543>

ORTIZ-CHAVES, L.; MARTINEZ-DE-PISON, E.; CANCELA-LOPEZ-CARRION, G. [et al.]. (2014). “AdWords, images, and banner blindness: an eye-tracking study”. Profesional de la información. Vol. 23. Issue 3. pp. 279-287. <http://dx.doi.org/10.1109/IHCI.2012.6481874>

PAIVIO, A.; CSAPO, K. (1973). “Picture superiority in free recall: Imagery or dual coding?”. Cognitive Psychology. Vol. 2. Issue 5. pp. 176-206. <http://dx.doi.org/10.1016/0010-0285(73)90032-7>

PENG. L. (2010). “Applications of eye tracking methods in the field of journalism and communication”. Journal of International Communication. Issue 12. pp. 97-104.

RAYNER, K. (1998). “Eye movements in reading and information processing: 20 years of research”. Psychological bulletin. Vol. 12. Issue 3. pp. 372. <http://dx.doi.org/10.1037/0033-2909.124.3.372>

ROSCHKE, K.; RADACH, R. (2016). “Perception, Reading, and Digital Media”. In C. CONNOR (Ed.). The Cognitive Development of Reading and Reading Comprehension. New York: Taylor & Francis. pp.33.

ROSS, C.S. (2002). “Reading in a digital age”. In: G.E. GORMAN (ed.). The Digital Factor in Library and Information Services. International Yearbook of Library and Information Management 2002/2003. London: Facet Publishing. pp. 91-111.

ROVIRA, C. (2016). “Bases teóricas y revisión Bibliográfica del estudio de los mapas conceptuales con el seguimiento de la mirada”. El profesional de la información. Vol 25. Issue 1. pp. 59-74. <http://dx.doi.org/10.3145/epi.2016.ene.07>

ROVIRA, C.; CAPDEVILA, J; MARCOS, M. C. (2014). “The importance of sources in the selection of online newspaper articles: a study of Google News using eye-tracking”. Investigación bibliotecnológica. Vol. 28. Issue 63. pp. 15-28.

RUILI, B.; SHISHANGBASHA, L.; YUEDU, L. (2014). “The most popular Chinese digital magazines ranking”. [online document]. [Accessed: 09/10/2015]. <http://read.11185.cn/preview/magazined_32752_2014.html>

SAMUELS, S.J. (1970). “Effects of pictures on learning to read, comprehension and attitudes”. Review of Educational Research. Issue 40. pp. 397-407. <http://dx.doi.org/10.3102/00346543040003397>

SUI, X.; WANG, X.; QIAN, L. (2008). “Eye tracking study on the influence of music on cognitive processes”. Psychological Science. Vol. 4. Issue 31. pp. 960-962.

TERENZI, M.; DI NOCERA, F.; FERLAZZO, F. (2005). “Action, not only semantics. Underlies expected location for Interface elements”. In The 4th Italian Symposium on Human Computer Interaction, Roma, Italy, Springer, pp. 23-27.

THE NIGHTH NATIONAL READING SURVEY. (2012). Chinese Academy of Press and Publication, Issue 4.

VAN DER WEEL, A. (2011). Changing our textual minds: Towards a digital order of knowledge. Manchester: Manchester University Press.

WOLF, M. (2008). Proust and the squid: The story and science of the reading brain. Cambridge: Icon Books.

XU. X. (2011). “Eye tracking study on multimedia reading materials”. Master's thesis, Liaoning Normal University.

YAN, G.; BAI, X. (2000). “Eye tracking studies of Chinese reading”. Advances in Psychological Science. Vol. 3. Issue 8. pp. 19-22.

YU. G.; TANG. X.; SU. L. [et al.] (2007). “Reading Chinese newspapers’ visual trajectory and its laws. An experimental study based on eye tracker”. International Press. Vol. 8. Issue 29. pp. 5-19.

ZHANG, B.; AÑAÑOS, E. (2014). “Study on eye tracking technique: do digital media influence reading comprehension?”. In: J. SIERRA; F. GARCIA-GARCIA (2014). Tecnología y narrativa audiovisual. Madrid: Fragua. pp. 525-540.

ZHANG, X.; YE, W. (2006). “Eye movements index reduce of the current reading studies”. Studies of Psychology and Behavior, Vol. 3. Issue 4. pp. 236-240.

Author Biographies

Bing Zhang, Autonomous University of Barcelona

Department of Journalism and Communication

Elena Añaños, Autonomous University of Barcelona

Department of Advertising, Public Relations and Audiovisual Communication

Min Zhang, University of Shanghai for Science and Technology

Department of Publishing and Art Design

Published

01-06-2016

Downloads

Download data is not yet available.