Downloadable papers on visual language research

This page features downloadable academic papers on visual language research. Also, see my introductory writings for more accessible writing for laypeople, and the Visual Linguist blog for more casual and exploratory writing, along with updates about ongoing research. For more detailed information about visual language and its study, check out my book, The Visual Language of Comics.


  • PDF – open pdfs in new window.
  • NEW – indicates recently added papers.
  • *** – recommended introductory papers.

Papers are organized by their major topics.


Visual Language Theory


BookshelfThe theory of visual language covers a wide range of topics, just like the study of spoken or signed languages. These papers discuss the broader relationship between visual language, comics, and lingusitics.


    ***Cohn, Neil. 2012. Comics, linguistics, and visual language: The past and future of a field. In Bramlett, Frank (ed). Linguistics and the Study of Comics. New York: Palgrave Macmillan. (PDF)


    Cohn, Neil. 2005. Un-defining "comics." International Journal of Comic Art. 7(2): 236-248. (PDF)



Visual Narrative Grammar


My main project in visual langauge research has always been exploring how sequences of images create meaning in the mind and brain. I am primarily interested in how such competence is structured, the nature of its neurocognitive comprehension, and how that system relates to other cognitive domains like verbal discourse and narrative, event structure, and even musical cognition.

    NEW Cohn, Neil. 2014. The architecture of visual narrative comprehension: the interaction of narrative structure and page layout in understanding comics. Frontiers in Psychology. 5:680 (PDF)


    Cohn, Neil, and Martin Paczynski. 2013. Prediction, events, and the advantage of Agents: The processing of semantic roles in visual narrative. Cognitive Psychology. 67 (3):73-97. (PDF)


    *** Cohn, Neil. 2013. Visual narrative structure. Cognitive Science 37(3): 413-452. (PDF)


    Cohn, Neil, Martin Paczynski, Ray Jackendoff, Phillip Holcomb, and Gina Kuperberg. 2012. (Pea)nuts and bolts of visual narrative: Structure and meaning in sequential image comprehension. Cognitive Psychology 65(1): 1-38. (PDF, Poster version)

     

    Cohn, Neil. 2010. The limits of time and transitions: Challenges to theories of sequential image comprehension. Studies in Comics 1(1): 127-147. (PDF)


    Cohn, Neil. 2007. A visual lexicon. Public Journal of Semiotics. 1(1): 35-56. (PDF)



Cognition of Drawing


These papers discuss the cognition of drawing: how we create meaning by making graphic marks. They explore how drawing is structured in the mind/brain, how this ability is developed, and the effect of culture on these abilities.


    NEW Cohn, Neil. 2014. Framing “I can’t draw”: The influence of cultural frames on the development of drawing. Culture & Psychology. 20(1): 102-117. (PDF)


    ***Cohn, Neil. 2012. Explaining "I can't draw": Parallels between the structure and development of language and drawing. Human Development 55(4): 167-192. (PDF)



Cross-Cultural comparison


Just like spoken languages differ across the world, visual languages differ between cultures. These papers discuss the differences between different visual languages of the world, particularly Japanese Visual Language (found in manga), and different dialects of American Visual Language.


    Cross-Cultural

    Cohn, Neil, Amaro Taylor-Weiner, and Suzanne Grossman. 2012. Framing attention in Japanese and American comics: Cross-cultural differences in attentional structure. Frontiers in Cultural Psychology. 3: 1-12. (PDF)


    Cohn, Neil. 2011. A different kind of cultural frame: An analysis of panels in American comics and Japanese manga. Image [&] Narrative 12 (1): 120-134. (PDF)


    ***Cohn, Neil. 2010. Japanese Visual Language: The structure of manga. In Manga: An Anthology of Global and Cultural Perspectives, edited by T. Johnson-Woods. New York: Continuum Books. (PDF)



Other


These papers cover other aspects of visual language structure and comprehension.


    NEW Cohn, Neil. 2013. Beyond speech balloons and thought bubbles: The integration of text and image. Semiotica. 2013(197): 35-63. (PDF)


    Cohn, Neil. 2013. Navigating comics: An empirical and theoretical approach to strategies of reading comic page layouts. Frontiers in Cognitive Science. 4: 1-15. (PDF)


    Cohn, Neil. 2010. Extra! Extra! Semantics in comics!: The conceptual structure of Chicago Tribune advertisements. Journal of Pragmatics 42 (11): 3138–3146. (PDF)