New paper: Remarks on multimodality

Multimodal Parallel Architecture

I’m really excited to announce that my 2022 is kicking off with a new paper! This one is written with my colleague Joost Schilperoord, Remarks on multimodality: Grammatical interactions in […]

New paper: Listening beyond seeing

Our new paper has just been published in Brain and Language, titled “Listening beyond seeing: Event-related potentials to audiovisual processing in visual narrative.” My collaborator Mirella Manfredi carried out this […]

New paper: A picture is worth more words over time

I’m excited to announce we have another new paper, “A picture is worth more words over time: Multimodality and narrative structure across eight decades of American superhero comics,” now out […]

New paper: When a hit sounds like a kiss

I’m excited to announce that I have new paper out in the journal Brain and Language entitled “When a hit sounds like a kiss: an electrophysiological exploration of semantic processing […]

New paper: Pow, punch, pika, and chu

I’m once again excited to announce the publication of another of my students’ projects. Our paper, “Pow, Punch, Pika, and Chu: The Structure of Sound Effects in Genres of American […]

New Paper: A multimodal parallel architecture

I’m excited to share that I now have a new article in the latest issue of Cognition: “A multimodal parallel architecture: A cognitive framework for multimodal interactions.” This paper presents […]

New book on Australian Sand Narratives

Anyone who has read my new book or followed my work online for the past several years knows that I frequently talk about sand narratives created by Australian Aboriginals as […]

New Paper: Beyond Speech Balloons and Thought Bubbles

I’m pleased to announce that my paper, “Beyond Speech Balloons and Thought Bubbles,” (PDF) has now been published in the journal Semiotica. The paper dissects the ways in which text […]

Revisiting “visual language”

I’ve now had this website for over 10 years, and have been blogging for almost 6 years, so it may be worth revisiting the fundamental ideas of my research over […]

Gestures in comics

A doubleshot of reviews**: Fein, Ofer, & Kasher, Asa (1996). How to do things with words and gestures in comics Journal of Pragmatics, 26 (6), 793-808 DOI: 10.1016/S0378-2166(96)00023-9 This study […]