Meet the Lab

The Visual Language Lab consists of an international mix of scholars from all levels of scholarship, both at Tilburg University along with external graduate students and postdocs. We also have many collaborators around the world.

Affiliated faculty

Joost Schilperoord Ph.D. has been a professor at Tilburg University since 1999. He studied Communication sciences and Linguistics at Utrecht University, where he wrote a dissertation on the psycholinguistics of written text production. His interests gradually shifted from psycholinguistics to visual and multimodal language and communication. He published several papers and gives bachelor and master courses about the rhetorics and cognition of visual genres like advertising and editorial cartoons, i.e. metaphorical conceptualization in visual expressions, visual incongruities, irony and hyperboles, and (visual) optimal innovation. Over the past several years, his main preoccupation has been multimodal language. Together with Neil Cohn he has been developing a cognitive linguistic model of multimodality which addresses questions concerning the substance, grammar and meaning of multimodal expressions: what is the structure of such messages?; how do these structures interact?; and how do the separate contributions of each modality interface to produce an expression’s meaning and what kinds of implications does all this have for the (multimodal) lexicon and (multimodal) constructions?; i.e. what is the role of productivity, multimodal compositionality and storage of elements in the lexicon? 

Joost Schilperoord

Postdoctoral fellows

Bruno Cardoso Ph.D. is a Postdoctoral Researcher at Tiburg University and the creator of the Multimodal Annotation Software Tool (MAST) for the TINTIN project. His research interests are focused on the field of Human-Computer Interaction, specifically topics of emotion, usability, context-awareness in mobile devices and domain-specific languages. His research has been presented in venues like the UIST, CHI, IUI, UbiComp and CIKM. Bruno received his BSc and MSc in Computer Science at the University of Évora (Évora, Portugal). Following years as a consultant and freelance, he received a Ph.D. in Computer Science at the Nova University of Lisbon (Lisbon, Portugal). Close to the end of his studies, Bruno spent a sunny Winter as a research intern at Telefonica R&D (Barcelona, Spain). After obtaining his Ph.D., Bruno spent 3 years as a Postdoctoral Research Fellow at KU Leuven (Leuven, Belgium). A pretty eclectic person, Bruno loves learning new things, science, technology (emphasis on all things computer) and culture. (Website)

Bruno Cardoso

Graduate students

Irmak Hacımusaoğlu M.Sc. is a Ph.D. student at Tilburg University and a doodle artist. She holds a MSc degree in Cognitive Neuropsychology (Research) from the Vrije Universiteit Amsterdam (2019). Her master’s research combined behavioral and electrophysiological (EEG) approaches. She worked with Prof. Dr. Martijn Meeter in her thesis about false memory generations in educational settings. Before that, she received her BA in Psychology (magna cum laude) with a specialization in Brain & Cognitive Sciences from Koç University, 2017. Her primary research interests include cultural memories, cognitive aspects of visual narratives (e.g., mimicry and the visual language), event cognition, and the cognition of drawing. She is fascinated by the intersect between neuroscience and humanities and has become a member of NeuroGenderings Network. (Twitter)

Bien Klomberg M.Sc. is a Ph.D. student at Tilburg University, excited to combine her lifelong love for stories and linguistics with an equally long passion for drawing and comics. During her bachelor at University College Roosevelt, Middelburg, she studied stylistics, rhetorics, literature, and cognitive linguistics, with figurative language and point of view as special interests. Her masters in Communication and Cognition at Tilburg University focused on inferencing techniques in visual narratives, and her PhD is focusing on (dis)continuity in visual narrative sequencing, particularly in mappings across domains. As a hobby artist, she enjoys mixing craft with science. She still draws, and love stories in written form as well as Netflix series.

Lenneke Lichtenberg is a Research Master student studying Linguistics and Communication Sciences at Tilburg University. She is interested in the processing of information across different modalities in neurocognition. During her bachelor Communication and Information Sciences, she specialized in Cognition and Communication. Her honors bachelor’s thesis focused on the processing of visual morphology of upfixes, focusing on their literal and symbolic/metaphoric meanings. She plans to learn more about EEG research and conduct EEG experiments in the future. After her Research Master’s, she hopes to pursue a PhD in (Neuro)Cognition and Communication sciences. (Twitter)

Affiliated graduate students and postdocs

Aditya Upadhyayula, Ph.D. (University of California, Davis) is a recently graduated PhD formerly working with Jon Flombaum on how we represent, process, and thereby group moments in time. Prior to pursuing a Ph.D. in Cognitive Psychology, he was trained as an Electrical and Computer Engineer, and a Physicist. He loves walking, cooking, and playing the guitar and the piano. He once made traditional South Indian potato fries with Italian seasoning (Although ironic, he maintains that it was delicious). He is often seeing going on long walks wondering how he has ended up pursuing cognitive psychology. Nevertheless, he is happy to be studying how the mind works. He is very interested in building and using computational models to understand human cognition. He recently began a postdoc working with John Henderson at UC Davis. (Website, Twitter)

Marianna Pagkratidou, Ph.D. (TU Dublin, Ireland) graduated with a Ph.D. in Cognitive and Experimental Psychology from the University of Cyprus. Marianna’s research focuses on spatial memory representations that are constructed through narratives, specifically through comics. She uses computerized behavioural tasks and eye tracking techniques to study how people foreground spatial situation models when reading comics under different circumstances. Currently, Marianna is a Postdoctoral Researcher at the School of Electrical and Electronic Engineering at TU Dublin. She coordinates the SellSTEM (Spatially Enhanced Learning Linked to STEM) Marie Skłodowska-Curie Actions project and examines the relationship of spatial abilities in and for STEM learning. (Website, Twitter)

Marianna Pagkratidou

Morgan Patrick (Northwestern University, USA) is a Ph.D. student in music theory and cognition. His collaboration with Neil focuses around enumerating the interface between musical form, broadly construed, and aspects of narrative grammar. This work takes both theoretical and empirical directions, involving three areas of inquiry: affective dynamics, structural parallels, and attentional processes involved the analysis and cognition of temporal structures. He is also engaged in research on film music analysis and musical theme learning, having most recently presented work on leitmotifs at Music and the Moving Image. (Website coming soon)

Fernando Casanova (University of Murcia, Spain) is a PhD student sponsored by a FPU scholarship granted by the Spanish Ministry of Education and Culture. He holds two degrees in Language Sciences (Spanish, English and French) and an MA in Theoretical and Applied Linguistics. His doctoral thesis focuses on the study of interjections and onomatopoeias, their emotions, and the co-speech body and facial gestures they incorporate. His aims are focused on observing intercultural differences from an emotional, cognitive, psychological, paralinguistic and multimodal perspective. From that multimodal level, he is analyzing the representation of human beings through drawings (comics) and physically with real people (NewsScape Television News Library, developed by the Red Hen Lab). He is fascinated by the psychological and cognitive connection of emotions and gestures to express all kinds of information and that allows us to communicate in an efficient way.