Are there cross-cultural patterns in the visual languages used in comics of the world? Do those patterns connect to the spoken languages of the comic creators? Do people’s languages or comic reading experience influence how they comprehend comics?
We seek to address these questions in the “TINTIN Project”, officially known as “Visual narratives as a window into language and cognition.” The TINTIN Project is funded by a €1.5 Million Starting Grant from the European Research Council.
We have created the Multimodal Annotation Software Tool (MAST), to better enable the analysis of visual and multimodal documents. We are using MAST to create a corpus of annotated comics from around the world. We are currently in the middle of data collection, and are analyzing comics from over 60 countries. Both MAST and our corpus will be open to researchers.
The TINTIN project is a follow up from the Visual Language Research Corpus which analyzed cross-cultural variation in comics from Asia, Europe, and the United States.
Want to read more about the TINTIN Project? Check out our TINTIN Project related blog posts with periodic updates and insights.
Our current research team consists of several core staff and various collaborators around the world help find and analyze comics for our corpus and conduct experiments. We welcome additional collaborations, so if you are interested in working with us on this project, please inquire with Neil Cohn for details.
At Tilburg University, we collaborate with faculty members Joost Schilperoord and Myrthe Faber.
Bruno Cardoso is a postdoctoral fellow who designed and programmed the Multimodal Annotation Software Tool (MAST).
Bien Klomberg and Irmak Hacımusaoğlu are PhD students analyzing cross-cultural visual language typology and conducting experiments.
Sharitha van der Gouw is a junior researcher assisting in annotation and research.
Fernando Casanova (University of Murcia, Spain) is a visiting PhD student who studies interjections in cross-cultural comics.
Additional assistance has come from Fred Atilla, Nikki Born, Freek van den Broek, Klava Fadeeva, Marleen Gerritsen, Kea Kimmel, Abe Simons, Yasmilla Stolvoort, and Janessa Vleghert.
External Collaborators and contributers
Our multicultural research corpus has benefited from contributions and donations from several creators and companies. If you would like your comics to be analyzed within our corpus, please contact me!
Cardoso, Bruno, and Neil Cohn. 2022. The Multimodal Annotation Software Tool (MAST). In Proceedings of the 13th Language Resources and Evaluation Conference, 6822‑6828. Marseille, France: European Language Resources Association.
This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No 850975).