Are there cross-cultural patterns in the visual languages used in comics of the world? Do those patterns connect to the spoken languages of the comic creators? Do people’s languages or comic reading experience influence how they comprehend comics?
We are addressing these questions in the TINTIN Project, officially known as “Visual narratives as a window into language and cognition.” The TINTIN Project is funded by a €1.5 Million Starting Grant from the European Research Council.
We have created the Multimodal Annotation Software Tool (MAST) to enable the analysis of visual and multimodal documents. With it, we have created the TINTIN Corpus consisting of 1,000+ annotated comics from 143 countries. We are currently in the later stages of data collection. Both MAST and the TINTIN corpus will be made open to researchers.
The TINTIN project is a follow up from the Visual Language Research Corpus which analyzed cross-cultural variation in comics from Asia, Europe, and the United States.
Want to read more about the TINTIN Project? Check out our TINTIN Project related blog posts with periodic updates and insights.
Our current research team consists of several core staff and various collaborators around the world help find and analyze comics for our corpus and conduct experiments. We welcome additional collaborations, so if you are interested in working with us on this project, please inquire with Neil Cohn for details.
At Tilburg University, we collaborate with faculty members Joost Schilperoord and Myrthe Faber.
Bruno Cardoso was a postdoctoral fellow who designed and programmed the Multimodal Annotation Software Tool (MAST).
Ana Krajinovíc is a postdoctoral fellow analyzing the TINTIN Corpus for its typological properties.
Bien Klomberg and Irmak Hacımusaoğlu are PhD students analyzing cross-cultural visual language typology and conducting experiments.
Sharitha van der Gouw is a research associate assisting in annotation and research.
Fernando Casanova (University of Murcia, Spain) is a visiting PhD student who studies interjections in cross-cultural comics.
Maki Miyamoto (Japan Advanced Institute of Science and Technology) is a visiting PhD student who studies ideophones in cross-cultural comics.
Additional assistance has come from Fred Atilla, Nikki Born, Freek van den Broek, Klava Fadeeva, Marleen Gerritsen, Tim Hankart, Kea Kimmel, Abe Simons, Yasmilla Stolvoort, Janessa Vleghert, and others.
External Collaborators and contributers
Our multicultural research corpus has benefited from contributions and donations from several creators and companies. If you would like your comics to be analyzed within our corpus, please contact me!
This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No 850975).