2025 Vol. 16 №2

Speech and gesture regulations in expressing vague reference in expository dialogue

DOI

10.5922/2225-5346-2025-2-5

Pages

93-106

Abstract

This study explores the organization of multimodal systems, mediated by two types of hierarchical regulations: systemic regulations governing each mode (speech and gesture) and multimodal regulations operationalizing mode alignment. To identify these regulations, we examine the variability of the multimodal speech-gesture system, modulated by the cognitive factor of vague reference in expository dialogue. The data were collected in an experiment involving native Russian speakers explaining the differences between close synonyms. The paper contrasts the distribution of vague reference speech cues used to shape referents in names (placeholders) and point the way to the referent in predications (approximators), both aligned with functional gestures (deictic, representational, and pragmatic).

The findings reveal several regulations that constrain the distribution and alignment of speech cues and gestures. First, the prevalence of approximators is observed, indicating that a higher input of predication expresses vague reference. Second, the prevalence of placeholders in the Request communicative move was found, accounting for the Request’s role in both initiating a new act and completing the previous one by renaming the vague referent. Third, a more frequent use of pragmatic gestures with approximators was identified, suggesting that while nominations primarily evoke iconic and indexical representations in gestures, predications are strongly linked with pragmatic manifestations. Finally, the study reveals that vague reference serves as a cognitive principle regulating the speech and gesture system in interactional discourse.

Reference

Berman, R. A. and Nir-Sagiv, B., 2007. Comparing Narrative and Expository Text Construction Across Adolescence: A Developmental Paradox. Discourse Processes, 43 (2), pp. 79—120, https://doi.org/10.1080/01638530709336894.

Channell, J. M., 1983. Vague Language: Some Vague Expressions in English. PhD the­sis. York.

Cienki, A. and Müller, C., eds., 2008. Metaphor and Gesture. Vol. 3. Amsterdam.

Demyankov, V. Z., 2019. Modality Agreement and Adaptation. Kognitivnye issle­dovaniya yazyka [Cognitive Studies of Language], 38, pp. 88—100 (in Russ.).

Donnellan, K. S., 1966. Reference and definite descriptions. Philosophical Review, 75 (3), pp. 281—304.

Iriskhanova, O., Kiose, M., Leonteva, A., et al., 2023. Multimodal Collaboration in Expository Discourse: Verbal and Nonverbal Moves Alignment. In: A. Karpov, K. Samudravijaya, K. T. Deepak, et al., eds. Speech and Computer. Lecture Notes in Computer Science. Vol. 14338, pp. 350—363, https://doi.org/10.1007/978-3-031- 48309-7_29.

Iriskhanova, O. K. and Avramova, Yu. S., 2021. Vague reference in metalinguistic tasks as a multimodal phenomenon. Kognitivnye issledovaniya yazyka [Cognitive Stu­dies of Language], 4 (47), 233—244 (in Russ.).

Iriskhanova, O. K., 2023. Simultaneous interpreter in multimodal dimension: the role of gestures in moments of non-interpretation. Slovo.ru: Baltic accent, 14 (3), pp. 40—51, https://doi.org/10.5922/2225-5346-2023-3-3 (in Russ.).

Iriskhanova, O. K., ed., 2021. Polimodal'nye izmereniya diskursa [Multimodal di­men­sions of discourse]. Мoscow (in Russ.).

Kanellos, I. and Ciobanu, E., 2021. The semiotic topos of vagueness. In: A. Syro­pou­los and B. K. Papadopoulos, eds. Vagueness in the Exact Sciences: Impacts in Mathematics, Physics, Chemistry, Biology, Medicine, Engineering and Computing. Ber­lin; Boston, pp. 145—180, https://doi.org/10.1515/9783110704303-009.

Korotaev, N. A., 2023. Collaborative constructions in Russian conversations: A multichannel perspective. In: Computational Linguistics and Intellectual Technologies. Vol. 22. Moscow, pp. 254—266, https://doi.org/10.28995/2075-7182-2023-22-254-266 (in Russ.).

Kripke, S. A., 1977. Speaker's reference and semantic reference. In: P. A. French, Th. E. Uehling and H. K. Wettstein, eds., Studies in the Philosophy of Language. Morris, pp. 255—296.

Longacre, R. E., 1983. The grammar of discourse. New York.

Lotman, Yu. М., 2010. Mechanisms of Dialogue. In: Yu. M. Lotman, ed. Semiosfera. Kul'tura i vzryv. Vnutri myslyashchikh mirov. Stat'i. Issledovaniya. Zametki [Semios­phe­re. Culture and explosion. Inside the thinking worlds. Articles. Studies. Notes]. St. Pe­tersburg, pp. 268—276 (in Russ.).

McNeill, D., 2017. Gesture-Speech Unity: What It Is, Where It Came From. In: R. B. Church, M. W. Alibali and S. D. Kelly, eds. Gesture Studies. Vol. 7. Amsterdam, pp. 77—101, https://doi.org/10.1075/gs.7.05mcn.

Podlesskaya, V. I. and Starodubtseva, А. V., 2013. On the grammar of placehol­ders in colloquial speech. Voprosy Jazykoznanija [Topics in the study of language], 3, pp. 25—41 (in Russ.).

Podlesskaya, V. I., 2013. Vague names in Russian speech: a corpus study. In: Komp'yuternaya lingvistika i intellektual'nye tekhnologii [Computational Linguistics and In­tellectual Technologies]. Vol. 1. Moscow, pp. 631—643 (in Russ.).

Putina, O. N., 2021. Funktsionirovanie diskursivnykh markerov v dialogicheskom edinstve vopros-otvet: na materiale russkogo i angliiskogo yazykov [Functioning of discour­se markers in a dialogue unity Request-Response (featuring Russian and English lan­guages)]. PhD Dissertation. Perm (in Russ.).

Sherstinova, T. Yu., 2018. The Structure of everyday dialogue as the sequence of speech acts. In: Komp'yuternaya lingvistika i intellektual'nye tekhnologii: po materialam mezhdunarodnoi konferentsii «Dialog 2018» [Computational Linguistics and Intellectual Technologies. Papers from the Annual International Conference “Dialogue 2018”]. Vol. 24. Moscow, pp. 637—651 (in Russ.).

Shvedova, N. Yu., 2003. Ocherki po sintaksisu russkoi razgovornoi rechi [Essays on the syntax of Russian spoken speech]. Moscow (in Russ.).

Sinha, C., 1999. Grounding, meaning, and the acts of meaning. In: T. Janssen and G. Redeker, eds. Cognitive linguistics. Foundations, scope, and methodology. Berlin; New York, pp. 223—256.

Stepanov, Yu. S., 1998. Yazyk i metod: k sovremennoi filosofii yazyka [Language and Method. Towards Modern Philosophy of Language]. Moscow (in Russ.).

Zolyan, S. T., 2021. Semiopoesis: Formation of Meaning in Molecular Genetics and Biosemiotics. Critique and Semiotics, 1, pp. 57—77, https://doi.org/10.25205/ 2307-1737-2021-1-57-77 (in Russ.).