2.2Multimodality

As a new concept emerging in recent years, multimodality is widely applied to various fields, especially in systemic-functional and social linguistics. Earlier due to the limitation of science and technology, scholars barely analyzed discourse from a multimodal aspect. As Hu Zhuanglin (2007:1-10) mentioned that “now the rapid development of new technology and corpus have made the multimodal study of natural discourse possible”. Kress & Leeuwen thought that "Multimodality is to use several kinds of semiotics modes respectively or comprehensively to strengthen the expression of the same meaning, or to exercise supplementary function, or to sort the meaning in a hierarchical order" (Kress & Leeuwen, 2001:20). While another famous multimodal theory experts O’Halloran, combining essence of various point of views, gave the multimodality a new definition as "a theoretical analysis and practice comprehensively integrated of language, visual images, other symbolic resources, construction paper text, digital media and daily life text, things and events" (O'Halloran,2008:231). It means that in multimodal texts, the receiver needs to use multiple senses to absorb the external symbols in a variety of modal forms, and meanwhile, the information received through these different sensory modes will interact effectively or produce one image as part of the written text and it is also true of the other way around, etc. (Kress, 2001:7). It has become a new issue to discuss how to use this newly-arise way to convey meanings, to construct metaphors, to combine the multimodality with metaphors and explore the metaphors in multimodality.

In terms of multimodal metaphors, in Pictorial Metaphor in Advertising (Forceville, 1996), Charles Forceville analyzed pictorial metaphors in advertisements from a visual aspect. In Multimodal Metaphors-Application of Cognitive Linguistics in 2009, he expounded the multimodal metaphors from various perspectives. In the multimodal metaphor theory, Forceville pided metaphors into 2 categories: one is the mono-modal metaphor and the other is the multimodal one. The mono-modal metaphor means two domains using only one modality to represent the metaphorical meaning while the multimodal metaphor is one choosing different modalities respectively to characterize the hidden meaning in both source domain and target domain (Forceville,1998:384), of which the construction and understanding involve all kinds of modal symbols: images and sounds, demanding the participation of people’s multiple senses: vision and hearing, in order to realize the effective interaction among the symbolic information.

3. Theoretical framework: systemic view to multimodal metaphor 

As an approach of linguistics, systemic functional linguistics regards language as a social semiotic system. The founder Michael Halliday, 'liberated' the dimension of choice from structure in a certain sense, making it the main organizing dimension of the theory. For Halliday, one principal theoretical principle is that “any act of communication involves choices”. Halliday thinks “linguistics is also ‘functional’ because he believes that languages have evolved under the pressure of the particular functions that the language system has to serve”. Systemic functional linguistics holds that language has three metafunctions including “the ideational metafunction, the interpersonal metafunction and the textual metafunction” (Halliday,2010:35). The idea of “context” is important in the study of Halliday and it is created with the help of the construed experience and the enacted social relations.来!自~吹冰论-文|网www.chuibin.com

The multimodal discourse symbols theory by Kress and Leeuwen is based on Halliday's theory. By introducing this sound theory into this field, Kress and Leeuwen's Reading Images (1996:20) rose attention to discourses that are of not solely verbal words but combinations of various semiotic resources. This framework provides a theoretical basis and analytical method for the visual image’s multimodal discourse analysis. Under the premise of considering the images as social symbols, they extended the ideas of metafunctions to visual patterns, creating the visual grammar centered on the “representational meaning, interactive meaning and compositional meaning”. Since then MDA has become a new sphere of Discourse Analysis and its study objects covers extensive materials, which includes “visual art, painting, sculpture and architecture” (O'Tool, 2010:78). Most of MDA researches later follow this social semiotic approach and analyzes the materials mentioned earlier. 

上一篇:浅析法律英语的词汇特点及其翻译
下一篇:从MTI学生与职业译者的对比实证研究看翻译实践教学

多元互补论视角下的《三字经》英译研究

电影《撞车》中的多元化歧视解析

多媒体技术在初中英语教学中的应用

多模态理论在小学英语口语教学中的应用

基于2016年美国总统大选第...

小学英语课堂中多媒体使用调查研究

中美英语口语类慕课多模态对比分析

稀土伴生放射性冶炼厂环境放射性水平调查

原位离子交换法合成AgBrAg3PO4复合光催化材料

18岁可以學什么技术,18岁...

浅谈芭蕾舞外开与中国古典舞外旋的区别

沉箱码头设计国内外研究现状和参考文献

谈人机工程学在公共电话亭设计中的应用

论好莱坞电影中的中国文化元素

中学地理生活化教学研究

社会工作视野下医患关系的冲突与协调

结肠透析机治疗慢性肾功...