Definition: A multimodal composition is a message that incorporates multiple modes of communication to tell a story, express a feeling, or persuade an audience. These modes can include written text, images, audio, video, gestures, and spatial arrangements, among others. The aim is to leverage the strengths of each mode to enhance the overall effectiveness and engagement of the message. Traits of multimodal composition are as follows:
Integration of Multiple Modes: Multimodal compositions integrate two or more modes of communication (i.e. text, images, video, and audio).
Enhanced Engagement: By appealing to multiple senses, multimodal compositions can capture and maintain the audience’s attention more effectively.
Diverse Media Formats: Websites, videos, infographics, digital stories, podcasts, social media posts, and interactive media.
Audience-Centric Design: Multimodal compositions employ the most appropriate modes to persuade the target audience.
Print Media – Physical, text-based formats.
Books, newspapers, magazines, brochures
Digital Media – Electronic or online formats.
Websites, blogs, e-books, social media posts
Audio Media – Sound-based communication.
Podcasts, radio broadcasts, music
Visual Media – Image or video-based formats.
Photography, films, television, graphic design
Multimedia – Combines text, images, audio, video, and interactivity
Video games, online courses, interactive websites
Social Media – Platforms for user-generated content and interaction.
Twitter (X), Instagram, TikTok, Facebook
Live/Performance Media – In-person or live-streamed events.
Theater, speeches, concerts, webinars
Image: Image, infographic, diagram, chart, graph, comic strip, animation, public service announcement, political cartoon, advertisement, collage, photograph, photograph gallery
Audio: Podcast episode, song, speech, presentation
Video: Film, video, presentation (like TED Talks), documentary video, animation, digital story, music video, video podcast episode, comic book, public service announcement, political cartoon, commercial.
Text: Written language used in various formats such as articles, essays, captions, and labels.
Visuals: Images, diagrams, charts, graphs, and videos that provide visual representation of ideas.
Audio: Spoken words, music, sound effects, and ambient noise that enhance the auditory experience.
Gestural: Body language, facial expressions, and hand movements that convey meaning.
Spatial: The arrangement of elements in physical or digital space to create meaning and facilitate navigation.
(The Modes of Communication)
Definition: The primary sensory channels through which communication occurs. Most communication methods utilize multiple modalities. While taste, touch, and smell can also convey information, the following modalities are most commonly used in persuasive communication:
Verbal: Spoken, sung, handwritten, or typed words (i.e. Linguistic).
Auditory: Spoken language, songs, music, or ambient sounds.
Visual: Still and moving images, colors, written text, gestures, and facial expressions.
Haptic: The sense of touch and the body's response, such as interacting with video games.
Example: A speech integrates verbal modality (spoken language) with visual modalities like gestures, facial expressions, and other visual cues.
Modes of Communication
Multimodal compositions are commonly used by natural science professionals to persuade a diverse assortment of target audiences. These compositions combine text, visuals, audio, and interactivity to effectively communicate and persuade audiences, from fellow scientists to the general public and policymakers.
Research Articles (e.g., academic journals, peer-reviewed papers)
Grant Proposals (e.g., funding applications)
Policy Briefs (e.g., documents for policymakers)
White Papers (e.g., detailed reports to advocate for specific initiatives)
Press Releases (e.g., announcements of discoveries or innovations)
Popular Science Articles (e.g., blogs, magazine articles)
Case Studies (e.g., practical examples to illustrate scientific applications)
Infographics (e.g., data visualization, simplified concepts for broad audiences)
Posters (e.g., academic conference presentations)
Charts and Graphs (e.g., data-supported arguments)
Slide Decks (e.g., PowerPoint or Keynote presentations)
Illustrations and Diagrams (e.g., scientific processes or mechanisms)
Websites (e.g., dedicated pages for research projects)
Social Media Posts (e.g., Twitter threads, Instagram infographics, LinkedIn updates)
Online Videos (e.g., YouTube explainer videos, short social media clips)
Interactive Simulations (e.g., educational tools to demonstrate scientific phenomena)
Podcasts and Webinars (e.g., discussions and presentations for broader outreach)
Conference Presentations (e.g., oral presentations with slides)
Public Lectures (e.g., talks to general or specific audiences)
Panel Discussions (e.g., expert panels on controversial topics)
Elevator Pitches (e.g., concise persuasive presentations to stakeholders)
Outreach Campaigns (e.g., combining written articles, videos, and social media)
Citizen Science Projects (e.g., engaging the public in data collection and research)
Advocacy Campaigns (e.g., multimedia approaches to support science policy changes)
Augmented Reality (AR) and Virtual Reality (VR) (e.g., immersive experiences to demonstrate phenomena)
Data Dashboards (e.g., real-time interactive visualizations for stakeholders)
Interactive E-books (e.g., scientific topics presented through multimedia content)
Table of Contents