Category Archives: academic

Transmedia Change — a new volume in the Routledge Advances in Transmedia Studies series

Book cover: Transmedia Change

I’m pleased to announce a forthcoming book (March 2022): Transmedia Change: Pedagogy and Practice for Socially-Concerned Transmedia Stories, my edited volume that includes chapters from 12 international authors on the practice, analysis, and teaching of transmedia storytelling for social good. Save 20% with discount code ESA22! The official blurb:

This book examines and illustrates the use of design principles, design thinking, and other empathy research techniques in university and public settings, to plan and ethically target socially-concerned transmedia stories and evaluate their success through user experience testing methods.

All media industries continue to adjust to a dispersed, diverse, and dilettante mediascape where reaching a large global audience may be easy but communicating with a decisive and engaged public is more difficult. This challenge is arguably toughest for communicators who work to engage a public with reality rather than escape. The chapters in this volume outline the pedagogy and practice of design, empathy research methods for story development, transmedia logics for socially-concerned stories, development of community engagement and the embrace of collective narrative, art and science research collaboration, the role of mixed and virtual reality in prosocial communication, ethical audience targeting, and user experience testing for storytelling campaigns. Each broad topic includes case examples and full case studies of each stage in production.

Offering a detailed exploration of a fast-emerging area, this book will be of great relevance to researchers and university teachers of socially-concerned transmedia storytelling in fields such as journalism, documentary filmmaking, education, and activism.

Table of contents:

  1. Introduction
    Kevin Moloney
  2. Native, Emergent, and Feral Transmedia Storyworlds
    Kevin Moloney
  3. Design Thinking and the Storytelling Goal
    Sarah Janssen
  4. Deploying Design Thinking for Story Design: Case Studies
    Sarah Janssen
  5. Contextualizing the American Opioid Crisis: A Case Study in Transmedia Harm Reduction
    Matt Slaby
  6. Storylines and Conceptual Lineage: Tomas van Houtryve and the Contextualization of History
    In Conversation with Matt Slaby
  7. Challenging Hegemonic Narratives: Power of Story-Based Design Strategies in Activating Sustainable Social Change
    Francesca Piredda and Mariana Ciancia
  8. Teaching Transmedia Practice in a Design School: The Plug Social TV Experience
    Mariana Ciancia and Francesca Piredda
  9. Transmedia Action Research: Progressive Pedagogy and Community Engagement
    Leslie L. Dodson
  10. Water from Fog: Transmedia Storytelling and Humanitarian Engineering
    Jamila Bargach and Leslie L. Dodson
  11. Encounters: Art, Science, Clouds and Water
    Ana Rewakowicz
  12. Addressing Social Issues Through Immersive Media
    Kuo-Ting Huang
  13. Immersive Storytelling Case Studies: Eva: A-7063, Lesson Learned from That Dragon Cancer, and Coming Home Virtually
    Kuo-Ting Huang
  14. Design Thinking as a Tool for Ethical Audience Targeting
    Kevin Moloney
  15. The Revolutionist: Eugene V. Debs – A Transmedia Experience for Public Media Audiences
    Kyle Travers
  16. User Experience Design and Testing for Socially-Concerned Storytelling
    Jennifer Palilonis
  17. User Experience Case Study: Professor Garfield’s 21st Century Literacy Project
    Jennifer Palilonis
  18. Conclusion: Defining a Flexible Framework for Analysis or Design of Socially-Concerned Transmedia Stories
    Kevin Moloney


24H Worldwide Design Conversations: Matt Slaby on transmedia design and the American opioid crisis

Kevin Moloney and Mariana Ciancia in conversation with Matt Slaby of Luceo about human-centered design, transmedia storytelling, and the American opioid overdose crisis.

All the News That’s Fit to Push: The New York Times Company and Transmedia Daily News

NYT_work

In my new article I explore how the New York Times Company’s Pulitzer-Prize-winning work on subjects such as the impact of slavery on U.S. culture, the feudal economy of taxi medallions, and the ongoing COVID-19 pandemic illustrate transmedia storytelling in daily news.

Download it with open access from the International Journal of Communication.

Here’s the abstract:

This feature article identifies three types of transmedia storyworlds—native, emergent, and feral—in the daily journalism work of The New York Times Company (NYT). In doing so, this case study of the NYT reevaluates how a transmedia storyworld is conceptualized, clarifies the relationship between storyworld and reference world in documentary storytelling, and illustrates the evolving transmedia journalism work of this organization. Through analysis of the NYT’s 1619 Project, New York taxi medallion economy, and COVID-19 coverage, the author defines native, emergent, and feral transmedia stories and how they can be understood across media industries.


Join me for 24H WORLDWIDE DESIGN CONVERSATIONS, June 24 at 5PM EDT

I will be joining in a global, 24-hour live conversation on issues of design in the face of the coronavirus pandemic, sponsored by the department of design at Politecnico di Milano in Italy. My half-hour conversation with fellow transmedia designer, producer, educator, and researcher Mariana Ciancia will explore the idea of rigor in design and how that looks different for differing design tasks, how it evolves for the designer and for a mode of creative production.

The lineup for the whole 24 hours is impressive and full of unique and informative sessions. Check out the list and details on joining here.


“Those goddamned stories with a beginning and an end.” Image as implied story

Image

Exposition: Characters and setting on the streets of Havana. © Kevin Moloney, 2019

Last week revolutionary documentary photographer Robert Frank died. Though this post is going to be about how images tell stories, I keep going back to a quote from this irascible critic of midcentury America. In a New York Times appreciation Arthur Lubow wrote, “Mr. Frank chafed like a bridled horse at conforming to a preordained narrative — as he phrased it, ‘those goddamned stories with a beginning and an end.’”

With a camera Frank was a poet of the real, who photographed like his friends Jack Kerouac and Allen Ginsberg wrote. But a story doesn’t need to be explicit to be a story.  We gain as much from what is implied as we do from what is explained. “When people look at my pictures I want them to feel the way they do when they want to read a line of a poem twice,” Frank told LIFE magazine back in 1951, on winning second place in the magazine’s young photographer contest.

This post continues the expansion of ideas on media form discussed in my recently published paper that breaks ideas of media into taxonomic ranks. When we better define the building blocks, we can more decisively build effective media. In those ranks I identify seven umbrella categories of media form: language, image, interaction, object, music, odor, and flavor. The last post expanded on language. This one expands on image.

Images are often explicit communicators — explicit enough for courtroom evidence, as documentation, or as representation. The photographs against which Robert Frank chafed not only represent the world like a list of facts, but also when combined in series they can be arranged with a beginning, middle, and end.

High-speed series of images — cinema, video — are exceptional at developing a narrative arc, and when combined with language as dialogue, narration, subtitle or interstitial texts, push further toward the complete narrative than language or image do alone.

Alone, however, images are naturally less explicit than language is when it is alone. Sensory information, contexts, events leading up to and resulting from the moment depicted are weak or absent. This requires us to imagine what is missing or add it in, consciously or unconsciously, through a prior understanding of context. The information or the story are implied, and we complete them with our own building blocks.

Creators of the many sub-forms of image — media like illustration, painting, comics, photography, cinema, animation, video, graphics, graffiti, and more — all engage unique tools to communicate explicitly and implicitly, and to mitigate the limits of their medium. In his book, Understanding Comics, Scott McLeod describes how we assemble a timeline between the fractured narrative of panel comics. The phenomenon of “closure” occurs when we imagine what happens between the panels to complete the story. By placing those panels in series, the author implies that they are connected. We do the rest.

This phenomenon also happens with still photographs and other media forms where images appear in series with wide gaps between the events depicted. This happens with cinema, video, and even text when edits jump forward to compress time.

Climax: Beach play in Punta del Este, Uruguay. © Kevin Moloney, 2019

More than a century ago Gustav Freytag described the dramatic pyramid (also often described as the dramatic arc), a classical structure starting with an exposition during which we meet characters and understand setting. It then moves up the side of the pyramid in the rising action phase during which protagonists and antagonists come into conflict. The pyramid peaks at the climax when the clash or cataclysm erupt. Then it drops into falling action as the old situation unravels, and finally the dénouement, or “new normal,” when we understand how the storyworld has changed.

Series of images in comics, photos, and film can hit all these points on the pyramid, or the hero’s journey, or a thesis argument structure, or others. This somewhat explicit arrangement limits how much imagining we do to get from one stage of a story or argument to the next.

Falling action: Hurricane displacement in Florida. © Kevin Moloney, 2019

A single still image presents a different communication challenge (or opportunity depending on the creator’s goal). A painted, drawn, assembled, or photographed image is often only one point on the dramatic pyramid leaving all of the rest of the story to be imagined or assumed, built from learned context or naked assumption. They may be exposition in the case of a portrait or a landscape, leaving us to imagine where the character might go or what will happen in that setting. It could be rising action, showing a tense, pregnant moment or situation. Many — particularly in my profession of photojournalism — are the moment of climax, allowing us to imagine how the moment came to be or how the aftermath will settle. I leave how images can land on the other two to your imagination.

Multiple stages of a narrative in one frame: Pumping water in Burkina Faso. © Kevin Moloney, 2019

Artists have long pushed against the still image as a singular moment, working to convey a sense of time passing or the context of the story or argument they wish to present. By including multiple moments in a single image, she may show different stages of the story in one frame. As the reader digests each of those moments he may experience the passing of time by reading multiple actions one by one.

Emotion

Rising action and explicit emotion: A combat medic and his wife say goodbye before deployment to the Persian Gulf. © Kevin Moloney, 2019

As the seven umbrella media forms I described in a prior post move from left to right, they also seize emotion as a tool. Language is certainly capable of conveying the emotion of a subject or engaging the emotion of a reader, but its greater strength is communicating the invisible. Successful images all work predominantly on an emotional level. The purely factual ones are usually pretty boring.

For humans, no communication is purely explicit. We always bring something of our own to the media with which we engage. Robert Frank embraced the image as a seed for our own contexts and emotions. His images ignore the story arc in favor of the argument or the poetic stanza. They draw from us readers emotional responses to the limited set of acute facts present in them. His masterwork The Americans first angered us here with what seemed an accusation that we were not who we thought we were. Now 60 years later those images imply something else to us Americans: that we are evolving or learning; the sadness of an acceptance of imperfection; that we really haven’t evolved or learned anything. As will all poets, he showed us who we are, and that is different with each reading.

 

For further reading see my chapter “Transmedia Photography” in Matthew Freeman and Renira Gambarato’s invaluable The Routledge Companion to Transmedia Studies, 2019.


How to Say Ain’t: Language as a Media Form

The medium is the message

Media is a mess.

Yes, that socio-political entity, “The Media,” certainly faces some troubles right now. But I’m talking about the contemporary English word itself. It’s messy. It can mean all sorts of things from the goo in a petri dish to the dab on an artist’s pallet. It’s a vocal stop in music and an ancient Persian empire. And it’s also the means, modes or technologies of communication. It’s so messy that even when we write or talk about that last one, understanding of the word is situated in the experience of the listener or reader. It might mean something different to them than it does to you.

My latest academic article, “Proposing a Practical Media Taxonomy for Complex Media Production,” tackles this messiness by breaking that one word apart under three umbrella categories: Content, Media Form and Media Channel. I started down this road on this blog a few years ago, using these terms to clearly define the difference between multimedia, crossmedia and transmedia storytelling. But let’s dig in a little deeper.

Media Form

I’ll come back to content in later posts. First the idea of media form merits some examples for which I didn’t have room in the linked article. Media form, one of the two terms I use to replace the vague and often-conflated singular medium, has been variously described as a language of storytelling, as semiotics, or as modes. The best way to understand what separates it from its partner media channel is that a media form can be published in many different places. The media channel is the place.

For example, text is a media form. It’s common and old (from the dawn of writing) and, as the illustration up top shows, can land almost anywhere. We see text in print, online, in skywriting and graffiti, in tattoos and crawling across the bottom of a cable news broadcast. Word-besotted humans have put it everywhere. The it is the media form, and the where is the media channel.

Explicit-Implicit Spectrum

In my taxonomy I break the idea of media form first into seven umbrella groups: Language, Image, Interaction, Object, Music, Odor and Flavor. That left to right order spreads them across a spectrum of most explicit (language) to most implicit (flavor) in how they communicate. Language is capable of being very explicit in how it communicates, if the circumstances are right. It is capable of great detail and narrative order or disorder. Words — written or spoken — can describe the absence of something where the other media forms cannot. As Sol Worth pointed out, “Pictures can’t say ain’t.”

Language is never completely explicit, though. The reader or listener always brings her or his own experience to understanding a message.

“Gown removed carelessly. Head, less so.” — Joss Whedon

This is a little six-word story by the creator of Buffy the Vampire Slayer. It’s a nice example of how language is an implicit communicator too. When we read that sparse story we fill in all the blanks with our own experiences and remnants of other stories. We abhor the gaps and make up stuff to fill them ourselves.

So yes, language is the most explicit of my seven categories, but that does not mean it is entirely explicit. Nothing achieves that when humans are involved in the communication.

Media FormFrom the umbrella category of Language, my taxonomy creates a structure to break that idea apart into ever-more-specific language forms. It can be written or spoken. Written language can be scribbled, sprayed, puffed into clouds, or set in a type font. Spoken language breaks into conversation, lecture, voice over and more. With each new level of specificity the media form of language finds more and more advantages, more ways of communication, and differentiates what it can or cannot say.

This is where I stop saying ain’t. Up soon: Image.


Building Blocks for Complex Publishing

Taxonomy

A Media Taxonomy

Today USC Annenburg’s International Journal of Communication published my “Proposing a Practical Media Taxonomy for Complex Media Production,” and it makes for a good reason to get back to posting here regularly (at least until my students catch up with me). The abstract:

This article proposes a taxonomy of media designed to clarify the production and critique of complex media publication. I examine the conflation of ideas described by the word media and review prior taxonomic categorizations of this fuzzy concept. Media is broken into layered categories of content, media form, and media channel based on the semiotic and technological roles in mediated communication and then is described as a flow of decisions made in the creation and publication of communicative products. Finally, this taxonomy is applied to clarify the different functions of multimedia, crossmedia, and transmedia storytelling.

In the coming weeks I’ll post a series of examples that help visualize and describe some of the concepts in the article. I’ll start off with interesting examples of the concept of media form, follow with media channel, then examples of multimedia, crossmedia and transmedia storytelling. Stay tuned for those, but in the meantime, you can read or download the article here:

International Journal of Communication

This article also builds on the ideas in these previous posts:

Multimedia, Crossmedia, Transmedia… What’s in a Name?

Transmedia Journalism as a Post-Digital Narrative