16.10.07

[reading images]

An interesting article on the reading (as in interpreting) of images and development of point of view. If the image appears alongside a narrative, people will wait to read the whole story before coming to any conclusions. If, however, the image appears with a list of information (rather than a narrative), people are quicker to form conclusions, basing their opinion more on the image rather than the verbal description. This has pedagogical and new media theory implications (among others).

"As our results indicate, pictures can have directionally opposite eVects on the impact of the verbal information they accompany, depending on whether this information is conveyed in a narrative or a list. These diVerences are largely traceable to the inXuence of pictures on the processes that individuals use to compute a judgment and the representations that are formed. When the information about a person describes a sequence of temporally related events, participants with the goal of forming an impression of the person are unlikely to compute an evaluation of the protagonist until the entire sequence is complete. Pictures provide perceptual symbols that both facilitate the formation of images of the individual events and permit the events to be perceptually linked, thereby leading a more coherent mental representation of the information to be constructed. When the information is conveyed in a list, however, participants attempt to form an evaluation of the protagonist on line by integrating the implications of the individual events as they encounter them, updating their impression as each new event is received. When pictures accompany the event descriptions, however, they appear to interfere with this integration process, resulting in a decrease in the impact of the descriptions. This interference largely occurs when pictures directly accompany the verbal information. Thus, as indicated by the supplementary data obtained in Experiment 2, presenting pictures separately from the verbal event descriptions had similar effects on participants’ evaluations regardless of the format in which the verbal material was presented.


Experiments 3 and 4 provided more direct indications of the processes and representations that underlie the judgments we observed in earlier studies. Experiment 3, for example, indicates that pictures are recognized both more quickly and more accurately when they are conveyed in a narrative than when they are conveyed in a list. Furthermore, verbal descriptions were also identified more accurately in the former condition, whereas the time required to make these identiWcations was longer. This latter effect is consistent with other evidence that when the features of information are represented in memory in a temporally related sequence, people engage in a mental search of the representation in order to identify these features, and the required time to do so is a reflection of this search.


Experiment 4 confrmed these implications and the nature of the representation formed more generally, showing that when event information is presented in a narrative
and, therefore, stored in memory as a temporally related sequence, exposure to one event description increases the speed of identifying the event that immediately follows it in the sequence. This eVect is not evident when the events are simply listed. Further results from this experiment indicate that pictures increased the time to identify statements when they were contained in a list but not when they were conveyed in a narrative. These results further strengthen the assumption that pictures interfered with the processing of the verbal information they accompanied."




"The impact of pictures on narrative- and list-based impression formation: A process interference model, Journal of Experimental Social Psychology, Volume 43, Issue 3, May 2007, Pages 352-364
Rashmi Adaval, Linda M. Isbell and Jr., Robert S. Wyer
"



Labels: , , , , , , , ,

5 Comments:

At 1:25 PM, Anonymous Bethany in London said...

I'm going to try this out in my class possibly even when I try teaching episode one of Inanimate Alice.

Any advice will be appreciated.

Thank you.

 
At 8:06 PM, Anonymous Ben said...

Nice one mate.

 
At 5:44 AM, Blogger Little Onion said...

hi jess

i'm thinking of haiga in relation to this - in haiga - images and texts (usually haiku or tanka)are placed together - in the tradition of ren - or renga - the text and image work in a link and shift manner - neither describing the other - any message or narrative that appears to the reader is set up by the juxtaposition of text to image image to text

shakespeare's beard
emerges then disappears
in my urine

http://littleonion.artremains.com/Home/Art/ViewArt/Default.aspx?ArtGUID=6c0f009d-38b9-4d2d-83df-2d84efdc6c27

all that's best

Paul

 
At 1:52 PM, Blogger Jess said...

thanks Paul for your comment and link to your haiga. The haiga certainly does seem an apt comparison especially to multimodal reading where each mode does not necessarily attempt to mirror what another mode is doing.

i'm wondering about your work in particular and your choice of font for your text. Why not the more traditional calligraphy?

 
At 8:27 PM, Blogger Little Onion said...

for me a 'calligraphic' font would be misplaced on a digital print by me who if i tried to do real calligraphy by hand.... well i'm no pensman - the images at the site indicated are quite degraded images - the prints are big in reality

placing information next to an image works often just as well as placing it on it - here's a link to one from a series of haiga that used just 3 words next to or on an image:
http://www.cddc.vt.edu/host/haikumania/toiletdeathburger1.JPG

 

Post a Comment

Links to this post:

Create a Link

<< Home