2011 Keynote Presentation:
Designing online learning experiences for
audio-visual language learning
Goh Kawai, Hokkaido
University, Center for Language Learning
--
河 合 剛
(北海道大学 外国語教育センター)
The man on the left (who owns an airplane factory in
Florida) is describing how a recent hurricane
destroyed an airplane hangar and the aircraft within.
The man gestures with his arms to describe how the
walls of the building collapsed. His audience
understands what happened, and he understands that his
audience understands. Hence he does not finish his
sentence "And the whole big building, block walls and
all ...". He never says the verb "collapsed". Instead,
he continues his story.
The above example
shows that gestures occasionally convey visual
information that is not present in the audio medium.
Although CALL has the technical capacity to facilitate
audio-visual (AV) language learning, learning
experiences for AV comprehension have not increased.
Narrated programs such as television programs about
art, history, and science are popular, but material
that teach the complementary nature of verbal and
non-verbal language is surprisingly scarce. The fact
that our students rarely gesture when talking or
giving presentation is evidence of the dearth of AV
language learning.
Gestures are not
universal. There seem to be at least geographic,
vocational, and gender differences even within
English. Perhaps each learner can view several styles
and choose their production target (i.e., the style
that learner prefers to adopt), while being exposed to
multiple styles in order to hone receptive skills. TED
talks (http://www.ted.com/) may be a possible source
to collect various gesture styles.
In my talk, I will
show technology used at Hokkaido University, plus a
drawing of a proposed system for training AV language.
Goh Kawai is an
associate professor of EFL and education engineering
at Hokkaido University. He designs and evaluates
learning environments for learning spoken language.
He conducted research in California and Oregon, USA
prior to coming to Sapporo. Goh has a PhD in
information and communication engineering.
http://goh.kawai.com/