RT @Multimodallang: Excited to announce the 10th Conference of the İnternational Society of Gesture Studies to be held in Nijmegen NL 9-11….

RT @LMatyjek: 𝗟𝗼𝗼𝗸𝗶𝗻𝗴 𝗳𝗼𝗿 (𝗮𝗱𝘂𝗹𝘁) 𝗮𝘂𝘁𝗶𝘀𝘁𝗶𝗰 𝗽𝗮𝗿𝘁𝗶𝗰𝗶𝗽𝗮𝗻𝘁𝘀 𝗳𝗼𝗿 𝗮𝗻 𝗼𝗻𝗹𝗶𝗻𝗲 𝘀𝘁𝘂𝗱𝘆!. Help us understand better what makes people "click". Details….

The most fun image & video creation tool in the world is here. Try it for free in the Grok App.

It is such an honor to be included in this fantastic new Handbook of Gesture Studies! And really wild to see my name listed among so many amazing people whose work has inspired me

RT @JulijaVaitonyte: We're organizing a workshop during this year's IVA and calling for short paper submissions:

RT @EPAN_lab: PhD opportunity at the Donders Institute: Are you fascinated by the connection between adapting communication and managing em….

Some space has opened up! Join us in a few weeks in Krakow for dynamical systems and social interaction research! Oriented towards both pushing methodology and thinking more deeply about underlying theory.

RT @LMatyjek: Dear #autism researchers,.Do you know of any *communication style questionnaires* which have been "approved" by the community….

Looks like a very cool postdoc position! Analysis of facial expressions, eye gaze, heart rate relating to emotion expression, and contributing to practical applications (app development).

RT @ShefAutismRes: Interested in research on autistic sensory experiences? A new study from Radbound University is recruiting now: https://….

Applications close in less than a week! More info on the workshop in this thread👇👇.

⚠️New workshop coming up!⚠️ Join us in Krakow, May 2-4, for "Behavioral Dynamics in Social Interactions". We've got great keynotes, poster session, hands on methodology sessions, and lots of room for discussion!. Read more and sign up here: 

RT @UofG_MOSAIC: Our next MOSAIC meeting will be hosted by @chaona_chen and feature a discussion of @jamesptrujillo & @JudithHoller's recen….

So now that Bluesky doesn't require me to ask anything of anyone in order to sign up, I've signed up😅 Follow me there if you've already made the move

Of course, we still need to expand this to look at more extensive interpretation options, visual signals, etc. But quite an exciting first step! And certainly a project I'm very proud of😁.

All of this suggests that we perceive multimodal language in a Gestalt-like way, where the meaning of any of the given signals (speech, facial expressions, head gestures, hand gestures) is likely dependent on the entire composition of co-occurring signals.

So do the single signals have any consistent influence on how people interpret combinations of signals? Yes! The responses to a multi-signal Gestalt are more similar to responses to a signal that is also part of that Gestalt than to responses to an unrelated signal

We also tried aggregating response distributions per spoke utterance, rather than per participant, and found the same results. In other words, we interpret the same speech differently when paired with an eyebrow raise, a head turn, *or* the two signals together.

This difference between interpretation of combinations (ie "whole") vs single signals (ie "parts") was a replication of our initial pilot study using the same design.

For each participant, we found the proportion of responses in each of the 6 intention categories, for each visual display. In line with Gestalt-like processing, distributions of responses to combinations of signals was different than responses to the single signals

So anyway, we combined spoken utterances with different visual signals (head nods, head tilts, eyebrow raises), and all the combinations of these 3 signals. We asked participants to judge the intention (or pragmatic meaning), of each utterance.