Matching entries: 0
settings...
Llobera J (2010), "Simulacions Immersives, Certeses Sentides" Vol. 2010 Arts Santa Mònica - Departament de Cultura i Mitjans de Comunicació de la Generalitat de Catalunya.
Abstract: Aquest llibre recull els textos de les reflexions que van tenir lloc en l'encontre internacional «Noves fronteres de la ciència, l'art i el pensament» celebrat a Barcelona l'any 2009
BibTeX:
@inproceedings{Llobera:Simulacions:2010,
  author = {Joan Llobera},
  editor = {Arts Santa Mònica - Departament de Cultura i Mitjans de Comunicació de la Generalitat de Catalunya},
  title = {Simulacions Immersives, Certeses Sentides},
  publisher = {Arts Santa Mònica - Departament de Cultura i Mitjans de Comunicació de la Generalitat de Catalunya},
  year = {2010},
  volume = {2010}
}
Llobera J (2012), "Stories in Immersive Technologies". Thesis at: EVENT-LAB - Facultat de Psicologia - Universitat de Barcelona.
Abstract: How can we use immersive and interactive technologies to develop narratives taking advantage of the fact that within immersive virtual environments people tend to respond realistically to virtual situations and events? Stories in such a media would allow the participant to contribute to the story and interact with the virtual characters while the narrative plot would not change, or change only up to how it was decided a priori. Participants in such a narrative would be able to freely interact within the virtual environments and yet still be aware of the main thrust of the stories presented. How can we preserve the 'respond as if it is real' phenomenon induced by these technologies, but also develop an unfolding narrative in this environment? In other words, can we develop a story, conserving the structure, its psychological and cultural richness and the emotional and cognitive involvement it supposes, in an interactive and immersive audiovisual space?

This work develops a new two part approach and a novel computational story model and shows experimentally people respond and interact realistically while being aware of the story plot.

BibTeX:
@phdthesis{Llobera:Stories:2010,
  author = {Joan Llobera},
  title = {Stories in Immersive Technologies},
  school = {EVENT-LAB - Facultat de Psicologia - Universitat de Barcelona},
  year = {2012}
}
Llobera J (2004), "L'illusion de Continuité Auditive. Une Étude MEG". Thesis at: IRCAM - CNRS.
Abstract: EN FRANÇAIS:
Dans une scène sonore typique, un auditeur doit traiter simultanément un grand nombre de sources superposées. Néanmoins, il est capable d'organiser cette scène en flux, groupements perceptuels liés à la représentation mentale des sources. Il a depuis longtemps été démontré par des expériences psychophysiques que même si un flux est masqué par un autre son pendant une durée de temps brève, il conservera sa cohérence perceptive. Ce phénomène est appelé illusion de continuité auditive. Cette étude vise a étudier les bases neuronales de cette illusion en combinant psychophysique et imagerie cérébrale par magnétoencéphalographie (MEG). Un ensemble de sons a été étudié où la manipulation d'un paramètre physique permettait d'obtenir des sons similaires mais provoquant ou ne provoquant pas l'illusion. Les sons consistent en un bruit modulé en amplitude, interrompu par un bruit non modulé. Les auditeurs entendent la modulation comme continue. Des expériences psychophysiques ont permis de montrer qu'un intervalle de silence de durée suffisante après le bruit non modulé permet de casser la continuité illusoire. L'imagerie cérébrale montre que la réponse MEG habituellement associée à la présence de stimuli modulés en amplitude, la réponse stationnaire ou ASSR, n'est pas reconstruite pendant l'illusion. En revanche, l'illusion apparaît corrélée à l'activité gamma précoce. Celle-ci est définie comme une activité évoquée qui se produit entre 30 et 80 ms après la stimulation, entre 35 et 57 Hz. Dans cette expérience, elle est liée avec le début du bruit modulé après l'intervalle de silence. Sous l'hypothèse que l'organisation de la scène sonore se réalise d'abord par la ségrégation des flux puis par la caractérisation des attributs perceptifs de ceux-là , l'activité gamma serait liée à l'attribution d'un flux aux nouveaux évènements sonores.

EN CATALÀ:
En una escena sonora típica, un auditor ha de tractar simultàniament un gran nombre de fonts superposades, i és capaç de focalitzar la seva atenció cap a l’una o l’altra d’aquestes fonts, separant-la del context. Això implica que és capaç d’organitzar aquesta escena en fluxos, agrupaments perceptuals associats a la representació mental d’aquestes fonts. Ja fa temps que experiments psicofísics demostraren que inclús quan un flux és cobert per un altre so durant una durada breu, el flux conserva la seva coherència perceptiva. Aquest fenomen es pot produir quan, per exemple, un oient d’un concert està atent a la línia melòdica que dibuixa el violí, i aquesta és coberta per una percussió o quan, en un cafè, un soroll ambient cobreix la veu que estem escoltant. En aquests casos, tot i que el senyal està cobert de forma intermitent, el percepte associat a ell és continu. Si en laboratori treiem el fragment de senyal que és cobert per l’altre so, l’estímul és discontinu i en canvi el percepte és continu. Aquest fenomen ha estat anomenat illusió de continuitat auditiva. Aquest estudi es proposa d’entendre les bases neuronals d’aquesta il·lusió, combinant un estudi psicofísic amb resultats d’imatgeria cerebral obtinguts per Magnetoencefalografia (MEG).

BibTeX:
@mastersthesis{Llobera:Illusion:2004,
  author = {J Llobera},
  title = {L'illusion de Continuité Auditive. Une Étude MEG},
  school = {IRCAM - CNRS},
  year = {2004}
}
Llobera J, Blom KJ and Slater M ((in press)), "Telling Stories within Immersive Virtual Environments", Leonardo Journal.
Abstract: Portraying an unfolding story within an immersive virtual environment (IVE) is difficult: in an IVE, participants can pay attention to and interact with whatever they want within the immersive simulation. Moreover, the decisions taken by virtual characters must appear consistent with their personality and motivations, but also take into account the participants actions, whenever relevant. Finally, the result of the interactions should satisfy a pre- established plot. In this article, we introduce a new two-part approach that addresses the dilemma between freedom of action and narrative.
BibTeX:
@article{llobera_leonardo,
  author = {Joan Llobera and Kristopher J. Blom and Mel Slater},
  title = {Telling Stories within Immersive Virtual Environments},
  journal = {Leonardo Journal},
  year = {(in press)}
}
Llobera J, González-Franco M, Pérez-Marcos D, Valls-Solé J, Slater M and Sánchez-Vives MV (2013), "Virtual reality for assessment of patients suffering chronic pain: a case study", Experimental Brain Research. Vol. 225(1), pp. 105-117.
Abstract: The study of body representation and ownership has been a very active research area in recent years. Synchronous multisensory stimulation has been used for the induction of the illusion of ownership over virtual body parts and even full bodies, and it has provided experimental paradigms for the understanding of the brain processing of body representation. However, the illusion of ownership of a virtual body has rarely been used for patient evaluation and diagnosis. Here we propose a method that exploits ownership of a virtual body in combination with a simple brain computer interface (BCI) and basic physiological measures to complement neurological assessment. A male patient presenting a fixed posture dystonia featuring a permanently closed left fist participated in this case study. The patient saw a virtual body that substituted his own after donning a head-mounted display and thereby entering the virtual reality. The left virtual hand had the same posture as his corresponding real hand. After inducing virtual hand ownership by correlated visuo-tactile stimulation and dynamic reflections in a virtual mirror, the virtual hand would open either automatically or through a cognitive task assessed through a BCI that required him to focus attention on the virtual hand. The results reveal that body ownership induced changes on electromyography and BCI performance in the patient that were different from those in five healthy controls. Overall, the case study shows that the induction of virtual body ownership combined with simple electrophysiological measures could be useful for the diagnosis of patients with neurological conditions.
BibTeX:
@article{llobera_EBR,
  author = {Joan Llobera and Mar González-Franco and Daniel Pérez-Marcos and Josep Valls-Solé and Mel Slater and Maria V. Sánchez-Vives},
  title = {Virtual reality for assessment of patients suffering chronic pain: a case study},
  journal = {Experimental Brain Research},
  year = {2013},
  volume = {225(1)},
  pages = {105-117}
}
Llobera J and Slater M (2011), "A method for automated Decision Making", july, 2011. (EP11075169)
Abstract: This patent describes a method by which situated agents can be programmed to fulfill an arbitrary complex plan in a coordinated way. With such method, we combine the best of 2 existing approaches in artificial intelligence: fast reactivity and context adaptation as situated agents have, together with the achievement of complicated plans involving long term goals. This enables the practical development of interactive stories in immersive virtual reality, as well as other scientific and industrial applications.
BibTeX:
@patent{patent_llobera,
  author = {Joan Llobera and Mel Slater},
  title = {A method for automated Decision Making},
  year = {2011},
  number = {EP11075169}
}
Llobera J, Spanlang B, Ruffini G and Slater M (2010), "Proxemics with Multiple Dynamic Characters in an Immersive Virtual Environment", ACM Transactions on Applied Perception. Vol. 10: 1. October
Abstract: An experiment was carried out to examine the impact on electrodermal activity of people when approached by groups of 1 or 4 virtual characters to varying distances. It was premised on the basis of proxemics theory that the closer the approach of the virtual characters to the participant, the greater the level of physiological arousal. Physiological arousal was measured by the number of skin conductance responses within a short time period after the approach, and the maximum change in skin conductance level 5s after the approach. The virtual characters were each either female or a cylinder of human size, and 1 or 4 characters approached each subject a total of 12 times. Twelve male subjects were recruited for the experiment. The results suggest that the number of skin conductance responses after the approach and the change in skin conductance level increased the closer the virtual characters approached towards the participants. Moreover, these response variables were inversely correlated with the number of visits, showing a typical adaptation effect. There was some evidence to suggest that the number of characters who simultaneously approached (1 or 4) was positively associated with the responses. Surprisingly there was no evidence of a difference in response between the humanoid characters and cylinders on the basis of these physiological data. It is suggested the similarity in this quantitative arousal response to virtual characters and virtual objects might mask a profound difference in qualitative response, an interpretation supported by questionnaire and interview results. Overall the experiment supported the premise that people exhibit heightened physiological arousal the closer they are approached by virtual characters.
BibTeX:
@article{Llobera:Proxemics:2010,
  author = {J Llobera and B Spanlang and G Ruffini and M Slater},
  title = {Proxemics with Multiple Dynamic Characters in an Immersive Virtual Environment},
  journal = {ACM Transactions on Applied Perception},
  year = {2010},
  volume = {10: 1. October}
}
Llobera J, Spanlang B, Ruffini G and Slater M (2009), "Proxemics with Multiple Dynamic Virtual Characters", In Real Actions in a Virtual Environment (RAVE).
BibTeX:
@inproceedings{Llobera:Proxemics:2009,
  author = {Joan Llobera and Bernhard Spanlang and Giulio Ruffini and Mel Slater},
  title = {Proxemics with Multiple Dynamic Virtual Characters},
  booktitle = {Real Actions in a Virtual Environment (RAVE)},
  year = {2009}
}
Llobera J, Spanlang B and Slater M ((submitted)), "Virtual Body Ownership Influences Temperature Sensitivity", Journal of the Royal Society Interface.
BibTeX:
@article{llobera_temp,
  author = {Joan Llobera and Bernhard Spanlang and Mel Slater},
  title = {Virtual Body Ownership Influences Temperature Sensitivity},
  journal = {Journal of the Royal Society Interface},
  year = {(submitted)}
}
Pasqualini I, Llobera J and Blanke O ((in press)), "“Seeing” and “feeling” architecture: how bodily self-consciousness alters architectonic experience and affects the perception of interiors", Frontiers in Quantitative Psychology and Measurement.
Abstract: Over the centuries architectural theory evolved several notions of embodiment, proposing in the 19th and 20th century that architectonic experience is related to physiological responses of the observer. Recent advances in the cognitive neuroscience of embodiment (or bodily self-consciousness) enable empirical studies of architectonic embodiment. Here, we investigated how architecture modulates bodily self-consciousness by adapting a video-based virtual reality setup previously used to investigate visuo-tactile mechanisms of bodily self-consciousness. While standing in two different interiors, participants were filmed from behind and watched their own virtual body online on a head-mounted display. Visuo-tactile strokes were applied in synchronous or asynchronous mode to the participants and their virtual body. Two interiors were simulated in the laboratory by placing the sidewalls either far or near from the participants, generating a large and narrow room. We tested if bodily self-consciousness was differently modulated when participants were exposed to both rooms and whether these changes depend on visuo-tactile stimulation. We measured illusory touch, self-identification and performed length estimations. Our data show that synchronous stroking of the physical and the virtual body induces illusory touch and self-identification with the virtual body, independent of room-size. Moreover, in the narrow room we observed weak feelings of illusory touch with the sidewalls and of approaching walls. These subjective changes were complemented by a stroking-dependent modulation of length estimation only in the narrow room with participants judging the room-size more accurately during conditions of illusory self-identification. We discuss our findings and previous notions of architectonic embodiment in the context of the cognitive neuroscience of bodily self-consciousness and propose an empirical framework grounded in architecture, cognitive neuroscience, and virtual reality.
BibTeX:
@article{pasqualini_bars,
  author = {Isabella Pasqualini and Joan Llobera and Olaf Blanke},
  title = {“Seeing” and “feeling” architecture: how bodily self-consciousness alters architectonic experience and affects the perception of interiors},
  journal = {Frontiers in Quantitative Psychology and Measurement},
  year = {(in press)}
}
Pasqualini I, Llobera J and Blanke O (2012), "The ‘I’ of architectonic perception (Own body perception and bodily feelings in architectonic space)", In Academy of Neuroscience for Architecture Annual Conference.
Abstract: Emotional aspects of extra-personal space with respect to bodily feelings and architec- tonic space have been argued in the past. For instance, during the nineteenth century somesthetic and physiognomic affinities involving the observer’s empathic response to architecture were assumed to be the main aspect of the aesthetic experience [1, 2]. However, knowledge about how the interference of multisensory mechanisms with ar- chitecture may contribute to the human experience of the environment has remained sparse. Here, we address the question of how strongly tectonic elements, i.e. the walls, or a modulation of the architectonic interiors contribute to evoking specific bodily states. Recent findings in cognitive neuroscience revealed that visuo-tactile stimulation of sub- jects could induce a Full-Body-Illusion (FBI) during which self-consciousness was ex- perienced as being disrupted. Based on a previous paradigm involving body parts [3, 4], it was observed that self-identification (SI), i.e. the sense to own a body, and self- location (SL), i.e. the experience of the self at a specific position in space, can be altered through visuo-tactile dissociation and a virtual body seen in peri-personal space [5, 6, 7]. How does the shape of the architectonic interior modulate self-identification and self-location with respect to visuo-tactile association?
BibTeX:
@inproceedings{pasqualini_conf,
  author = {Isabella Pasqualini and Joan Llobera and Olaf Blanke},
  title = {The ‘I’ of architectonic perception (Own body perception and bodily feelings in architectonic space)},
  booktitle = {Academy of Neuroscience for Architecture Annual Conference},
  year = {2012}
}
de la Peña N, Weil P, Llobera J, Giannopoulos E, Pomes A, Spanlang B, Friedman D, Sanchez-Vives MV and Slater M (2010), "Immersive Journalism: Immersive Virtual Reality for the first Person Experience of News", In Real Actions in a Virtual Environment (RAVE).
BibTeX:
@inproceedings{Pena:Immersive:2010,
  author = {Nonny de la Peña and Peggy Weil and Joan Llobera and Elias Giannopoulos and Ausias Pomes and Bernhard Spanlang and Doron Friedman and Maria V. Sanchez-Vives and Mel Slater},
  title = {Immersive Journalism: Immersive Virtual Reality for the first Person Experience of News},
  booktitle = {Real Actions in a Virtual Environment (RAVE)},
  year = {2010}
}
de la Peña N, Weil P, Llobera J, Giannopoulos E, Pomes A, Spanlang B, Friedman D, Sanchez-Vives MV and Slater M (2010), "Immersive Journalism: Immersive Virtual Reality for the First Person Experience of News", Presence: Teleoperators and Virtual Environments., August, 2010. Vol. 19(4), pp. 291-301.
Abstract: This paper introduces the concept, and discusses the implications of Immersive Journalism, that is the production of news in a form in which people can gain first person experiences of the events or situation described in news stories. The fundamental idea of Immersive Journalism is to allow the participant, typically represented as a digital avatar, to actually enter a virtually recreated scenario representing the news story. The sense of presence obtained through an immersive system (whether a Cave, head-tracked head-mounted displays (HMD) and online virtual worlds, such as video games and online virtual worlds) affords the participant unprecedented access to the sights and sounds, and possibly feelings and emotions that accompany the news. The paper surveys current approaches to interactive journalism, theoretical background supporting claims regarding avatar experience in immersive systems, and describes a specific demonstration: giving participants the experience of being in an interrogation room in an offshore prison.
BibTeX:
@article{Pena:Immersive:2010a,
  author = {Nonny de la Peña and Peggy Weil and Joan Llobera and Elias Giannopoulos and Ausias Pomes and Bernhard Spanlang and Doron Friedman and Maria V. Sanchez-Vives and Mel Slater},
  title = {Immersive Journalism: Immersive Virtual Reality for the First Person Experience of News},
  journal = {Presence: Teleoperators and Virtual Environments},
  year = {2010},
  volume = {19},
  number = {4},
  pages = {291-301}
}
Salomon R, Lim M, Kannape O, Llobera J and Blanke O ((submitted)), "“Self Pop-Out”: Agency enhances self-recognition in visual search", Experimental Brain Research.
BibTeX:
@article{salomon_pop_out,
  author = {Roy Salomon and Melanie Lim and Oliver Kannape and Joan Llobera and Olaf Blanke},
  title = {“Self Pop-Out”: Agency enhances self-recognition in visual search},
  journal = {Experimental Brain Research},
  year = {(submitted)}
}