XR_Unites
The workshop “Art meets Tech meets Business” on 21.11.22 in cooperation with the business professionals Angela Höhle from the Gründungszentrum of HTW Berlin, Jana Pyrek and Christopher Purbst from IDiA – Ideas in Action was super intensive and informative. Twelve participants worked on startup ideas in different stages: We are excited to see which startups might really get off the ground soon!
On 25.07.2022 the XR_Unites jury decided for the collaborative development of the “Sci-Fi Mini-Opera” with Virtual Reality AM ENDE DER WELT (WT) based on the concept of Nora Krahl, Amir Baltic, Lisa Ströckens, Vincent Kaufmann and Matin Soofipour Omam (last both advisory). More info on the XR_Unites fellows from September 2022 to June 2023 can be found here.
Our third and last XR_Unites XR Art & Networking was so nice!!! With best weather, exciting impulse talks and coffee mobile, almost 80 people from art, culture and informatics exchanged ideas about XR technologies in the independent cultural scene at Köpenick Castle and its park.
(Photo: © M. Stark, HTW Berlin)
On June 23, 2022 the first public preview of the VR multiplayer XBPMMM took place as part of the XR_Unites XR Art & Networking in and around Schloss Köpenick. The artists* Janne Kummer and Anton Krause were present. A prototype of the artists’ suit equipped with sensors and actuators could also be tested: In a feedback loop, it collects body data of the user*s and returns it via physical computing (e.g. via heat or small electrical impulses) in coordination with the VR experience.
(Photo: © M. Stark, HTW Berlin)
The XBPMMM meeting on 01.12.21 started with a guest presentation by AURORA developer and media computer scientist Leonid Barsht about locomotion, interaction and user interface in virtual reality.
During the following discussion it became clear that we will probably test some VR applications as references for locomotion and interaction in the near future – we will keep you posted! For XBPMMM a combination of different locomotion and interaction possibilities (possibly depending on the level of the multiplayer) is planned.
And traraaaa: At this meeting the Unity project was restructured based on the preliminary work of Janne and Anton. That means that now – parallel to the development of the storyboard – we can start with the development!
The focus of storyboard and development is first on level 0, where you arrive, and the third and thus last scene – both in combination with the softrobots and the MQTT protocol. The goal is to think and develop the (browser-based) WebGL and VR multiplayer in parallel.
At this meeting, our new expert board member Sebastian Keppler presented the BMBF-funded research project VitraS, in which he is involved as a project collaborator (lead at HTW: Prof. Habakuk Israel, also expert on the board of XR_Unites).
The focus of VitraS is on virtual reality therapy by stimulating modulated body perception, for example in obesity patients – it is thus a true embodiment project in a medical context. Based on Sebastian’s talk, a mutually fruitful exchange developed at the intersection of art, humanities, informatics and health.
Common topics were, for example, normative body images and barely existing »marginal body forms« in the digital world, facial expressions of avatars, counter-gendered hand models, body awareness and the potential of the mirror – symbolizing self-knowledge in visual art – to mediate perception of one’s own (avatar) body. The fact that body images are always mediated by media was also discussed – a fact that has enormous relevance for body perception in times of Instagram face filters and remote conferencing and reinforces the often unhealthy orientation towards idealized norms in our contemporary Western society.
VitraS is a cooperation of HTW Berlin with the University of Würzburg (lead), University of Bielefeld, SRH University of Health Gera, The Caputry GmbH, TU Munich, brainboost GmbH, CBMI.
We thank Sebastian Keppler for the great lecture and exchange!
For more info on the VitraS project, see here.
XBPMMM (AT) addresses a huge range of exciting computer science areas – most of which have to do with embodiment experience in VR. On 10/27/21, the second meeting on this took place at the Research Center for Culture and Informatics (FKI) at HTW Berlin. The artists shared their experiences with the MQTT protocol, we played the already developed WebGL multiplayer, Janne Kummer brought softrobot forms cast out of silicone and skills, responsibilities and necessary technologies were important topics.
Potential work areas for further development:
The concept of the mixed reality installation Transient Exposure won our first Open Call in early 2021. We interviewed Isabel Robson, Mareike Trillhaas and Susanne Vincenz – as the artist collective reVerb they are behind the project idea in cooperation with the Chitrasena Dance Company (Colombo, Sri Lanka).
XRU: How would you describe your collective?
Isabel: We see ourselves as a video art collective. We explore spatial imagery in relation to performance. Over time, technologies have changed and so now we are on our first attempt with Mixed Reality (MR).
XRU: How did the collective come about and what was your vision at the time?
Susanne: reVerb was always linked to the question of how to integrate documentary material as a moving image in a live performance. This has evolved piece by piece over time. We worked with different artists internationally, on urban development in China, on the protest movement in Iran, and the videos took on a three-dimensionality in connection with the performance. This led to the next step, which was to think more in terms of installations.
Starting with György Kurtág’s Kafka fragments, we had an installation at the Jewish Museum in 2013. That was our first joint work as reVerb.
XRU: And then joined Mareike. Right?
Mareike: Exactly. I already knew Isabel from other projects. We met for the first time at the Maxim Gorki Theater and then sporadically did some smaller things together. I joined reVerb last year.
XRU: Transient Exposure is your new project in cooperation with the Chitrasena Dance Company in Sri Lanka. How did this collaboration come about?
Isabel: I was lucky to spend three and a half years of my childhood in Sri Lanka. Every Saturday morning, my mother and I attended the Chitrasena dance school.
There was a fascination with the movement and the music from that time. reVerb, meaning reverberation, is the program in this respect. After several visits in recent years, we are now in the middle of a joint project. The collaboration with XR_Unites is one chapter of this rapprochement and collaboration.
XRU: What is the appeal and potential of Transient Exposure for you?
Isabel: I have a great desire to experiment with HoloLens 2, the mixed reality glasses. Compared to the closed virtual reality experience, MR offers more possibilities for integrating a live performance. In this first stage, we won’t be able to work with live performance. It’s more about user interactivity. But what’s exciting is that content is spatially anchored and that you as a user decide what you see and what you don’t. And above all, the answer to the question: What can this technology of live performance bring on a scenographic level – and what not?
XRU: What can the audience expect?
Mareike: I imagine it so far like a mixture of claimed communication and real communication, because the dancer is supposed to connect with the people who are also in that space. Since it’s not live, the communication can’t really be direct. But by being able to use gesture control or maybe acoustic control, there is still that kind of interaction. The communication can still be between the two or three people who are watching and listening to it. And then there are also these levels between times, because the past also plays a role, and between places like Sri Lanka and Berlin.
XRU: You have chosen a form of presentation in which dancers are represented as point clouds. These can give the impression that what is represented with them is not tangible – it can also easily disintegrate or dissolve. Why this decision?
Isabel: Our title suggests that. There were always encounters of the Chitrasenas through tours and travels between their traditional dance and other stage artists in the Soviet Union, also here in the former GDR, for example with Gret Palucca. For a moment there is an exposure – one is exposed to another language or art form. What remains of the actual dance? That’s a question we ask with the Chitrasena Company archive.
The Point Clouds move away from photorealism, and if you really want to focus on movement, then an abstract form is more appropriate.
XRU: The application will not only bring together dancers from different generations, but will also let the rhythm of traditional Sri Lankan dances like the Kandy Dance play a central role. How do you coordinate the music of old choreographies with new ones?
Susanne: In fact, they are the same choreographies that have been passed down through three generations. These are dances that came from the ritual contexts of Sri Lankan tradition and then were adapted for the stage in the 1940s. They were further developed by the women of the company and passed down through three generations. We work with overlays that are meant to make these layers of time visible. Thaji Dias still dances the choreographies that her grandmother danced in a different way.
XRU: Will this overlay also be in the music?
Mareike: It will be a mix between new and real sounds from Colombo. The heavy traffic, for example, plays an important role. But there can also be more abstract sounds that don’t reflect one-to-one how it is now or how it was, but that awaken associations. It can be sounds of costumes – there is a costume with a lot of metal that is very noisy. I’d like to integrate something like that, too.
XRU: To what extent will the political-historical context factor in, for example the Civil War?
Isabel: Political background, also where the country is right now, is important. We learn about the hurdles and challenges that each generation has experienced. When we look at the work of Upeca Chitrasena in the 1980s, it’s in the context of the beginning of the civil war, which lasted so long.
Susanne: I think that in Transient Exposure you can’t directly experience such a complex background. But what you might get is that it’s a transitional situation. Basically the questions: What is the place of this dance today in Sri Lanka? To what extent does it have something to do with contemporaneity? What does this dance tell today? What does it trigger? Where is its place? That is something that we are also trying to convey with the MR installation.
XRU: What will happen with Transient Exposure after the XR_Unites grant?
Susanne: We will definitely take it to Sri Lanka. There is a possibility that it will be shown in different places on the island. We are in contact with various institutions, including the Goethe-Institut. One of the challenges in this collaboration is actually to develop something that can work for an audience in Sri Lanka as well as in Germany. And perhaps this new technology is particularly well-suited for this purpose, because neither we, nor an audience in Sri Lanka, have had so much contact with it so far.
The interview was conducted by Laura Magdaleno Amaro from XR_Unites on 03.03.2021.
TRANSIENT EXPOSURE is a dance and research project in mixed reality. It is a collaboration between the artists’ collective reVerb and the dance company Chitrasena, Colombo (Sri Lanka) – and from January to September 2021 also in collaboration with XR_Unites. Across the distance, it is an attempt to bring together five female artists on different continents. Mixed Reality (MR) becomes a testing ground for a working process with the long-term goal of combining live performance, interaction and mediality. The purely digital installation planned for September 2021 will be a station on the path of realizing TRANSIENT EXPOSURE. A live performance in Colombo and Berlin, planned for 2022, will be another stage.
Based on the archive of the Chitrasena Dance Company in Colombo, Sri Lanka, TRANSIENT EXPOSURE asks about contemporaneity in dance. Since the island’s independence in 1948, the women of the Chitrasena family have led the company in the third generation, through the civil war (1983-2009) to a globalized present that brings Lankan Kandy dance to the brink of disappearance. In the planned installation, the artists explore the changing environment of the company, the search for a place for their dance and the struggle for renewal.
The collaboration with XR_Unites aims to experiment with the possibilities of MR and to make dance experienceable in a new way beyond the classical live performance. For this purpose, a sensual-virtual format will be developed that allows users to explore the different layers of time, to experience the three generations of dancers together and to participate physically. Tactile sensory experiences as well as Colombo’s heterogeneous sound backdrop are of central importance here – and connected to this is the tension between live experience and augmented scenography. Digitized images and film footage of the three dancers from different periods are available – both historical and current footage. They form the basis for a 3D montage that will be accessible via the Hololens 2 in Mixed Reality.
The project is funded within the framework of XR_Unites by the European Regional Development Fund (ERDF) in the INP-II program. It is also supported by the national performance network (npn) – stepping out, funded by the Federal Government Commissioner for Culture and the Media as part of the initiative Neustart Kultur. Aid Program Dance.
