Naomi questions at start
Is your piece intended to be game engine or 360 video based and why? I’m most interested in interaction/movement and think it applies well to the project goals and I see game engines as providing more options in this area than 360 video which can be more passive. My skillset and career ambitions are more aligned with game engine than 360 video 360 video does provide a great way of capturing an environment and events within it, so if the scene you want to capture exists in the real world this can be a lot quicker/cheaper than recreating it in a game engine. 360 video is also much easier to distribute (works on lots of devices), although I think the research papers already provide an easy to distribute option. Are you intending this to be a VR or MR experience?
Undecided but needs resolving via a tech spike into the options once I have narrowed down the visual aesthetic and interaction design. MR provides better options for encouraging movement but can be visually limited compared to VR as its virtual objects have to compete with the real world. I would like to try a tech spike that combines the two, e.g. begin in MR to get used to it, then use a semi-transparent overlay over the pass-through video to provide a VR backdrop to make virtual elements visually more compelling.
How wide or narrow will your focus be on specific types and locations of injury?
Planning to keep the type/location of injury out of the experience, as the Storying Sports Injury Experiences narratives don’t apply to specific injuries, other than they are injuries (physical and mental) that affect a runners ability to perform. Some injuries may be too severe to be catered for by the narratives, e.g. looked at narratives applying to rugby players who suffered life-changing spinal chord injuries which are different to the narratives in Storying Sports Injury Experiences. How adaptable is your piece likely to be to different types of injury?
A good question and I do have some concerns around accessibility and injuries, e.g. I don’t want to get user to do something that isn’t possible because of their injury. Originally I was thinking of asking where the user was injured to tailor the experience for them, but now I’m thinking maybe it can be done by offering different types of locomotion (walk around vs seated teleport), interaction (hand grab vs ray cast to grab) and adjusting the height of intractable objects (e.g. seated/wheelchair vs standing). Due to time constraints another approach is to call out the types of injury it currently is and isn’t suitable for.
Do you have a specific first person story or stories in mind to hang the narrative on?
The research has short quotes of athletes they interviewed about injury stories I have emailed to ask if I can use. I hadn’t thought of having something more advanced like a single story or perhaps writing a story based on the interviews. This wasn’t something I was looking to cover due to other responsibilities but Rebecca is keen to help with dramaturgy and storytelling. Might see if I can get longer excerpts of athlete stories from the research.
Will the participant be in the first-person POV of the athlete whose story is being told?
I had seen it as a third-person experience where you explore different athletes stories at a distances, but that is probably just because that is how the research videos approached it. The first-person POV is an interesting twist and I will add a question about 1st vs 3rd person POV
How will you address their embodiment?
If it was 1st person POV, the camera angle would assist with embodiment. Other ideas:
Selecting which athlete to embody via an object or clothing that you can then see on you in the scene, e.g. reflection in water or a watch on your virtual hand, looking down to see virtual running shoes on you Interacting with objects that are personal to them or feature in the audio of the athletes story, or perhaps represent an abstract concept (e.g. pushing the snowball that increases in size to represent the athletes problems getting worse) Use a virtual filter of some kind that alters the pass-through video representing how the embodied athlete sees the world, e.g. rose-tinted soft focus for happiness and balance or sharp, pixelated monochrome for negative thoughts What kinds of movement will alter their experience if any?
I’ve added a question () which I’ll explore next week around movement/interaction How will the injury and recovery aspects be simulated?
The athlete stories in the research don’t tend to be specific about injuries or recovery programmes, presumably so people don’t get caught up on technical aspects of the injury/recovery and that their experiences can apply to a wider range of injuries where the experience is similar if not the exact injury? So I think I will follow that approach. This may change if I decide to create a more detailed narrative around a specific athlete
What are your thoughts on simulating weight and lifting?
This is tricky in XR and virtual objects are effectively weightless, it’s not easy measure muscle tension and muscles work better when an object has real weight and gravity acting on it. As I understand it an EMG can be used to measure muscle activity which could be quite interesting but probably too much of a divergence for this project. Haptic feedback sometimes adds to the physicality of an object, but not weight specifically. A lo-fi way I have seen of emulating weight is by having to grab object via controller trigger for a set amount of time before it can be released and lifted, with some kind of audio/visual feedback to simulate muscular effort which the controller trigger is down (e.g. Gauge in ). This could map to hand tracking via a fist hand pose perhaps. Just did a quick Google and there is a VR experience, , that uses real weights in the experience. With MR it would be possible to use real objects and track them as virtual objects. How could you calibrate this to differing levels and severities of injury?
Raycast vs direct hand manipulation, although I’m not sure how you simulate weight with a raycast
Will the experience be gamified in the sense that they can 'win' or progress by using it? If so how?
Hadn’t thought about gamification, it would be useful to reward the user for progressing through the experience, but I am aiming for an exploratory thought-provoking experience so the gamified elements might be quite subtle? Current user journey is something like this
Consultation scene: user is asked questions about a recent injury to understand which of the 6 socio-cultural narratives is closest to their current approach to injury. Would use rich interaction and movement to get answers from user (e.g. virtual objects float around space that represent different injury narratives; user is asked to move and grab one that represents their injury experience, then talk about why. Interacting with 3D objects could play audio of athlete's stories) 2. Current narrative scene: based on user's answers in consultation the user can progress to a scene explaining one of the 6 injury narratives that is closest to their current approach to injury (e.g. interaction and audio/visuals could be used to illustrate abstract concepts, so "Snowball" could include a virtual snowball the user has to roll to across the room that grows in size and plays audio about that narrative) 3. Alternative narrative scene: based on user's answers in consultation the user can progress to a scene explaining one of the 6 injury narratives that prioritises physical or mental health to provide contrasting story for the user to consider 4. Ending: unsure of this but somehow to help user formulate their thoughts on the experience / reframe their injury experiences / come up with new approach for injury in future I don’t have any ideas currently but looks like there are some opportunities to use gamification to encourage progression / discourage drop-off
What narrative devices do you think will be the most useful in taking your audience members/ players on the kind of emotional and cognitive journey that will make your piece useful to the target audience?