To Design through Gestures (at scale 1:1) | Florence, Italy | Unit 21 | 2023

This project investigates the potential of virtual reality (VR) as a tool for comprehending spatial design across multiple scales. The exploration of this process commenced last year, using a diverse array of accessible tools to facilitate 1:1 scale design within a VR environment. Further experimentation was undertaken in the current year by also incorporating movement and gestures in the design process. A systematic methodology was used to examine the integration of traced gestures into the design of buildings, thereby enabling its applicability to a broad spectrum of programs, as exemplified in this case, the gestures of Italian chefs for the development of a cooking academy in Florence.

By using augmented reality (AR) in conjunction with a projector, the gestures were traced, subsequently scaled and integrated into the design. For example, the act of peeling became the foundational concept for the roofs, while the varied vegetable chopping actions informed the cuts of the stone panels. After creating an index with all the gestures, projections of 10 to 60 second delay were used in order to recreate these gestures at scale 1:1 for as many times as needed within the building.

Initial Experiments in VR at Scale 1:1
In the beginning of the project, a series of experiments were conducted where the user could position themselves inside different meshes in order to manipulate and carve them from the inside.

Transposing Italian Recipes within the Design
After choosing a series of clips with Italian recipes, a projector was displaying them on the wall in front and by using the AR feature of the headset the user was able to trace the gestures of the chefs and transform them in surfaces.

Gestures as Architectural Elements
After re-enacting a series of recipes, each gesture was modified to a new scale and became an architectural element. An index of gestures was created in order to later be used and traced at scale 1:1 for as many times as the user needs to.

10-60 Seconds Delay to Design at Scale 1:1
A computer script facilitated the accurate reproduction of these rescaled gestures at 1:1 by using a live feed of the user with a 10 to 60 second delay and projecting their gestures on the wall so they can be traced for as many times as needed.

To Design through Gestures