Hiltswaltå is a prototype that explores jam sessions between human musicians and AI, with a focus on voice-based control and physical feedback. It was developed in collaboration with Pien den Hollander and Thunderboom Records as part of the Get Back project. Musicians interact with the system using spoken commands, audio input, and light cues, allowing them to guide the AI without breaking the flow of playing. The design stays close to familiar musical electronics, keeping the interaction clear and practical. A later iteration keeps the same interaction model but changes the embodiment by using a mannequin as the body of the system. This version uses Magenta’s MelodyRNN model, allowing for more complex melodic output with slightly slower response times. The change in form and timing affects how musicians interact with the system.




