Welcome to Netz
Netz is an AI-powered, hand-controlled XR musical instrument that
enables musicians to learn, play and create music and control studio
software in mixed reality. It uses AI algorithms for real-time tracking
of hand gestures, leveraging them for musical expression.
Try out the demo below!
Use your mouse to control the camera and hover over the nodes to play a note.
Can you figure out the relationships between individual nodes?
Hint: If you're on mobile, touch the nodes to play a note,
rotate with one finger, and move around with two fingers.
Hint 2: If you're on iOS, make sure to set the
Ring/Silent switch on the side of your device to Ring (with
headphones you're fine).
Note: Make sure you turn on the sound before you start.
Features
This is just a simple example of what Netz can do. The full version of
Netz has the following features:
Full XR integration
Netz is a fully integrated XR experience, allowing you to create, record
and perform music in XR. It has its own
sound engine running on-device, which ensures maximum performance
and low latency. There's several presets to choose from, and you can
create your own sounds and upload them to the instrument. Netz runs on
Meta Quest headsets and will support the Apple Vision Pro in the future.
However, it is not a VR instrument: while you play, you can still see
the real world around you, talk to people and interact with your
environment.
Hand tracking & gesture recognition
Netz uses machine learning algorithms that enable real-time tracking of hand
gestures, leveraging them for musical expression. Netz can recognise a variety
of hand gestures and use them to control the musical elements within the
instrument. You can also create your own control gestures for playing, recording
and performing music.
DAW Integration
Netz integrates seamlessly with modern digital audio workstations (DAWs)
like Ableton Live, Logic Pro and FL Studio. It comes with a VST plugin that
allows you to control synthesizers and effects through MIDI messages.
Advanced note layout
Netz uses a unique note layout developed specifically for the instrument.
For this, we have collaborated with a musician and music producer to create
a layout that enables you to play scales and chords in an easy-to-learn way.
Notes in Netz have MIDI MPE capabilities, enabling performers to individually
control their dynamics, pitch bend and timbre, as well as other assignable
attributes.
Customisable
Netz is fully customisable, allowing you to create your own gestures and
map them to features of the instrument.
Netz in action
To get a better idea of what Netz can do, check out the following videos.
Performance
See a short performance of Netz in action, recorded at Queen Mary University of London. This was recorded live through the headset!Features & Scenarios
Check out a demonstration of Netz's features and the different ways in which it can be played. The video walks through ideation, external synthesizer control and performance.Performance
Listen to another piece written for Netz.Testimonials & Awards
Get Started
We are working hard to finalise the development of Netz and make it
available for the Meta Quest and Apple Vision Pro platforms later this
year. Sign up to our
to be the first one to know when Netz is available.
In the meantime, you can follow us on here:
Contact
Please get in touch! Send us a message on Twitter here or here or email us directly.