Starting
Mouth — MIDI — Note —
Looking for your face…
Make sure your face is clearly visible to the camera.
camera • face tracking • landmarks
Behavior
Instrument
Surface
Input
5
Samples
Surface
Sound Quality
0
Expression

Use Squint?

Squint Velocity uses both wink gestures. Their current mappings will be temporarily reserved.
Sound intensity
Movement speed 35

Faster facial movement starts the note more strongly.

MIDI velocity ranges from 1 to 127.

5
35
127
Curve· Linear
Vibrato
0.82
9
5
0.4
0.0 Hz · 0% depth
Manual Calibration
Automatic Calibration
Sound Controls
Local sound
Tutorial
Presentation
Gesture Mappings Notes 6 · CC 0 · Muted 0
Gesture
Raw
MIDI#
Note
Calibration
Mute
Solo
CC
Notes
Trigger / Sample
Boca
0
Sonrisa
0
Guiño Izq.
0
Guiño Der.
0
Nariz X
0
Nariz Y
0
MIDI off
About MIDImyFACE

What is MIDImyFACE?

MIDImyFACE is a browser-based musical interface that lets people make and control music using facial gestures, computer keys, or MIDI devices. It can produce sound directly in the browser or send MIDI to compatible music software and hardware.

What can you play?

Play Notes, build Chords, trigger Percussion, or shape a continuous Synth. Musical expression and MIDI CC can respond to movement, while Browser Audio (Local Sound) lets you listen immediately and MIDI Out connects the performance to compatible software or hardware.

How can you control it?

Choose Face, Keys, or MIDI as the musical input. Face features can turn facial movement into notes, rhythm, expression, or MIDI CC. Keys and MIDI can supply pitches while selected facial mappings shape expression. Camera access is needed only when a Face-controlled feature is being used.

Things you can do

  • Play melodies or chords with facial movement, a computer keyboard, or a MIDI controller.
  • Use Keys or MIDI for pitch while facial gestures shape expression or control MIDI CC.
  • Explore percussion, harmony, scales, chord progressions, rhythm, and improvisation.
  • Give participants different musical roles in classrooms, workshops, and collaborative activities.
  • Use it for interactive performance, creative coding, sound art, and installation contexts.
  • Explore alternative or hands-free approaches to musical interaction.

Networked sessions

Hosts can prepare a MIDImyFACE session and assign musical configurations or roles to participants. Participants join from their own compatible devices and perform using the input assigned to them.

Research

MIDImyFACE was presented at the 2025 International Computer Music Conference (ICMC). MIDImyFACE: A Web-Based Facial Gestural Interface for Real-Time Music Performance and Control.

Created by Ricardo Arbiza.

MIDImyFACE

How to play

Choose what you want to play, then how you want to control it. MIDImyFACE can use your face, computer keys, or a MIDI device.

01

Choose what you play

  • Notes: play single pitches.
  • Chords: turn pitches into harmony.
  • Percussion: trigger one-shot sounds.
  • Synth: control a continuous synthesizer.
02

Choose how you control it

  • Face: use facial movement and gestures. Face input requires camera access and calibration.
  • Keys: play with your computer keyboard. The camera is not required unless you also use a Face-controlled feature.
  • MIDI: play from a MIDI controller. Pitch and velocity can come directly from your device; Face can still be added for expression or CC when desired.
  • Available inputs change with the selected musical behavior.
03

Shape the result

  • Choose an instrument, percussion kit, or Synth sound.
  • Use the available surface — Piano Roll, Grid, or Wheel — when the selected behavior supports it.
  • Shape dynamics and expression, and optionally map a Face gesture to MIDI CC.
  • Choose Local sound to hear MIDImyFACE in the browser or MIDI Out to control compatible software or hardware.
04

Play together

  • Join Session: enter a hosted MIDImyFACE session and perform with the configuration assigned to you.
  • Host Session: prepare Seats, assign musical roles and inputs, and manage the ensemble from the Console.

If something does not respond, check Camera or MIDI permission, Local sound, your selected input, and — for Face control — lighting and calibration.