← All things

Creative coding · Computer vision

Scribble Face

A camera that scribbles over your face, until someone else comes close.

One idea built twice, three years apart, in two creative coding courses. The first version finds a face and covers it in scribble. The second tracks several faces at once and draws lines between people who come close to each other.

Scribble Face

A face, covered

Written in Processing, on top of an OpenCV face detection example. Each frame, the sketch draws 400 to 1,000 random lines inside the box around your face. I packaged it as a Mac app and ran it in the school building at SAIC, filming what it did to the people who stood in front of it.

Two faces, linked

Rebuilt in p5.js with TensorFlow.js face landmarks. Alone, your face is scribbled over. When two faces come within a set distance, lines connect them, and the color shifts with the number of people in the frame.

The 2022 sketch in the p5.js editor: code on the left, and lines linking my face to a face on a phone on the right.
The 2022 sketch in the p5.js editor: code on the left, and lines linking my face to a face on a phone on the right.
In the exhibition: a wall monitor with a webcam on top and a Mac mini below. Lines link two faces.
In the exhibition: a wall monitor with a webcam on top and a Mac mini below. Lines link two faces.

From a box to landmarks

In 2019 a face was a rectangle, and the scribble stayed inside it. In 2022 a face is a set of landmark points, and the lines are drawn from those points, so they follow the shape of the face and can reach across to another person. The question moved too: from what happens to one person on camera to what happens between two.

← Back to all things