Using a lot of cardboard and hot glue, Brie Musser and I created a coffee machine to use as a controller for the pico-8 game Coffee Maker by creator shinpansen.
Originally, all of the markers were visible from the front. There are 8 ingredients in the game, and players must use x and the arrow keys to add ingredients to a drink. The idea was that players would have to interact with levers, drawers, pull tabs, and an espresso cup to reveal the markers and add ingredients.
To make it easier for the camera to see the symbols, we rearranged the controls so that all markers were visible from the backside of the coffee machine. We also changed some of our ingredient controls, like switching pull-out tabs for knobs and levers. The controller works by hiding and showing the different markers to the camera as the player interacts with each control.
In order to create a variety of interactions, we added a lever and a knob for cream and chantilly.
We then painted the coffee machine silver and black, and added images and labels for the different ingredients. The water and the espresso components did not have graphics added. We used a plastic bottle for the water and painted our original cardboard espresso cup.
The player sits in front of the controller anbd looks through it at the screen, while the webcam views the markers from the back.
A coffee cup is used to control menu buttons X and C
For the hot water ingredient, a plastic bottle rotates
Milk and whiskey are levers of cardstock that fold in from each side. The graphics are seen when they are folded in, and the aruco markers are visible on the backs of each graphic.
Sugar and cacao are controlled by opening and closing drawers, and the graphics are visible both on the front of the drawer and on the tops of he drawers when they are pulled out. Aruco markers at the back of the machine are pushed down (hidden) when the drawers are pulled out.
Cream and chantilly appear from the top, as a rotating knob and a lever. The knob controls a stick that rotates the cream graphic down from the back of the machine, simultaneously uncovering a hidden aruco marker. The lever is a stick that can be pushed up and down, bringing with it a graphic of a whipped cream can and revealing a hidden aruco marker on the back of the machine. The graphic never fully disapeared when it was "off" but instead shows the nozzle vs the whole can.