With no reliable place to record, the Caucasian Boys once again used video as an artistic means with "Cheese." The full name of the album was going to be "Cheesy Album," but the title was shortened.

The album was played live, and recorded simultaneously through Matt Pool's video recorder and an audio tape deck. The original release of Cheese was a two-sided cassette, with the programming repeated in full on both sides.