Free Kitten began in 1992 in New York as a vehicle that would allow Sonic Youth's Kim Gordon and Pussy Galore's Julie Cafritz to pursue other projects away from their usual work with their respective bands. Guitarist Cafritz and bassist Gordon began playing out, offering their audiences short sets of post-punk numbers. They put out Call Now/Straight Up later that year, and proceeded on the Lollapalooza tour. Their singles include "Oh Bondage, Up Yours," which was originally done by X-Ray Spex. Yoshimi, of the Boredoms, joined the group in 1993, contributing harmonica, trumpet, and drums, as well as occasional vocals. Bass player Mark Ibold, of Pavement, came aboard the following year.