O.J. Simpson's controversial prank show was supposed to be a joke ... but production wasn't funny -- in fact, his costar says ...