I went ahead and turned off server side caching in Drupal. It seemed to be causing problems by caching the captcha output, resulting in a few problems for anonymous users.