Then it seems like this is another caveat of XCache, since the code used for the various cachers is for all intents and purposes identical except for what functions it calls (i.e. XCache calls xcache_get() etc) to grab and set the cache.
Would it be possible for you to try APC?