OK, I checked everything . Reset my private forum to deny all except for mods and admins and still when I log out I can see private forum posts in the last 5 posts in the info panel. Even cleared all my caches. I am bumfuzzled.
ETA: I think it had to do with the refresh time after logging in and out. I'll make a test member and see what happens.