It sounds to me like your VM's could be generating enough disk activity to cause the hypervisor console, which is using the same disks, to become unresponsive. It is possible that the kernel just can't process the management quickly enough due to the latency on the disks, resulting in vCenter losing the management connection temporarily.
Does this seem to follow certain windows, like backup processing for example?