Ecology, physiology and performance in high-rate anaerobic digestion