Machine learning-based human observer analysis of video sequences