Human-in-loop Collaboration