Delaying item drop states in a Drag & Drop interaction

My interaction consists of 9 rectangle items that each will be dropped on 1 of 2 drop targets.  Each rectangle has 3 states: Normal, Drop Correct, and Drop Incorrect.  Everything works great when I leave the 'Delay item drop states until interaction is submitted' check box UNCHECKED.  However, I would like to delay the state change until the interaction is submitted, but when I check that box, the states no longer change when submit is clicked.

Is there more to this?  Do I need to add triggers to make this work properly?  It seems like it should be so simple!