Returning Matrix Value based on two table selections

Hi,

I am trying to return a value in a risk matrix based on selections made in the previous 2 slides. The final slide has rows A-F and columns 0-5. Each rectangle in this matrix has a Normal and Selected state.

The previous two slides have a matrix, one with a set of values for A - F and the other with a set of values for 0-5. 

I need the final matrix to show the risk rating according to the highest selected values in matrix 1 (F highest) and matrix 2 (5 highest).

Currently I have set up the first two matrixes to have object triggers on all selected values, e.g:

The final slide has a slide trigger for each rectangle to change state, e.g.:

This is working to a degree... however, the last selected objects on the first two slides are the over-riding triggers. That is, it's returning the value A0 because these were the objects selected last. But I need it to return the highest value. I have tried re-ordering triggers, but this has not helped. I have also tried grouping triggers by 'When' clause, but this hasn't solved it either.

Wondering if anyone has any suggestions or perhaps a better way of doing this?

Thanks