Fix NPE when setting a player's spectator target
Uses an EnumMap as well as a Set paired List for O(1) contains calls