I think lawyering is pretty ok fine and dandy on a rules forum, just not at the table during the game.
I enjoy theory crafting and white paper experiments and rules lawyering on forums and before/after the game. When in game if I disagree with a GM I give them my take on the rule in a single sentence, and then accept whatever the GM says. As a GM I give my players about 10 seconds to say what they have to say (I forget rules sometimes, reminders from a player don't hurt), then make my ruling and keep the game moving.
My own personal recommendation is 60 seconds. If you can't recall, can't find, or can't agree in 60 seconds, the GM makes the call, game moves on. If it's important and may come up again, write it down and take it to a rules forum or sit around digging through books trying to find something after the game.
On topic, I agree that the RAI is that no possibilities can be used and the rule is simply pointing out the specific cards that can't be used for the test. Cards that don't spend possibilities can be used, IMO. The possibilities from say a Glory card can't be used either IMO even though it's not specifically called out.