Why explainability is a requirement, not a feature
An unexplainable score fails at exactly the moment it matters. Three groups will ask why, and none of them accept a number on its own:
- The analyst triaging the alert, who needs to decide in seconds whether it is real.
- The employee who was blocked, who will escalate if the reason is not clear and defensible.
- The auditor or regulator, who under frameworks like the EU AI Act expects demonstrable, documented reasoning behind automated decisions.