The traffic-light tool: where AI doesn't belong

Describe one AI use you're considering and answer the questions. The classification uses only the criteria in the essay "Where AI Doesn't Belong": any red criterion makes the use red, and green requires every green condition to hold. Your answers aren't stored anywhere — they stay in your browser and in the link you choose to share.

The questions

  1. Is the cost of an error high?
  2. Is the action hard or impossible to reverse?
  3. Does the decision affect rights, health, money, or a career?
  4. Is it impossible to explain how the decision was reached?
  5. Is there nobody qualified to genuinely supervise the system?
  6. Is there meaningful business or human impact?
  7. Is the data sensitive?
  8. Is the output relatively easy to check?
  9. Is there a clear definition of a good result?

The classifications

  • Green — AI can execute — Here you can let AI work and leave people with spot-checking and correction when needed.
  • Yellow — AI assists, a person decides — AI can organize information, surface patterns, and recommend. It shouldn't make the call alone.
  • Red — AI does not make the decision — Once a process is classified red, the question is no longer how to improve the model. It's what part of the process should reach it at all.

Eight questions for the board

  1. What decision or action does the system perform?
  2. What business value do we expect from it?
  3. Who could be harmed if it's wrong?
  4. Can the action be reversed?
  5. Can we explain how the result was reached?
  6. Who is able to check the quality of the output?
  7. Who is the business owner of the system?
  8. Under what conditions do we stop or shut it down?

The AI Traffic Light Model