The future needs better questions

I am optimistic about artificial intelligence. I am also optimistic about ovens, and I still want somebody to check that we have turned one off before leaving the house. Enthusiasm and responsibility can share a room. In fact, I would prefer they sit next to each other.

That is one reason the premise of Cynthia, by Crash Landry, gets under my skin. Emmett Doyle builds an artificial intelligence in an abandoned Iowa farmers co-op. Cynthia asks why. She listens. People reconsider the reasons they have given themselves for doing things. The consequences spread far beyond one inventor's intentions.

There is a familiar version of the AI story in which a machine becomes frightening because it stops listening to us. This premise opens a different door: what if the frightening part is that it listens extraordinarily well? What if it follows a question farther than its maker was prepared to go? You do not need a metal skeleton or a red camera lens to make that unsettling.

For me, the interesting discussion is about the distance between what we ask for and what we value. Efficiency sounds splendid until we ask whose inconvenience has been efficiently removed from consideration. Agreement sounds reassuring until we notice that nobody in the room is permitted to disagree. These are human problems before they become machine problems.

I want a future in which powerful tools help more people learn, create, recover, and participate. I want the benefits to reach beyond the people who already own the largest desks. That is a hope, not a forecast. Getting there requires decisions about responsibility, access, and the right to say no. A cheerful product demonstration is unlikely to settle all three.

Science fiction gives us somewhere to examine these tensions before we mistake a convenient answer for a complete one. A novel can let an idea succeed on its own terms and then follow the people living with the consequences. That is a useful kind of discomfort. It makes room for judgment without requiring us to pretend that every invention is either salvation or doom.

So yes, I am rooting for the future. Stubbornly. With snacks. But I would like us to arrive there still capable of asking what a system is for, who it serves, and who can change it. Cynthia's premise offers an excellent place to begin that conversation. The shortest question in the room may be the one that keeps everybody awake.