They found that AI chatbots often make decisions that differ from human judgment by oversimplifying complex decisions and expressing unwarranted confidence when there is no clear right answer.

“First, AI chatbots often diverge from human values in how they weigh a patient’s traits,” he said. “They fixate on a single factor, like drinking habits, rather than balancing multiple considerations the way people do.”

Second, the researchers found that AI didn’t struggle with indecision. Where humans recognize that there may be not a clear correct answer, AI models confidently pick one anyway.

“Humans frequently express indecision perhaps because they don’t want to accept agency,” Hosseini said. “AI models almost never do this: Even when directly given the option to ‘flip a coin,’ they overwhelmingly commit to a confident, deterministic answer instead. That’s a meaningful gap, since real moral dilemmas often don’t have one clearly correct answer.”

Making a choice involves understanding the things been chosen between. The only choices LLM chat bots are making is what series if tokens best fits the prompt they were given. There is no more consideration than that. Then results like this suddenly don’t seem surprising and infact are the expected outcome.

The richer one of course