The bigger difference is that the net utility for LLMs could turn out to be massively negative

Maybe! But that’s certainly debatable. “I thought I was doing the right thing” is anyways a much better defense than “I was just following orders” anyways.

Rockets have value to humanity too, but some people that worked on rockets ended up working for people that did not want to use rockets to improve human life.