>It is difficult to demarcate the individual for a model given how much the system prompt and the fine tunes / distills affect the behavior

Why does DNA not cause the exact same problem for humans? Your DNA determines your personality, your likes and dislikes, your lifespan, your sexual preferences etc.