> If they are ingesting peoples data to train their model, at what point are the... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

Turing_Machine on May 20, 2023 | parent | context | favorite | on: Apple Restricts Employee Use of ChatGPT, Joining O...

> If they are ingesting peoples data to train their model, at what point are they checkpointing?

Multiple times per day if they're not incompetent. And I don't think they're incompetent.

supermatt on May 20, 2023 [–]

Are you implying that removing the diff between checkpoints achieves the same effect? Ive never heard of this, but I suppose it may be possible.

I suppose the "ghost" of the removed weights would also have shaped subsequent training though...

Interesting idea...

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact