Hello Eric Cockerill,
Welcome to Microsoft Q&A forum.
This is actually an expected behavior, and you shouldn't be worried about it.
Microsoft periodically released updates for the latest version of Windows, as of now it is 25H2. So even if you are staying in 23H2, 25H2 updates are still offered, and they could be repeatedly offered until installed. Since 23H2 is an old version, it will receive less updates compared to the other newer version. Per my knowledge, as of now, 23H2 has reached end of servicing, which means it will only receive security updates at most. User is expected to move to a newer version. I hope this clarifies.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.