Unfortunately, there is no real direct way to do what you are asking. There is no column level changes. Now i say that, but I would like to know how the users are accessing the data.
Let me explain.
Let's pretend you were building a Canvas App. In that App, you can check a users roles or security groups and for them only show a specific View from SharePoint that does not show that column, and for others. You could do something similar in a model-driven app, as well as any other app as long as you do not expose a direct way for them to write to it.
Now... from the back end, let's assume they have access to SharePoint itself, and that specific List with read-write-chain , from that side it is not completely possible.
Now here is another... PITA but possible.
You could setup a security group for instance where you have People X and another with People Y. Now the list is blocked from everyone. You have a UI or something where people can try to update that list. In your UI, you would trigger a Flow that would temporarily assign permissions on the fly to the item itself via the flow, do the update and turn it off.
So in a really convoluted or structured way it would be possible, with some of the things I said, but again, if they are able to Browse to SharePoint and directly change it... you cannot do it without blocking them completely from the List, and only allow them to update it via your UX and Flow.
Once the change has been made.... and depending on what it is, without versioning and then after the fact checking if its ok to change.. you cannot
TO extend hehe a little. Let's pretend this was Dataverse. Dataverse supports plugins. Now thats not the big part, but it supports Stages. A stage is where you can set a plugin to do something, including, having the plugin look at the data BEFORE its applied to the Table and go, oh NO not that field, and block that field... Now of course ikn Dataverse you can simply use Column Level Security
So IF you have Dataverse already.... and licenses.,.. maybe look at that instead, otherwise you have to build a solution around adding/removing/ui based solution
If these suggestions help resolve your issue, Please consider Marking the answer as such and also maybe a like.
Thank you!
Sincerely, Michael Gernaey