Caller ID, whilst can be configured from your device, it’s actually a feature that is configured at by carrier.
I’d in touch your carrier.
What you can do on your device? Cache reset of the phone, and any app that is connected, for example, contacts..
Carrier has no idea? Backup your data and do a hard reset.