Your GP (for example) can still use your ongoing records - with this trusted party still (only) having access to what's been specifically agreed.
Your day to day communication with your GP is kept seperate from any other specialist's access, in their respectively agreed Silos. Because. Privacy Silos. Do This.
Most of your day to day stuff with GP isn't anyone else's business. So that just stays in its Silo. Like always.