Trusted parties can collaborate on specific shared information.
Your GP's role often includes co-ordinating the input from a variety of specialists. That's OK. As long as it's specific to their need to know.
Doctors need to share information in order to help you. Help them do this. On your terms. Not their employer's.