But Apple’s excuse not to comply with it is privacy-related.

How does that reflect poorly (or positively) on their privacy chops? The dispute is about a competition law, a law Apple is complying with by withholding this feature.

They don’t want third parties to be able the access all data on your phone. Do you?

Yes. There are two values (privacy and competition) that are directly in conflict here.