It's something to consider for sure. Music I don't think is as big of a deal but your podcast subscriptions could be an issue if you're subscribed to something you don't want people to know about.
Setting them to private and also turning off the sync to Nostr entirely is something I'll look at adding.