Yes, this is why I think it's necessary to move completely towards all economic activity/transactions (L1 settlements) happening on the private by default chain. If XMR/BTC swaps or similar is used, as you mention with linking past Tx amounts, there is a lot of data leaked and easily correlated. Wallet fingerprints, netflows, timing, etc. And you basically lose more privacy as a function of how much economic activity still requires you to use those surveillance networks (btc or fiat).