And even major gold bugs are starting to say that the rally may pump the brakes soon