i have an 03 and i have to shift from 1 to 3 in the morning for the first 5 mins after that its fine.
did you check your front u-joint? just a thought, they can get loud when they wear.
i also have flowmaster 50 they are a bit low but has a nice clean sound. the kit i have just bolted right in, it had all hardware and hangers.