I have the same issue. I thought it was the clutch, but Nope.. It started for awhile and went away and now its back. The noise sounds like a clunking sound but its like two metal pieces clunking against each other. So i thought it might be my drive shaft, or H pipe or even the darn metal hose that connects to the H pipe, it seems like that piece might be hitting the valve or strut tower.
Mine makes the sound everytime I take off.
Anyways, I am replacing my drive shaft this weekend and I am going to Weld my damn H-pipes to to the bottom of the car, Ofcourse its going to be done to where the pipes will be able to un-bolt off. I have had lots of proplems with my H-pipes vibrating. This way I can get rid of these being my problem. I will let you know if any of this fixes my problem.