Okay, I have discovered that when I put the car in neutral while coming to a stop it sometimes makes that noise, but when I apply pressure to the clutch pedal it stops. Even the slightest pressure makes it go away.
It doesn't feel like the flywheel is warped and it doesn't happen every time...