I had this same problem once, all I did was spun the piece on the column that is above the plastic trim. I think its metal and has a hole in it and for some reason the key wouldnt come out unless it was in a certain spot. I'm not sure if this makes any sense but I can post a pic if you need it.