my passenger window control switch (on my drivers side) stopped working, i gave it a little hit with my palm, then it worked. took the door handle/bezel off and noticed that the wiring was loose, put a bit of solder in there and its been good to go.
so yes loose wires is more likely your problem.