Hmm, I haven't really experienced your issue, but give this a try:
1) Disconnect your device
2) Open Device Manager
3) You'll probably see "Unknown/Other Device" being shown with a warning sign, right click it, uninstall & delete drivers for this device.
4) While still in Device Manager, click on view in the top left corner > click on "show hidden devices"
5) Right click, uninstall and delete the drivers for your (greyed out)joystick.
6) Plug in device and wait for the drivers to install.
7) Profit ???