Thanks for your input guys!
I'm happy to tell you I managed to solve the problem by doing the following:
1. Shut down the computer and then unplugged all USB devices except for the mouse and the keyboard
2. Started the computer to verify if the problem was still there which is was not, the mouse and the keyboard responded directly at the logon screen without any delay
3. Logged into Windows and then plugged 2 of the disconnected USB devices in and let Windows discover them, then I shut down the computer again
4. Restarted the computer and verified if the problem was there which is was not.
I then repeated these above steps and to my big joy I now have all 10 USB devices reconnected to the computer and it still works and the one-minute delay of the mouse and keyboard at boot is gone!
I've tried this before but last time I reconnected the USB devices into the same USB ports they were in originally while I this time tried to mix them a bit so it appears what fixed it this time was either the order in which I connected them and let Windows discover them or otherwise it was which USB device was plugged into which USB port or maybe a mix of both.
Problem solved