I’ve recently added more detailed guidelines to the troubleshooting page to provide information about how to get hold of debug logs for connection problems so if you’re still having trouble with this I’d recommend testing with version 3.0 (either now in beta testing or in future when it’s released) and look at the debug logs for clues if it is still not working.
I’ve not been able to reproduce this at any point with any version, although it is potentially worth noting that some system configurations can cause delays of over a minute in the worst case so if you’re (understandably) losing patience and restarting Firefox before then, that might explain what’s happening.