The most likely cause of this problem is that your Ledger is not set up to accept Contract Data and Browser Support.
You need Browser Support turned on to connect your Ledger.
Check out Ledger’s support page: https://support.ledgerwallet.com/
Here are all the steps to switch both of these options on.