You can just use the ETH address on your ledger. It will cost you a transaction fee to send.
Alternatively, you can use Metamask to access your ledger address. After this step, you only have one address to worry about and everything is transferred to your ledger address.
