It is possible to do what you wish. I’m assuming you are using iPadOS 26!
First select ‘Albums’ from the left hand pane.
Then when the Albums are shown on the right, select the three ‘dots’ top right. From the panel that opens, select ‘list view’ and then ‘sort by name’
Your Albums will now...