That I am not sure, since the way I downloaded the pics was different than what you have described. The album was already created by my cousin which he share for me. The only time I needed to be online was go sign in on my google account to view the album. When online, the pictures I wanted to download went directly to my "PHOTO" app.
So I know that you can download and view single photos from albums without an internet connection, but cannot say about full albums. I think you are just going to need to play around with it.
Glad it worked out for you in the end.