You can delete albums by holding down on an album cover and then hitting the X. For singles, do a swipe left to right (or right to left) on a song and hit Delete. That works only on iPad. You'll still need to delete from iTunes or toggle off synching for those albums or songs before the next time you synch, or they will reappear on your iPad.
