I don't think the VGA adapter is to connect the iPad to a TV. I use mine to connect either to a PC monitor or say to a projector.
Recently I bought an RCA composite cable and this plays a number of apps from the iPad on an old TV I have.
Depending on your TV you have a number of other options like component or HDMI.