If you plan to take in the whole of the island in one trip, you can then head east to Newport (there are plenty of bus services operating from Yarmouth to various parts of the island), where you can visit the medieval Carisbrooke Castle. You can also take the kids to Monkey Haven, ...