Both an iPad and an Android tablet can work fine without being connected to the Internet.
It's not so much the tablet that needs Internet to run, it are the apps. An app might need Internet to actually run in a meaningful way (for example: Whatsapp), it might need Internet occasionally (for example: to download a new level or a new magazine) and it might be totally independent of Internet once you installed it.
So what you're looking for are games and educational apps for Android (or iPad if buying one is an option, financially speaking) that don't need an Internet connection to play.
Kees
I am looking to buy a Learning Tablet without a constant internet requirement.
User
-It's for a 5 year old boy.
-English is not his primary language but his mother knows it well.
Requirements
-An internet connection is rare, maybe only a few times a week. Hence the requirement for it to work offline.
-Prefer something I could load up with games and educational materials at home and they would work offline.
-No PC connection required either, there is no PC at home.
Wishes
-A good battery life also since power is not 24 hours a day.
-Something durable, while the child is supervised by family always (the mother works two jobs), I am not confident in the supervision of some of the family members. And the floors are concrete.
I am willing to entertain suggestions of regular tablets if they would be better.

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic