I wouldn't avoid glass. Lot easier to come by, and, unless you're planning on a lot of boating in shallow rocky areas in water with a lot of movement, the strength won't come into play much.
The fuel hit from glass vs aluminum won't be a deal killer, IMO. If it was, more glass hulled boaters would be trying to run solo with no gear on board.
I went with aluminum primarily because I was spending a lot of time off rocky shores, often in pretty close. Of course, once I got the more capable boat, I've been spending more time further offshore. Go figure.