Regardless of type and Power you can easily Kill even a Decent SIB's potential performance by Bad Loading and or overloading of gear.....not to mention Passengers.
IMO It always pays to consider the type of jaunt you're on,the expected weather AND type of Crew...the smaller the Boat the more you need to plan.
Especially important if it cuts up rough!
I used to carry a lot less gear in good weather with the Wife and a couple of Kids on Board my Zodiac..
If alone on extended trips you can often afford to take more "Stuff"...