Greetings. I found this thread cross-posted on one of my favorite fishing sites and I felt I had to comment.
I live and fish in the same area as the OP. Thousands of people fish in the manner described, it's called "BTB" or "Beyond The Breakers". The majority use kayaks, the older busted up folks like me use inflatables or jet-skis. I've been doing this for almost 25 years now. Cannot kayak anymore so I use a 13' inflatable with a 15hp Mercury. A jet ski is a little out of budget. Sold the big boat years ago once the kids moved out, too expensive and a hassle.
The risk is minimal. The fishing is VERY good. A typical trip, going from rig to rig, is about 20-25 miles. Communications are not an issue, there are both cell phone and VHF repeaters on the rigs. Any rig inside of 10 miles is visible from the beach and 2' to 3' swells is about as bad as it gets.
To be honest, your biggest threat is heat stroke and sunburn.