Im pretty sure that area is referred to as the "THE POOL"This area is extremely dangerous in peak hours and you may want to avoid it.
I tend to head straight out the back now where the odds of running into kiteboarders are minimal.This allows big open runs.
I perfer to get exposure in swell as i want to wavesail.
There is a little bit of swell which gets into Safety bay but its towards long point.
I often go out there and play the waves are big enough to ride and if you catch the swell line early you will be suprized how fun it is.
I use a wave fin on one of my boards this allows us on hight tide to go straight over the sandbar and also allows manoverability when catching swell
The is weed patches in the bay they will cause you to go sideways with the incorrect fin but it can be controlled I had a plastic bag stuck on it once ;-(