Yeah as others have mentioned, around both the bridges and dolls point, woolloware bay and the river itself you would be fine but as they bay is quiet shallow it does chop up heavily if the wind pics up.
Back in the day i used to run out to the container wharf and the airport at night in a 12' but i had a 15 and 25hp back then.