i think it's just easy to forget the big wharf lot(s). entry is just after you have committed to the turn onto fort. but yes after 4pm and all weekend there is lots of space.
Those lots frankly never occurred to me, or for that matter to any of the other 3 drivers in the truck at the time; nor apparently to the dozens of other cars in the immediate area vainly jostling for an street spot. As for the small surface lot off Fort it was full.