My suggestion, GET A GOOD LAWYER!
Negotiate the settlement from winning this case with them.
You legally have a "right of way" to your property which even without you going to court to ask for that CAC is legally bound to accommodate you with.
The have violated this right of way and if the building department is not making any effort to enforce it, they should be added to the lawsuit as well.