Detention

I have my own authority for 10 months. How many of you charge for detention? I don't want to burn bridges with brokers since I'm fresh. Do you charge for your time or eat it up? At first, I didn't charge any detention for months. Lately, I billed three brokers. I got paid for one with no problem. I'm waiting to be paid for the other two.
Do you always need written approval of the detention time? The problem arises when you make deliveries in the middle of the night, and the broker you deal with isn't there. So, someone else might say that it's fine to add detention time over the phone. But nobody usually makes notes in the system about it. So, once your broker is in, he doesn't know anything about it.
How do you deal with it?