K.P.
I would talk to them and tell them how your feeling and let them know that if they are later than a certain time like 4:30pm or so that you will charge them extra hourly, and I would also let them know that you would appreciate a phone call if they are going to be later than that time also. Communication is key, how do they know there is a problem unless you tell them.
Best of Luck K.