Can an employer dock me vacation days for doctor visits after the fact?

I put in my 2 weeks and now my employer wants me to give him an accounting of all my doctor visits this year so he can figure out how much time I missed. I'm guessing he wants to get out of paying me for my unused vacation days.

We don't have any forms to fill out at the company when we go to doctor appointments. It's just a very informal "hey I have to leave a couple hours early for an appointment".

This is NY State.

usa jobs
usa jobs resume
usa hotel jobs
usajobs
usa jobs federal government
usa job in ksa
usa jobs
usa jobs login
usa jobs gov
usajobs.gov
www.usajobs.gov
usajobs.com
usajobs
usajobs.gov official