My employer pays me a flat rate, by the day. Does he have to pay me for statutory holidays?

Everything, such as CPP and EI are deducted from my pay cheques, so I am not a contract worker. I live in Nunavut, Canada. He says he doesn't have to pay me for stats because I agreed to a flat rate. This doesn't make sense to me if I'm not a contract worker.