I have done this recently also. I practice what I am going to say too! 
You have every right to do it. I termed a 4yr old preschooler also. He was not fitting in with the other kids, was unnaturally nervous about everything, one of my dogs HATED him for some reason, preschool had a policy about the kids having to be walked all the way to the classroom(ridiculous to do with 2 other toddlers in the winter) AND my husband's cousin had a baby who needed part time care. So I got the same pay, but much better situation for me. Hard to do, but one of the best decisions I have made.

You have every right to do it. I termed a 4yr old preschooler also. He was not fitting in with the other kids, was unnaturally nervous about everything, one of my dogs HATED him for some reason, preschool had a policy about the kids having to be walked all the way to the classroom(ridiculous to do with 2 other toddlers in the winter) AND my husband's cousin had a baby who needed part time care. So I got the same pay, but much better situation for me. Hard to do, but one of the best decisions I have made.
Comment