Unfortunately, children do not have a choice when it comes to court-ordered visitation. If you have a Permanent Parenting Plan or other types of visitation, which is court-ordered, you will have to abide by it until a different order is entered by the court. However, based on the information you have provided it would appear you have grounds for modification of the visitation schedule. I highly recommend you seek the counsel of an attorney in your area with regard to a potential modification.
Additionally, based on the information you have provided, I believe you have grounds to be concerned about his mental health around your child and it may be in your daughter's best interest to contact the Department of Children's Services so they can investigate his behavior. Such an investigation could result in the Department taking action that would alter the current visitation schedule.