My response:
Without court orders for Paternity, Visitation, and Child Support, yes, he could theoretically, and legally, take the child wherever he wants. While even with court orders he could leave the country with the child, it would be very difficult.
If you feel that he is a "flight risk" and would take your child no matter what orders may, or may not, be in place, then I would suggest that you have orders made that require "supervised visitation".
IAAL