Yes, Norrie Disease is typically present at birth, and symptoms, such as congenital blindness, may be noticeable early in infancy.