Triple Crown winner American Pharoah was initially hesitant to leave Churchill Downs the morning of June 18 before returning to California to prepare for the next phase of his racing career.