Warm weather may have cost fashion retailers nearly $700 million in sales