Cross Validation in IntegratedML
Hi!
I'd like to know if the VALIDATE MODEL statement in IntegratedML performs a cross validation (CV) procedure internally. If it doesn't, is there a ready to use method for CV?
Thanks!
Hi!
I'd like to know if the VALIDATE MODEL statement in IntegratedML performs a cross validation (CV) procedure internally. If it doesn't, is there a ready to use method for CV?
Thanks!
No, the VALIDATE MODEL statement does not do cross validation. It calculates validation metrics for the given trained model and dataset. As described in the "Model Selection Process" section of the documentation, however, the TRAIN MODEL statement does this to some extent for classification models when using the AutoML provider:
I also believe that the DataRobot provider incorporates cross validation into its training. I'm not sure about H2O.
Thanks Jon, I'll check it out.