/AWS1/CL_ML=>CREATEEVALUATION()
¶
About CreateEvaluation¶
Creates a new Evaluation
of an MLModel
. An MLModel
is evaluated on a set of observations associated to a DataSource
. Like a DataSource
for an MLModel
, the DataSource
for an Evaluation
contains values for the Target Variable
. The Evaluation
compares the predicted result for each observation to the actual outcome and provides a
summary so that you know how effective the MLModel
functions on the test
data. Evaluation generates a relevant performance metric, such as BinaryAUC, RegressionRMSE or MulticlassAvgFScore based on the corresponding MLModelType
: BINARY
, REGRESSION
or MULTICLASS
.
CreateEvaluation
is an asynchronous operation. In response to CreateEvaluation
, Amazon Machine Learning (Amazon ML) immediately
returns and sets the evaluation status to PENDING
. After the Evaluation
is created and ready for use,
Amazon ML sets the status to COMPLETED
.
You can use the GetEvaluation
operation to check progress of the evaluation during the creation operation.
Method Signature¶
IMPORTING¶
Required arguments:¶
IV_EVALUATIONID
TYPE /AWS1/ML_ENTITYID
/AWS1/ML_ENTITYID
¶
A user-supplied ID that uniquely identifies the
Evaluation
.
IV_MLMODELID
TYPE /AWS1/ML_ENTITYID
/AWS1/ML_ENTITYID
¶
The ID of the
MLModel
to evaluate.The schema used in creating the
MLModel
must match the schema of theDataSource
used in theEvaluation
.
IV_EVALUATIONDATASOURCEID
TYPE /AWS1/ML_ENTITYID
/AWS1/ML_ENTITYID
¶
The ID of the
DataSource
for the evaluation. The schema of theDataSource
must match the schema used to create theMLModel
.
Optional arguments:¶
IV_EVALUATIONNAME
TYPE /AWS1/ML_ENTITYNAME
/AWS1/ML_ENTITYNAME
¶
A user-supplied name or description of the
Evaluation
.