modeva.TestSuite.interpret_llm_summary#
- TestSuite.interpret_llm_summary(dataset: str = 'test')#
This method generates a table populated with unwrapper summary statistics.
The statistics include count, response mean, response std deviation, local MSE/AUC and global MSE/AUC for selected top LLMs
- Parameters:
dataset ({"main", "train", "test"}, default="test") – The data set used for calculating the explanation results.
- Returns:
A container object with the following components:
key: “llm_summary”
data: Name of the dataset used
model: Name of the model used
inputs: Input parameters
table: DataFrame containing summary statistics including:
”count”
”response mean”
”response standard deviation”
”local MSE/AUC”
”global MSE/AUC”
- Return type:
Examples
