czbenchmarks.tasks.embedding
Attributes
Classes
Task for evaluating embedding quality using labeled data. |
Module Contents
- czbenchmarks.tasks.embedding.logger
- class czbenchmarks.tasks.embedding.EmbeddingTask(label_key: str)[source]
Bases:
czbenchmarks.tasks.base.BaseTask
Task for evaluating embedding quality using labeled data.
This task computes quality metrics for embeddings using ground truth labels. Currently supports silhouette score evaluation.
- Parameters:
label_key (str) – Key to access ground truth labels in metadata
- label_key
- property required_inputs: Set[czbenchmarks.datasets.DataType]
Required input data types.
- Returns:
Set of required input DataTypes (metadata with labels)
- property required_outputs: Set[czbenchmarks.datasets.DataType]
Required output data types.
- Returns:
required output types from models this task to run (embedding coordinates)