Azure.AI.Projects.Evaluation Namespace

Insights on set of Agent Evaluation Results.

Insights from the agent cluster analysis.

Input configuration for the evaluation taxonomy when the input type is agent.

Represents a target specifying an Azure AI agent.

Represents a target specifying an Azure AI model for operations requiring model selection.

Azure OpenAI model configuration. The API version would be selected by the service for querying the model.

Coordinates for the analysis chart.

Insights from the cluster analysis.

Token usage for cluster analysis.

Code-based evaluator definition using python code.

Evaluation rule action for continuous evaluation.

Cron based trigger.

Daily recurrence schedule.

Endpoint-based evaluator definition. The customer owns and hosts an HTTP endpoint that implements the evaluation contract. The evaluator references a Project Connection by name; the connection stores the endpoint URL and credentials (API Key or Entra ID). At execution time, the service resolves the connection to obtain the endpoint URL and authentication details, then calls the endpoint for each evaluation row.

Result of the evaluation.

Metric comparison for a treatment against the baseline.

Comparison results for treatment runs against the baseline.

Summary statistics of a metric in an evaluation run.

Evaluation Comparison Request.

Insights from the evaluation comparison.

Request body for getting evaluator credentials.

A sample from the evaluation result.

Evaluation rule model.

Evaluation action model. Please note this is the abstract base class. The derived classes available for instantiation are: ContinuousEvaluationRuleAction and HumanEvaluationPreviewRuleAction.

Evaluation filter model.

The EvaluationRules sub-client.

Insights on set of Evaluation Results.

Insights from the evaluation run cluster analysis.

Evaluation task for the schedule.

A single dimension — one independent, measurable quality dimension within a rubric evaluator's scoring blueprint.

Base class for targets with discriminator support. Please note this is the abstract base class. The derived classes available for instantiation are: AzureAIModelTarget and AzureAIAgentTarget.

The EvaluationTaxonomies sub-client.

Evaluation Taxonomy Definition.

Input configuration for the evaluation taxonomy. Please note this is the abstract base class. The derived classes available for instantiation are: AgentTaxonomyInput.

The EvaluatorDefinition.

Service-managed provenance artifacts produced by an evaluator generation job. Present only on EvaluatorVersion resources created via the generation pipeline. The combined-JSONL Foundry Dataset is read-only and resolves to a versioned dataset in a service-reserved namespace.

Caller-supplied inputs for an evaluator generation job.

Evaluator Generation Job resource — a long-running job that generates rubric-based evaluator definitions from source materials. On success, the result is the persisted EvaluatorVersion.

The EvaluatorGenerationJobs sub-client.

The base source model for evaluator generation jobs. Polymorphic over type. Please note this is the abstract base class. The derived classes available for instantiation are: PromptEvaluatorGenerationJobSource, AgentEvaluatorGenerationJobSource, TracesEvaluatorGenerationJobSource, and DatasetEvaluatorGenerationJobSource.

Token consumption summary for an evaluator generation job. Populated when the job reaches a terminal state.

Evaluator Metric.

Evaluator Definition.

Hourly recurrence schedule.

Evaluation rule action for human evaluation.

A cluster of analysis samples.

Configuration of the model used in the insight generation.

The request of the insights report. Please note this is the abstract base class. The derived classes available for instantiation are: EvaluationRunClusterInsightRequest, AgentClusterInsightRequest, and EvaluationComparisonInsightRequest.

The result of the insights. Please note this is the abstract base class. The derived classes available for instantiation are: EvaluationComparisonInsightResult, EvaluationRunClusterInsightResult, and AgentClusterInsightResult.

A sample from the analysis. Please note this is the abstract base class. The derived classes available for instantiation are: EvaluationResultSample.

Insight task for the schedule.

Metadata about the insights.

Summary of the error cluster analysis.

Represents a set of parameters used to control the sampling behavior of a language model during text generation.

Monthly recurrence schedule.

One-time trigger.

The ProjectEvaluators sub-client.

Represents an insight produced by a project insight run.

The ProjectInsights sub-client.

The response body for cluster insights.

The Schedules sub-client.

Prompt-based evaluator.

Recurrence schedule model. Please note this is the abstract base class. The derived classes available for instantiation are: HourlyRecurrenceSchedule, DailyRecurrenceSchedule, WeeklyRecurrenceSchedule, and MonthlyRecurrenceSchedule.

Recurrence based trigger.

Red team details.

The RedTeams sub-client.

Schedule run model.

Base model for Trigger of the schedule. Please note this is the abstract base class. The derived classes available for instantiation are: CronTrigger, RecurrenceTrigger, and OneTimeTrigger.

Abstract class for target configuration. Please note this is the abstract base class. The derived classes available for instantiation are: AzureOpenAIModelConfiguration.

Taxonomy category definition.

Taxonomy sub-category definition.

Weekly recurrence schedule.

Strategies for attacks.

Type of the evaluation rule event.

The category of the evaluator.

The type of evaluator definition.

The direction of the metric indicating whether a higher value is better, a lower value is better, or neutral.

The type of the evaluator.

The request of the insights.

Enum describing allowed operation states.

The level at which evaluation is performed.

Risk category for the attack objective.

Schedule provisioning status.

Type of the task.