annotation_queue_label_schemas
Creates, updates, deletes, gets or lists an annotation_queue_label_schemas resource.
Overview
| Name | annotation_queue_label_schemas |
| Type | Resource |
| Id | datadog.llm_observability.annotation_queue_label_schemas |
Fields
The following fields are returned by SELECT queries:
- get_llmobs_annotation_queue_label_schema
| Name | Datatype | Description |
|---|---|---|
id | string | Unique identifier of the annotation queue. (example: 00000000-0000-0000-0000-000000000001) |
attributes | object | Attributes of an annotation queue label schema. |
type | string | Resource type of an Agent Observability annotation queue. (queues) (example: queues) |
Methods
The following methods are available for this resource:
| Name | Accessible by | Required Params | Optional Params | Description |
|---|---|---|---|---|
get_llmobs_annotation_queue_label_schema | select | queue_id | Retrieve the label schema for a given annotation queue. | |
update_llmobs_annotation_queue_label_schema | replace | queue_id, data | Create or replace the label schema for a given annotation queue.<br />The label schema defines the labels annotators can apply to interactions in the queue.<br />Label names must be unique within the queue and match the pattern ^[a-zA-Z0-9_-]+$.<br />Each label must have a valid type: score, categorical, boolean, or text. |
Parameters
Parameters can be passed in the WHERE clause of a query. Check the Methods section to see which parameters are required or optional for each operation.
| Name | Datatype | Description |
|---|---|---|
queue_id | string | The ID of the Agent Observability annotation queue. (example: 00000000-0000-0000-0000-000000000001) |
site | string | The Datadog site (region) for your organization, for example datadoghq.com, us3.datadoghq.com, us5.datadoghq.com, ap1.datadoghq.com, ap2.datadoghq.com, datadoghq.eu, ddog-gov.com. Resolved from the DD_SITE environment variable when set. Optional: defaults to datadoghq.com, or the value of the DD_SITE environment variable when set; a WHERE value overrides both. |
SELECT examples
- get_llmobs_annotation_queue_label_schema
Retrieve the label schema for a given annotation queue.
SELECT
id,
attributes,
type
FROM datadog.llm_observability.annotation_queue_label_schemas
WHERE queue_id = '{{ queue_id }}' -- required
;
REPLACE examples
- update_llmobs_annotation_queue_label_schema
Create or replace the label schema for a given annotation queue.<br />The label schema defines the labels annotators can apply to interactions in the queue.<br />Label names must be unique within the queue and match the pattern ^[a-zA-Z0-9_-]+$.<br />Each label must have a valid type: score, categorical, boolean, or text.
REPLACE datadog.llm_observability.annotation_queue_label_schemas
SET
data = '{{ data }}'
WHERE
queue_id = '{{ queue_id }}' --required
AND data = '{{ data }}' --required
RETURNING
data;