annotation_queues

Creates, updates, deletes, gets or lists an annotation_queues resource.

Overview

Name	annotation_queues
Type	Resource
Id	datadog.llm_observability.annotation_queues

Fields

The following fields are returned by SELECT queries:

list_llmobs_annotation_queues

Name	Datatype	Description
id	string	Unique identifier of the annotation queue. (example: 00000000-0000-0000-0000-000000000001)
attributes	object	Attributes of an Agent Observability annotation queue.
type	string	Resource type of an Agent Observability annotation queue. (queues) (example: queues)

Methods

The following methods are available for this resource:

Name	Accessible by	Required Params	Optional Params	Description
list_llmobs_annotation_queues	select		project_id, queue_ids	List annotation queues. Optionally filter by project ID or queue IDs. These parameters are mutually exclusive.<br />If neither is provided, all queues in the organization are returned.
create_llmobs_annotation_queue	insert	data		Create an annotation queue. The name and project_id fields are required.<br />An optional annotation_schema can be provided to define the labels for the queue.<br />Fields such as created_by, owned_by, created_at, modified_by,<br />and modified_at are inferred by the backend.
update_llmobs_annotation_queue	update	queue_id, data		Partially update an annotation queue. The name, description, and annotation_schema fields can be updated.
delete_llmobs_annotation_queue	delete	queue_id		Delete an annotation queue by its ID.

Parameters

Parameters can be passed in the WHERE clause of a query. Check the Methods section to see which parameters are required or optional for each operation.

Name	Datatype	Description
queue_id	string	The ID of the Agent Observability annotation queue. (example: 00000000-0000-0000-0000-000000000001)
site	string	The Datadog site (region) for your organization, for example datadoghq.com, us3.datadoghq.com, us5.datadoghq.com, ap1.datadoghq.com, ap2.datadoghq.com, datadoghq.eu, ddog-gov.com. Resolved from the DD_SITE environment variable when set. Optional: defaults to datadoghq.com, or the value of the DD_SITE environment variable when set; a WHERE value overrides both.
project_id	string	Filter annotation queues by project ID. Cannot be used together with queueIds. (wire: projectId)
queue_ids	array	Filter annotation queues by queue IDs (comma-separated). Cannot be used together with projectId. (wire: queueIds)

SELECT examples

list_llmobs_annotation_queues

List annotation queues. Optionally filter by project ID or queue IDs. These parameters are mutually exclusive.<br />If neither is provided, all queues in the organization are returned.

SELECT
id,
attributes,
type
FROM datadog.llm_observability.annotation_queues
WHERE project_id = '{{ project_id }}'
AND queue_ids = '{{ queue_ids }}'
;

INSERT examples

create_llmobs_annotation_queue

Create an annotation queue. The name and project_id fields are required.<br />An optional annotation_schema can be provided to define the labels for the queue.<br />Fields such as created_by, owned_by, created_at, modified_by,<br />and modified_at are inferred by the backend.

INSERT INTO datadog.llm_observability.annotation_queues (
data
)
SELECT 
'{{ data }}' /* required */
RETURNING
data
;

Manifest

# Description fields are for documentation purposes
- name: annotation_queues
props:
  - name: data
    description: |
      Data object for creating an Agent Observability annotation queue.
    value:
      attributes:
        annotation_schema:
          label_schemas:
            - description: "{{ description }}"
              has_assessment: {{ has_assessment }}
              has_reasoning: {{ has_reasoning }}
              id: "{{ id }}"
              is_assessment: {{ is_assessment }}
              is_integer: {{ is_integer }}
              is_required: {{ is_required }}
              max: {{ max }}
              min: {{ min }}
              name: "{{ name }}"
              type: "{{ type }}"
              values: "{{ values }}"
        description: "{{ description }}"
        name: "{{ name }}"
        project_id: "{{ project_id }}"
      type: "{{ type }}"

UPDATE examples

update_llmobs_annotation_queue

Partially update an annotation queue. The name, description, and annotation_schema fields can be updated.

UPDATE datadog.llm_observability.annotation_queues
SET 
data = '{{ data }}'
WHERE 
queue_id = '{{ queue_id }}' --required
AND data = '{{ data }}' --required
RETURNING
data;

DELETE examples

delete_llmobs_annotation_queue

Delete an annotation queue by its ID.

DELETE FROM datadog.llm_observability.annotation_queues
WHERE queue_id = '{{ queue_id }}' --required
;