experiment_events

Creates, updates, deletes, gets or lists an experiment_events resource.

Overview

Name	experiment_events
Type	Resource
Id	datadog.llm_observability.experiment_events

Fields

The following fields are returned by SELECT queries:

SELECT not supported for this resource, use SHOW METHODS to view available operations for the resource.

Methods

The following methods are available for this resource:

Name	Accessible by	Required Params	Optional Params	Description
create_llmobs_experiment_events	insert	experiment_id, data		Push spans and metrics for an Agent Observability experiment.

Parameters

Parameters can be passed in the WHERE clause of a query. Check the Methods section to see which parameters are required or optional for each operation.

Name	Datatype	Description
experiment_id	string	The ID of the Agent Observability experiment. (example: 3fd6b5e0-8910-4b1c-a7d0-5b84de329012)
site	string	The Datadog site (region) for your organization, for example datadoghq.com, us3.datadoghq.com, us5.datadoghq.com, ap1.datadoghq.com, ap2.datadoghq.com, datadoghq.eu, ddog-gov.com. Resolved from the DD_SITE environment variable when set. Optional: defaults to datadoghq.com, or the value of the DD_SITE environment variable when set; a WHERE value overrides both.

INSERT examples

create_llmobs_experiment_events

Push spans and metrics for an Agent Observability experiment.

INSERT INTO datadog.llm_observability.experiment_events (
data,
experiment_id
)
SELECT 
'{{ data }}' /* required */,
'{{ experiment_id }}'
;

Manifest

# Description fields are for documentation purposes
- name: experiment_events
props:
  - name: experiment_id
    value: "{{ experiment_id }}"
    description: Required parameter for the experiment_events resource.
  - name: data
    description: |
      Data object for pushing experiment events.
    value:
      attributes:
        metrics:
          - assessment: "{{ assessment }}"
            boolean_value: {{ boolean_value }}
            categorical_value: "{{ categorical_value }}"
            error:
              message: "{{ message }}"
            json_value: "{{ json_value }}"
            label: "{{ label }}"
            metadata: "{{ metadata }}"
            metric_type: "{{ metric_type }}"
            reasoning: "{{ reasoning }}"
            score_value: {{ score_value }}
            span_id: "{{ span_id }}"
            tags: "{{ tags }}"
            timestamp_ms: {{ timestamp_ms }}
        spans:
          - dataset_id: "{{ dataset_id }}"
            duration: {{ duration }}
            meta:
              error:
                message: "{{ message }}"
                stack: "{{ stack }}"
                type: "{{ type }}"
              expected_output: "{{ expected_output }}"
              input: "{{ input }}"
              output: "{{ output }}"
            name: "{{ name }}"
            project_id: "{{ project_id }}"
            span_id: "{{ span_id }}"
            start_ns: {{ start_ns }}
            status: "{{ status }}"
            tags: "{{ tags }}"
            trace_id: "{{ trace_id }}"
      type: "{{ type }}"