spa_recommendations

Creates, updates, deletes, gets or lists a spa_recommendations resource.

Overview

Name	spa_recommendations
Type	Resource
Id	datadog.infrastructure.spa_recommendations

Fields

The following fields are returned by SELECT queries:

get_sparecommendations_with_shard

Name	Datatype	Description
id	string	Resource identifier for the recommendation. Optional in responses.
attributes	object	Attributes of the SPA Recommendation resource. Contains recommendations for both driver and executor components.
type	string	JSON:API resource type for Spark Pod Autosizing recommendations. Identifies the Recommendation resource returned by SPA. (recommendation) (default: recommendation, example: recommendation)

get_sparecommendations

Name	Datatype	Description
id	string	Resource identifier for the recommendation. Optional in responses.
attributes	object	Attributes of the SPA Recommendation resource. Contains recommendations for both driver and executor components.
type	string	JSON:API resource type for Spark Pod Autosizing recommendations. Identifies the Recommendation resource returned by SPA. (recommendation) (default: recommendation, example: recommendation)

Methods

The following methods are available for this resource:

Name	Accessible by	Required Params	Optional Params	Description
get_sparecommendations_with_shard	select	shard, service	bypass_cache	This endpoint is currently experimental and restricted to Datadog internal use only. Retrieve resource recommendations for a Spark job. The caller (Spark Gateway or DJM UI) provides a service name and shard identifier, and SPA returns structured recommendations for driver and executor resources.
get_sparecommendations	select	service	bypass_cache	This endpoint is currently experimental and restricted to Datadog internal use only. Retrieve resource recommendations for a Spark job. The caller (Spark Gateway or DJM UI) provides a service name and SPA returns structured recommendations for driver and executor resources. The version with a shard should be preferred, where possible, as it gives more accurate results.

Parameters

Parameters can be passed in the WHERE clause of a query. Check the Methods section to see which parameters are required or optional for each operation.

Name	Datatype	Description
service	string	The service name for a spark job.
shard	string	The shard tag for a spark job, which differentiates jobs within the same service that have different resource needs
site	string	The Datadog site (region) for your organization, for example datadoghq.com, us3.datadoghq.com, us5.datadoghq.com, ap1.datadoghq.com, ap2.datadoghq.com, datadoghq.eu, ddog-gov.com. Resolved from the DD_SITE environment variable when set. Optional: defaults to datadoghq.com, or the value of the DD_SITE environment variable when set; a WHERE value overrides both.
bypass_cache	string	The recommendation service should not use its metrics cache.

SELECT examples

get_sparecommendations_with_shard

This endpoint is currently experimental and restricted to Datadog internal use only. Retrieve resource recommendations for a Spark job. The caller (Spark Gateway or DJM UI) provides a service name and shard identifier, and SPA returns structured recommendations for driver and executor resources.

SELECT
id,
attributes,
type
FROM datadog.infrastructure.spa_recommendations
WHERE shard = '{{ shard }}' -- required
AND service = '{{ service }}' -- required
AND bypass_cache = '{{ bypass_cache }}'
;

get_sparecommendations

This endpoint is currently experimental and restricted to Datadog internal use only. Retrieve resource recommendations for a Spark job. The caller (Spark Gateway or DJM UI) provides a service name and SPA returns structured recommendations for driver and executor resources. The version with a shard should be preferred, where possible, as it gives more accurate results.

SELECT
id,
attributes,
type
FROM datadog.infrastructure.spa_recommendations
WHERE service = '{{ service }}' -- required
AND bypass_cache = '{{ bypass_cache }}'
;