PostHog · Capability

PostHog API — llm_analytics

PostHog API — llm_analytics. 134 operations. Lead operation: llm_analytics. Self-contained Naftiko capability covering one Posthog business surface.

Run with Naftiko Posthogllm_analytics

What You Can Do

GET
Environmentsdatasetitemslist — environmentsdatasetitemslist
/v1/api/environments/{environment-id}/dataset-items
POST
Environmentsdatasetitemscreate — environmentsdatasetitemscreate
/v1/api/environments/{environment-id}/dataset-items
GET
Environmentsdatasetitemsretrieve — environmentsdatasetitemsretrieve
/v1/api/environments/{environment-id}/dataset-items/{id}
PUT
Environmentsdatasetitemsupdate — environmentsdatasetitemsupdate
/v1/api/environments/{environment-id}/dataset-items/{id}
PATCH
Environmentsdatasetitemspartialupdate — environmentsdatasetitemspartialupdate
/v1/api/environments/{environment-id}/dataset-items/{id}
DELETE
Environmentsdatasetitemsdestroy — Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true
/v1/api/environments/{environment-id}/dataset-items/{id}
GET
Environmentsdatasetslist — environmentsdatasetslist
/v1/api/environments/{environment-id}/datasets
POST
Environmentsdatasetscreate — environmentsdatasetscreate
/v1/api/environments/{environment-id}/datasets
GET
Environmentsdatasetsretrieve — environmentsdatasetsretrieve
/v1/api/environments/{environment-id}/datasets/{id}
PUT
Environmentsdatasetsupdate — environmentsdatasetsupdate
/v1/api/environments/{environment-id}/datasets/{id}
PATCH
Environmentsdatasetspartialupdate — environmentsdatasetspartialupdate
/v1/api/environments/{environment-id}/datasets/{id}
DELETE
Environmentsdatasetsdestroy — Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true
/v1/api/environments/{environment-id}/datasets/{id}
POST
Evaluationrunscreate — Create a new evaluation run.
/v1/api/environments/{project-id}/evaluation-runs
GET
Evaluationslist — evaluationslist
/v1/api/environments/{project-id}/evaluations
POST
Evaluationscreate — evaluationscreate
/v1/api/environments/{project-id}/evaluations
POST
Evaluationstesthogcreate — Test Hog evaluation code against sample events without saving.
/v1/api/environments/{project-id}/evaluations/test-hog
GET
Evaluationsretrieve — evaluationsretrieve
/v1/api/environments/{project-id}/evaluations/{id}
PUT
Evaluationsupdate — evaluationsupdate
/v1/api/environments/{project-id}/evaluations/{id}
PATCH
Evaluationspartialupdate — evaluationspartialupdate
/v1/api/environments/{project-id}/evaluations/{id}
DELETE
Evaluationsdestroy — Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true
/v1/api/environments/{project-id}/evaluations/{id}
GET
Llmanalyticsclusteringconfigretrieve — Team-level clustering configuration (event filters for automated pipelines).
/v1/api/environments/{project-id}/llm-analytics/clustering-config
POST
Llmanalyticsclusteringconfigseteventfilterscreate — Team-level clustering configuration (event filters for automated pipelines).
/v1/api/environments/{project-id}/llm-analytics/clustering-config/set-event-filters
GET
Llmanalyticsclusteringjobslist — CRUD for clustering job configurations (max 5 per team).
/v1/api/environments/{project-id}/llm-analytics/clustering-jobs
POST
Llmanalyticsclusteringjobscreate — CRUD for clustering job configurations (max 5 per team).
/v1/api/environments/{project-id}/llm-analytics/clustering-jobs
GET
Llmanalyticsclusteringjobsretrieve — CRUD for clustering job configurations (max 5 per team).
/v1/api/environments/{project-id}/llm-analytics/clustering-jobs/{id}
PUT
Llmanalyticsclusteringjobsupdate — CRUD for clustering job configurations (max 5 per team).
/v1/api/environments/{project-id}/llm-analytics/clustering-jobs/{id}
PATCH
Llmanalyticsclusteringjobspartialupdate — CRUD for clustering job configurations (max 5 per team).
/v1/api/environments/{project-id}/llm-analytics/clustering-jobs/{id}
DELETE
Llmanalyticsclusteringjobsdestroy — CRUD for clustering job configurations (max 5 per team).
/v1/api/environments/{project-id}/llm-analytics/clustering-jobs/{id}
GET
Llmanalyticsevaluationconfigretrieve — Get the evaluation config for this team
/v1/api/environments/{project-id}/llm-analytics/evaluation-config
POST
Llmanalyticsevaluationconfigsetactivekeycreate — Set the active provider key for evaluations
/v1/api/environments/{project-id}/llm-analytics/evaluation-config/set-active-key
GET
Llmanalyticsevaluationreportslist — CRUD for evaluation report configurations + report run history.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports
GET
Llmanalyticsevaluationreportslist — CRUD for evaluation report configurations + report run history.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports
POST
Llmanalyticsevaluationreportscreate — CRUD for evaluation report configurations + report run history.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports
POST
Llmanalyticsevaluationreportscreate — CRUD for evaluation report configurations + report run history.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports
GET
Llmanalyticsevaluationreportsretrieve — CRUD for evaluation report configurations + report run history.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports/{id}
GET
Llmanalyticsevaluationreportsretrieve — CRUD for evaluation report configurations + report run history.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports/{id}
PUT
Llmanalyticsevaluationreportsupdate — CRUD for evaluation report configurations + report run history.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports/{id}
PUT
Llmanalyticsevaluationreportsupdate — CRUD for evaluation report configurations + report run history.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports/{id}
PATCH
Llmanalyticsevaluationreportspartialupdate — CRUD for evaluation report configurations + report run history.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports/{id}
PATCH
Llmanalyticsevaluationreportspartialupdate — CRUD for evaluation report configurations + report run history.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports/{id}
DELETE
Llmanalyticsevaluationreportsdestroy — Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports/{id}
DELETE
Llmanalyticsevaluationreportsdestroy — Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports/{id}
POST
Llmanalyticsevaluationreportsgeneratecreate — Trigger immediate report generation.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports/{id}/generate
POST
Llmanalyticsevaluationreportsgeneratecreate — Trigger immediate report generation.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports/{id}/generate
GET
Llmanalyticsevaluationreportsrunslist — List report runs (history) for this report.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports/{id}/runs
GET
Llmanalyticsevaluationreportsrunslist — List report runs (history) for this report.
/v1/api/environments/{project-id}/llm-analytics/evaluation-reports/{id}/runs
POST
Llmanalyticsevaluationsummarycreate — Generate an AI-powered summary of evaluation results.
/v1/api/environments/{project-id}/llm-analytics/evaluation-summary
GET
Llmanalyticsmodelsretrieve — List available models for a provider.
/v1/api/environments/{project-id}/llm-analytics/models
POST
Llmanalyticsproviderkeyvalidationscreate — Validate LLM provider API keys without persisting them
/v1/api/environments/{project-id}/llm-analytics/provider-key-validations
GET
Llmanalyticsproviderkeyslist — llmanalyticsproviderkeyslist
/v1/api/environments/{project-id}/llm-analytics/provider-keys
POST
Llmanalyticsproviderkeyscreate — llmanalyticsproviderkeyscreate
/v1/api/environments/{project-id}/llm-analytics/provider-keys
GET
Llmanalyticsproviderkeystrialevaluationsretrieve — List enabled evaluations currently using trial credits for a given provider.
/v1/api/environments/{project-id}/llm-analytics/provider-keys/trial-evaluations
GET
Llmanalyticsproviderkeysretrieve — llmanalyticsproviderkeysretrieve
/v1/api/environments/{project-id}/llm-analytics/provider-keys/{id}
PUT
Llmanalyticsproviderkeysupdate — llmanalyticsproviderkeysupdate
/v1/api/environments/{project-id}/llm-analytics/provider-keys/{id}
PATCH
Llmanalyticsproviderkeyspartialupdate — llmanalyticsproviderkeyspartialupdate
/v1/api/environments/{project-id}/llm-analytics/provider-keys/{id}
DELETE
Llmanalyticsproviderkeysdestroy — llmanalyticsproviderkeysdestroy
/v1/api/environments/{project-id}/llm-analytics/provider-keys/{id}
POST
Llmanalyticsproviderkeysassigncreate — Assign this key to evaluations and optionally re-enable them.
/v1/api/environments/{project-id}/llm-analytics/provider-keys/{id}/assign
GET
Llmanalyticsproviderkeysdependentconfigsretrieve — Get evaluations using this key and alternative keys for replacement.
/v1/api/environments/{project-id}/llm-analytics/provider-keys/{id}/dependent-configs
POST
Llmanalyticsproviderkeysvalidatecreate — llmanalyticsproviderkeysvalidatecreate
/v1/api/environments/{project-id}/llm-analytics/provider-keys/{id}/validate
GET
Llmanalyticsreviewqueueitemslist — llmanalyticsreviewqueueitemslist
/v1/api/environments/{project-id}/llm-analytics/review-queue-items
GET
Llmanalyticsreviewqueueitemslist — llmanalyticsreviewqueueitemslist
/v1/api/environments/{project-id}/llm-analytics/review-queue-items
POST
Llmanalyticsreviewqueueitemscreate — llmanalyticsreviewqueueitemscreate
/v1/api/environments/{project-id}/llm-analytics/review-queue-items
POST
Llmanalyticsreviewqueueitemscreate — llmanalyticsreviewqueueitemscreate
/v1/api/environments/{project-id}/llm-analytics/review-queue-items
GET
Llmanalyticsreviewqueueitemsretrieve — llmanalyticsreviewqueueitemsretrieve
/v1/api/environments/{project-id}/llm-analytics/review-queue-items/{id}
GET
Llmanalyticsreviewqueueitemsretrieve — llmanalyticsreviewqueueitemsretrieve
/v1/api/environments/{project-id}/llm-analytics/review-queue-items/{id}
PATCH
Llmanalyticsreviewqueueitemspartialupdate — llmanalyticsreviewqueueitemspartialupdate
/v1/api/environments/{project-id}/llm-analytics/review-queue-items/{id}
PATCH
Llmanalyticsreviewqueueitemspartialupdate — llmanalyticsreviewqueueitemspartialupdate
/v1/api/environments/{project-id}/llm-analytics/review-queue-items/{id}
DELETE
Llmanalyticsreviewqueueitemsdestroy — llmanalyticsreviewqueueitemsdestroy
/v1/api/environments/{project-id}/llm-analytics/review-queue-items/{id}
DELETE
Llmanalyticsreviewqueueitemsdestroy — llmanalyticsreviewqueueitemsdestroy
/v1/api/environments/{project-id}/llm-analytics/review-queue-items/{id}
GET
Llmanalyticsreviewqueueslist — llmanalyticsreviewqueueslist
/v1/api/environments/{project-id}/llm-analytics/review-queues
GET
Llmanalyticsreviewqueueslist — llmanalyticsreviewqueueslist
/v1/api/environments/{project-id}/llm-analytics/review-queues
POST
Llmanalyticsreviewqueuescreate — llmanalyticsreviewqueuescreate
/v1/api/environments/{project-id}/llm-analytics/review-queues
POST
Llmanalyticsreviewqueuescreate — llmanalyticsreviewqueuescreate
/v1/api/environments/{project-id}/llm-analytics/review-queues
GET
Llmanalyticsreviewqueuesretrieve — llmanalyticsreviewqueuesretrieve
/v1/api/environments/{project-id}/llm-analytics/review-queues/{id}
GET
Llmanalyticsreviewqueuesretrieve — llmanalyticsreviewqueuesretrieve
/v1/api/environments/{project-id}/llm-analytics/review-queues/{id}
PATCH
Llmanalyticsreviewqueuespartialupdate — llmanalyticsreviewqueuespartialupdate
/v1/api/environments/{project-id}/llm-analytics/review-queues/{id}
PATCH
Llmanalyticsreviewqueuespartialupdate — llmanalyticsreviewqueuespartialupdate
/v1/api/environments/{project-id}/llm-analytics/review-queues/{id}
DELETE
Llmanalyticsreviewqueuesdestroy — llmanalyticsreviewqueuesdestroy
/v1/api/environments/{project-id}/llm-analytics/review-queues/{id}
DELETE
Llmanalyticsreviewqueuesdestroy — llmanalyticsreviewqueuesdestroy
/v1/api/environments/{project-id}/llm-analytics/review-queues/{id}
GET
Llmanalyticsscoredefinitionslist — llmanalyticsscoredefinitionslist
/v1/api/environments/{project-id}/llm-analytics/score-definitions
GET
Llmanalyticsscoredefinitionslist — llmanalyticsscoredefinitionslist
/v1/api/environments/{project-id}/llm-analytics/score-definitions
POST
Llmanalyticsscoredefinitionscreate — llmanalyticsscoredefinitionscreate
/v1/api/environments/{project-id}/llm-analytics/score-definitions
POST
Llmanalyticsscoredefinitionscreate — llmanalyticsscoredefinitionscreate
/v1/api/environments/{project-id}/llm-analytics/score-definitions
GET
Llmanalyticsscoredefinitionsretrieve — llmanalyticsscoredefinitionsretrieve
/v1/api/environments/{project-id}/llm-analytics/score-definitions/{id}
GET
Llmanalyticsscoredefinitionsretrieve — llmanalyticsscoredefinitionsretrieve
/v1/api/environments/{project-id}/llm-analytics/score-definitions/{id}
PATCH
Llmanalyticsscoredefinitionspartialupdate — llmanalyticsscoredefinitionspartialupdate
/v1/api/environments/{project-id}/llm-analytics/score-definitions/{id}
PATCH
Llmanalyticsscoredefinitionspartialupdate — llmanalyticsscoredefinitionspartialupdate
/v1/api/environments/{project-id}/llm-analytics/score-definitions/{id}
POST
Llmanalyticsscoredefinitionsnewversioncreate — llmanalyticsscoredefinitionsnewversioncreate
/v1/api/environments/{project-id}/llm-analytics/score-definitions/{id}/new-version
POST
Llmanalyticsscoredefinitionsnewversioncreate — llmanalyticsscoredefinitionsnewversioncreate
/v1/api/environments/{project-id}/llm-analytics/score-definitions/{id}/new-version
POST
Llmanalyticssentimentcreate — llmanalyticssentimentcreate
/v1/api/environments/{project-id}/llm-analytics/sentiment
POST
Llmanalyticssummarizationcreate — Generate an AI-powered summary of an LLM trace or event.
/v1/api/environments/{project-id}/llm-analytics/summarization
POST
Llmanalyticssummarizationbatchcheckcreate — Check which traces have cached summaries available.
/v1/api/environments/{project-id}/llm-analytics/summarization/batch-check
POST
Llmanalyticstextreprcreate — Generate a human-readable text representation of an LLM trace event.
/v1/api/environments/{project-id}/llm-analytics/text-repr
GET
Llmanalyticstracereviewslist — llmanalyticstracereviewslist
/v1/api/environments/{project-id}/llm-analytics/trace-reviews
GET
Llmanalyticstracereviewslist — llmanalyticstracereviewslist
/v1/api/environments/{project-id}/llm-analytics/trace-reviews
POST
Llmanalyticstracereviewscreate — llmanalyticstracereviewscreate
/v1/api/environments/{project-id}/llm-analytics/trace-reviews
POST
Llmanalyticstracereviewscreate — llmanalyticstracereviewscreate
/v1/api/environments/{project-id}/llm-analytics/trace-reviews
GET
Llmanalyticstracereviewsretrieve — llmanalyticstracereviewsretrieve
/v1/api/environments/{project-id}/llm-analytics/trace-reviews/{id}
GET
Llmanalyticstracereviewsretrieve — llmanalyticstracereviewsretrieve
/v1/api/environments/{project-id}/llm-analytics/trace-reviews/{id}
PATCH
Llmanalyticstracereviewspartialupdate — llmanalyticstracereviewspartialupdate
/v1/api/environments/{project-id}/llm-analytics/trace-reviews/{id}
PATCH
Llmanalyticstracereviewspartialupdate — llmanalyticstracereviewspartialupdate
/v1/api/environments/{project-id}/llm-analytics/trace-reviews/{id}
DELETE
Llmanalyticstracereviewsdestroy — llmanalyticstracereviewsdestroy
/v1/api/environments/{project-id}/llm-analytics/trace-reviews/{id}
DELETE
Llmanalyticstracereviewsdestroy — llmanalyticstracereviewsdestroy
/v1/api/environments/{project-id}/llm-analytics/trace-reviews/{id}
POST
Llmanalyticstranslatecreate — Translate text to target language.
/v1/api/environments/{project-id}/llm-analytics/translate
GET
Llmpromptslist — llmpromptslist
/v1/api/environments/{project-id}/llm-prompts
POST
Llmpromptscreate — llmpromptscreate
/v1/api/environments/{project-id}/llm-prompts
GET
Llmpromptsnameretrieve — llmpromptsnameretrieve
/v1/api/environments/{project-id}/llm-prompts/name/{prompt-name}
PATCH
Llmpromptsnamepartialupdate — llmpromptsnamepartialupdate
/v1/api/environments/{project-id}/llm-prompts/name/{prompt-name}
POST
Llmpromptsnamearchivecreate — llmpromptsnamearchivecreate
/v1/api/environments/{project-id}/llm-prompts/name/{prompt-name}/archive
POST
Llmpromptsnameduplicatecreate — llmpromptsnameduplicatecreate
/v1/api/environments/{project-id}/llm-prompts/name/{prompt-name}/duplicate
GET
Llmpromptsresolvenameretrieve — llmpromptsresolvenameretrieve
/v1/api/environments/{project-id}/llm-prompts/resolve/name/{prompt-name}
GET
Llmskillslist — llmskillslist
/v1/api/environments/{project-id}/llm-skills
POST
Llmskillscreate — llmskillscreate
/v1/api/environments/{project-id}/llm-skills
GET
Llmskillsnameretrieve — llmskillsnameretrieve
/v1/api/environments/{project-id}/llm-skills/name/{skill-name}
PATCH
Llmskillsnamepartialupdate — llmskillsnamepartialupdate
/v1/api/environments/{project-id}/llm-skills/name/{skill-name}
POST
Llmskillsnamearchivecreate — llmskillsnamearchivecreate
/v1/api/environments/{project-id}/llm-skills/name/{skill-name}/archive
POST
Llmskillsnameduplicatecreate — llmskillsnameduplicatecreate
/v1/api/environments/{project-id}/llm-skills/name/{skill-name}/duplicate
POST
Llmskillsnamefilesrenamecreate — llmskillsnamefilesrenamecreate
/v1/api/environments/{project-id}/llm-skills/name/{skill-name}/files-rename
POST
Llmskillsnamefilescreate — llmskillsnamefilescreate
/v1/api/environments/{project-id}/llm-skills/name/{skill-name}/files
GET
Llmskillsnamefilesretrieve — llmskillsnamefilesretrieve
/v1/api/environments/{project-id}/llm-skills/name/{skill-name}/files/{file-path}
DELETE
Llmskillsnamefilesdestroy — llmskillsnamefilesdestroy
/v1/api/environments/{project-id}/llm-skills/name/{skill-name}/files/{file-path}
GET
Llmskillsresolvenameretrieve — llmskillsresolvenameretrieve
/v1/api/environments/{project-id}/llm-skills/resolve/name/{skill-name}
GET
Datasetitemslist — datasetitemslist
/v1/api/projects/{project-id}/dataset-items
POST
Datasetitemscreate — datasetitemscreate
/v1/api/projects/{project-id}/dataset-items
GET
Datasetitemsretrieve — datasetitemsretrieve
/v1/api/projects/{project-id}/dataset-items/{id}
PUT
Datasetitemsupdate — datasetitemsupdate
/v1/api/projects/{project-id}/dataset-items/{id}
PATCH
Datasetitemspartialupdate — datasetitemspartialupdate
/v1/api/projects/{project-id}/dataset-items/{id}
DELETE
Datasetitemsdestroy — Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true
/v1/api/projects/{project-id}/dataset-items/{id}
GET
Datasetslist — datasetslist
/v1/api/projects/{project-id}/datasets
POST
Datasetscreate — datasetscreate
/v1/api/projects/{project-id}/datasets
GET
Datasetsretrieve — datasetsretrieve
/v1/api/projects/{project-id}/datasets/{id}
PUT
Datasetsupdate — datasetsupdate
/v1/api/projects/{project-id}/datasets/{id}
PATCH
Datasetspartialupdate — datasetspartialupdate
/v1/api/projects/{project-id}/datasets/{id}
DELETE
Datasetsdestroy — Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true
/v1/api/projects/{project-id}/datasets/{id}

MCP Tools

environmentsdatasetitemslist

environmentsdatasetitemslist

read-only idempotent
environmentsdatasetitemscreate

environmentsdatasetitemscreate

environmentsdatasetitemsretrieve

environmentsdatasetitemsretrieve

read-only idempotent
environmentsdatasetitemsupdate

environmentsdatasetitemsupdate

idempotent
environmentsdatasetitemspartialupdate

environmentsdatasetitemspartialupdate

idempotent
hard-delete-this-model-is

Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true

idempotent
environmentsdatasetslist

environmentsdatasetslist

read-only idempotent
environmentsdatasetscreate

environmentsdatasetscreate

environmentsdatasetsretrieve

environmentsdatasetsretrieve

read-only idempotent
environmentsdatasetsupdate

environmentsdatasetsupdate

idempotent
environmentsdatasetspartialupdate

environmentsdatasetspartialupdate

idempotent
hard-delete-this-model-is-2

Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true

idempotent
create-new-evaluation-run

Create a new evaluation run.

evaluationslist

evaluationslist

read-only idempotent
evaluationscreate

evaluationscreate

test-hog-evaluation-code-against

Test Hog evaluation code against sample events without saving.

read-only
evaluationsretrieve

evaluationsretrieve

read-only idempotent
evaluationsupdate

evaluationsupdate

idempotent
evaluationspartialupdate

evaluationspartialupdate

idempotent
hard-delete-this-model-is-3

Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true

idempotent
team-level-clustering-configuration-event

Team-level clustering configuration (event filters for automated pipelines).

read-only idempotent
team-level-clustering-configuration-event-2

Team-level clustering configuration (event filters for automated pipelines).

crud-clustering-job-configurations-max

CRUD for clustering job configurations (max 5 per team).

read-only idempotent
crud-clustering-job-configurations-max-2

CRUD for clustering job configurations (max 5 per team).

crud-clustering-job-configurations-max-3

CRUD for clustering job configurations (max 5 per team).

read-only idempotent
crud-clustering-job-configurations-max-4

CRUD for clustering job configurations (max 5 per team).

idempotent
crud-clustering-job-configurations-max-5

CRUD for clustering job configurations (max 5 per team).

idempotent
crud-clustering-job-configurations-max-6

CRUD for clustering job configurations (max 5 per team).

idempotent
get-evaluation-config-this-team

Get the evaluation config for this team

read-only idempotent
set-active-provider-key-evaluations

Set the active provider key for evaluations

crud-evaluation-report-configurations-report

CRUD for evaluation report configurations + report run history.

read-only idempotent
crud-evaluation-report-configurations-report-2

CRUD for evaluation report configurations + report run history.

read-only idempotent
crud-evaluation-report-configurations-report-3

CRUD for evaluation report configurations + report run history.

crud-evaluation-report-configurations-report-4

CRUD for evaluation report configurations + report run history.

crud-evaluation-report-configurations-report-5

CRUD for evaluation report configurations + report run history.

read-only idempotent
crud-evaluation-report-configurations-report-6

CRUD for evaluation report configurations + report run history.

read-only idempotent
crud-evaluation-report-configurations-report-7

CRUD for evaluation report configurations + report run history.

idempotent
crud-evaluation-report-configurations-report-8

CRUD for evaluation report configurations + report run history.

idempotent
crud-evaluation-report-configurations-report-9

CRUD for evaluation report configurations + report run history.

idempotent
crud-evaluation-report-configurations-report-10

CRUD for evaluation report configurations + report run history.

idempotent
hard-delete-this-model-is-4

Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true

idempotent
hard-delete-this-model-is-5

Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true

idempotent
trigger-immediate-report-generation

Trigger immediate report generation.

trigger-immediate-report-generation-2

Trigger immediate report generation.

list-report-runs-history-this

List report runs (history) for this report.

read-only idempotent
list-report-runs-history-this-2

List report runs (history) for this report.

read-only idempotent
generate-ai-powered-summary-evaluation

Generate an AI-powered summary of evaluation results.

list-available-models-provider

List available models for a provider.

read-only idempotent
validate-llm-provider-api-keys

Validate LLM provider API keys without persisting them

read-only
llmanalyticsproviderkeyslist

llmanalyticsproviderkeyslist

read-only idempotent
llmanalyticsproviderkeyscreate

llmanalyticsproviderkeyscreate

list-enabled-evaluations-currently-using

List enabled evaluations currently using trial credits for a given provider.

read-only idempotent
llmanalyticsproviderkeysretrieve

llmanalyticsproviderkeysretrieve

read-only idempotent
llmanalyticsproviderkeysupdate

llmanalyticsproviderkeysupdate

idempotent
llmanalyticsproviderkeyspartialupdate

llmanalyticsproviderkeyspartialupdate

idempotent
llmanalyticsproviderkeysdestroy

llmanalyticsproviderkeysdestroy

idempotent
assign-this-key-evaluations-and

Assign this key to evaluations and optionally re-enable them.

get-evaluations-using-this-key

Get evaluations using this key and alternative keys for replacement.

read-only idempotent
llmanalyticsproviderkeysvalidatecreate

llmanalyticsproviderkeysvalidatecreate

read-only
llmanalyticsreviewqueueitemslist

llmanalyticsreviewqueueitemslist

read-only idempotent
llmanalyticsreviewqueueitemslist-2

llmanalyticsreviewqueueitemslist

read-only idempotent
llmanalyticsreviewqueueitemscreate

llmanalyticsreviewqueueitemscreate

llmanalyticsreviewqueueitemscreate-2

llmanalyticsreviewqueueitemscreate

llmanalyticsreviewqueueitemsretrieve

llmanalyticsreviewqueueitemsretrieve

read-only idempotent
llmanalyticsreviewqueueitemsretrieve-2

llmanalyticsreviewqueueitemsretrieve

read-only idempotent
llmanalyticsreviewqueueitemspartialupdate

llmanalyticsreviewqueueitemspartialupdate

idempotent
llmanalyticsreviewqueueitemspartialupdate-2

llmanalyticsreviewqueueitemspartialupdate

idempotent
llmanalyticsreviewqueueitemsdestroy

llmanalyticsreviewqueueitemsdestroy

idempotent
llmanalyticsreviewqueueitemsdestroy-2

llmanalyticsreviewqueueitemsdestroy

idempotent
llmanalyticsreviewqueueslist

llmanalyticsreviewqueueslist

read-only idempotent
llmanalyticsreviewqueueslist-2

llmanalyticsreviewqueueslist

read-only idempotent
llmanalyticsreviewqueuescreate

llmanalyticsreviewqueuescreate

llmanalyticsreviewqueuescreate-2

llmanalyticsreviewqueuescreate

llmanalyticsreviewqueuesretrieve

llmanalyticsreviewqueuesretrieve

read-only idempotent
llmanalyticsreviewqueuesretrieve-2

llmanalyticsreviewqueuesretrieve

read-only idempotent
llmanalyticsreviewqueuespartialupdate

llmanalyticsreviewqueuespartialupdate

idempotent
llmanalyticsreviewqueuespartialupdate-2

llmanalyticsreviewqueuespartialupdate

idempotent
llmanalyticsreviewqueuesdestroy

llmanalyticsreviewqueuesdestroy

idempotent
llmanalyticsreviewqueuesdestroy-2

llmanalyticsreviewqueuesdestroy

idempotent
llmanalyticsscoredefinitionslist

llmanalyticsscoredefinitionslist

read-only idempotent
llmanalyticsscoredefinitionslist-2

llmanalyticsscoredefinitionslist

read-only idempotent
llmanalyticsscoredefinitionscreate

llmanalyticsscoredefinitionscreate

llmanalyticsscoredefinitionscreate-2

llmanalyticsscoredefinitionscreate

llmanalyticsscoredefinitionsretrieve

llmanalyticsscoredefinitionsretrieve

read-only idempotent
llmanalyticsscoredefinitionsretrieve-2

llmanalyticsscoredefinitionsretrieve

read-only idempotent
llmanalyticsscoredefinitionspartialupdate

llmanalyticsscoredefinitionspartialupdate

idempotent
llmanalyticsscoredefinitionspartialupdate-2

llmanalyticsscoredefinitionspartialupdate

idempotent
llmanalyticsscoredefinitionsnewversioncreate

llmanalyticsscoredefinitionsnewversioncreate

llmanalyticsscoredefinitionsnewversioncreate-2

llmanalyticsscoredefinitionsnewversioncreate

llmanalyticssentimentcreate

llmanalyticssentimentcreate

generate-ai-powered-summary-llm

Generate an AI-powered summary of an LLM trace or event.

check-which-traces-have-cached

Check which traces have cached summaries available.

read-only
generate-human-readable-text-representation

Generate a human-readable text representation of an LLM trace event.

llmanalyticstracereviewslist

llmanalyticstracereviewslist

read-only idempotent
llmanalyticstracereviewslist-2

llmanalyticstracereviewslist

read-only idempotent
llmanalyticstracereviewscreate

llmanalyticstracereviewscreate

llmanalyticstracereviewscreate-2

llmanalyticstracereviewscreate

llmanalyticstracereviewsretrieve

llmanalyticstracereviewsretrieve

read-only idempotent
llmanalyticstracereviewsretrieve-2

llmanalyticstracereviewsretrieve

read-only idempotent
llmanalyticstracereviewspartialupdate

llmanalyticstracereviewspartialupdate

idempotent
llmanalyticstracereviewspartialupdate-2

llmanalyticstracereviewspartialupdate

idempotent
llmanalyticstracereviewsdestroy

llmanalyticstracereviewsdestroy

idempotent
llmanalyticstracereviewsdestroy-2

llmanalyticstracereviewsdestroy

idempotent
translate-text-target-language

Translate text to target language.

read-only
llmpromptslist

llmpromptslist

read-only idempotent
llmpromptscreate

llmpromptscreate

llmpromptsnameretrieve

llmpromptsnameretrieve

read-only idempotent
llmpromptsnamepartialupdate

llmpromptsnamepartialupdate

idempotent
llmpromptsnamearchivecreate

llmpromptsnamearchivecreate

llmpromptsnameduplicatecreate

llmpromptsnameduplicatecreate

llmpromptsresolvenameretrieve

llmpromptsresolvenameretrieve

read-only idempotent
llmskillslist

llmskillslist

read-only idempotent
llmskillscreate

llmskillscreate

llmskillsnameretrieve

llmskillsnameretrieve

read-only idempotent
llmskillsnamepartialupdate

llmskillsnamepartialupdate

idempotent
llmskillsnamearchivecreate

llmskillsnamearchivecreate

llmskillsnameduplicatecreate

llmskillsnameduplicatecreate

llmskillsnamefilesrenamecreate

llmskillsnamefilesrenamecreate

llmskillsnamefilescreate

llmskillsnamefilescreate

llmskillsnamefilesretrieve

llmskillsnamefilesretrieve

read-only idempotent
llmskillsnamefilesdestroy

llmskillsnamefilesdestroy

idempotent
llmskillsresolvenameretrieve

llmskillsresolvenameretrieve

read-only idempotent
datasetitemslist

datasetitemslist

read-only idempotent
datasetitemscreate

datasetitemscreate

datasetitemsretrieve

datasetitemsretrieve

read-only idempotent
datasetitemsupdate

datasetitemsupdate

idempotent
datasetitemspartialupdate

datasetitemspartialupdate

idempotent
hard-delete-this-model-is-6

Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true

idempotent
datasetslist

datasetslist

read-only idempotent
datasetscreate

datasetscreate

datasetsretrieve

datasetsretrieve

read-only idempotent
datasetsupdate

datasetsupdate

idempotent
datasetspartialupdate

datasetspartialupdate

idempotent
hard-delete-this-model-is-7

Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true

idempotent

Capability Spec

posthog-llm-analytics-2.yaml Raw ↑ 
naftiko: 1.0.0-alpha2
info:
  label: PostHog API — llm_analytics
  description: 'PostHog API — llm_analytics. 134 operations. Lead operation: llm_analytics. Self-contained Naftiko capability
    covering one Posthog business surface.'
  tags:
  - Posthog
  - llm_analytics
  created: '2026-05-19'
  modified: '2026-05-19'
binds:
- namespace: env
  keys:
    POSTHOG_API_KEY: POSTHOG_API_KEY
capability:
  consumes:
  - type: http
    namespace: posthog-llm-analytics-2
    baseUri: ''
    description: PostHog API — llm_analytics business capability. Self-contained, no shared references.
    resources:
    - name: api-environments-environment_id-dataset_items
      path: /api/environments/{environment_id}/dataset_items/
      operations:
      - name: environmentsdatasetitemslist
        method: GET
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: dataset
          in: query
          type: string
          description: Filter by dataset ID
        - name: limit
          in: query
          type: integer
          description: Number of results to return per page.
        - name: offset
          in: query
          type: integer
          description: The initial index from which to return the results.
      - name: environmentsdatasetitemscreate
        method: POST
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
    - name: api-environments-environment_id-dataset_items-id
      path: /api/environments/{environment_id}/dataset_items/{id}/
      operations:
      - name: environmentsdatasetitemsretrieve
        method: GET
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this dataset item.
          required: true
      - name: environmentsdatasetitemsupdate
        method: PUT
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this dataset item.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
      - name: environmentsdatasetitemspartialupdate
        method: PATCH
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this dataset item.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: false
      - name: environmentsdatasetitemsdestroy
        method: DELETE
        description: Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this dataset item.
          required: true
    - name: api-environments-environment_id-datasets
      path: /api/environments/{environment_id}/datasets/
      operations:
      - name: environmentsdatasetslist
        method: GET
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id__in
          in: query
          type: array
          description: Multiple values may be separated by commas.
        - name: limit
          in: query
          type: integer
          description: Number of results to return per page.
        - name: offset
          in: query
          type: integer
          description: The initial index from which to return the results.
        - name: order_by
          in: query
          type: array
          description: Ordering
        - name: search
          in: query
          type: string
          description: Search in name, description, or metadata
      - name: environmentsdatasetscreate
        method: POST
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
    - name: api-environments-environment_id-datasets-id
      path: /api/environments/{environment_id}/datasets/{id}/
      operations:
      - name: environmentsdatasetsretrieve
        method: GET
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this dataset.
          required: true
      - name: environmentsdatasetsupdate
        method: PUT
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this dataset.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
      - name: environmentsdatasetspartialupdate
        method: PATCH
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this dataset.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: false
      - name: environmentsdatasetsdestroy
        method: DELETE
        description: Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this dataset.
          required: true
    - name: api-environments-project_id-evaluation_runs
      path: /api/environments/{project_id}/evaluation_runs/
      operations:
      - name: evaluationrunscreate
        method: POST
        description: Create a new evaluation run.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
    - name: api-environments-project_id-evaluations
      path: /api/environments/{project_id}/evaluations/
      operations:
      - name: evaluationslist
        method: GET
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: enabled
          in: query
          type: boolean
          description: Filter by enabled status
        - name: id__in
          in: query
          type: array
          description: Multiple values may be separated by commas.
        - name: limit
          in: query
          type: integer
          description: Number of results to return per page.
        - name: offset
          in: query
          type: integer
          description: The initial index from which to return the results.
        - name: order_by
          in: query
          type: array
          description: Ordering
        - name: search
          in: query
          type: string
          description: Search in name or description
      - name: evaluationscreate
        method: POST
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
    - name: api-environments-project_id-evaluations-test_hog
      path: /api/environments/{project_id}/evaluations/test_hog/
      operations:
      - name: evaluationstesthogcreate
        method: POST
        description: Test Hog evaluation code against sample events without saving.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
    - name: api-environments-project_id-evaluations-id
      path: /api/environments/{project_id}/evaluations/{id}/
      operations:
      - name: evaluationsretrieve
        method: GET
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation.
          required: true
      - name: evaluationsupdate
        method: PUT
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
      - name: evaluationspartialupdate
        method: PATCH
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: false
      - name: evaluationsdestroy
        method: DELETE
        description: Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation.
          required: true
    - name: api-environments-project_id-llm_analytics-clustering_config
      path: /api/environments/{project_id}/llm_analytics/clustering_config/
      operations:
      - name: llmanalyticsclusteringconfigretrieve
        method: GET
        description: Team-level clustering configuration (event filters for automated pipelines).
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
    - name: api-environments-project_id-llm_analytics-clustering_config-set_event_filters
      path: /api/environments/{project_id}/llm_analytics/clustering_config/set_event_filters/
      operations:
      - name: llmanalyticsclusteringconfigseteventfilterscreate
        method: POST
        description: Team-level clustering configuration (event filters for automated pipelines).
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
    - name: api-environments-project_id-llm_analytics-clustering_jobs
      path: /api/environments/{project_id}/llm_analytics/clustering_jobs/
      operations:
      - name: llmanalyticsclusteringjobslist
        method: GET
        description: CRUD for clustering job configurations (max 5 per team).
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: limit
          in: query
          type: integer
          description: Number of results to return per page.
        - name: offset
          in: query
          type: integer
          description: The initial index from which to return the results.
      - name: llmanalyticsclusteringjobscreate
        method: POST
        description: CRUD for clustering job configurations (max 5 per team).
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
    - name: api-environments-project_id-llm_analytics-clustering_jobs-id
      path: /api/environments/{project_id}/llm_analytics/clustering_jobs/{id}/
      operations:
      - name: llmanalyticsclusteringjobsretrieve
        method: GET
        description: CRUD for clustering job configurations (max 5 per team).
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this clustering job.
          required: true
      - name: llmanalyticsclusteringjobsupdate
        method: PUT
        description: CRUD for clustering job configurations (max 5 per team).
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this clustering job.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
      - name: llmanalyticsclusteringjobspartialupdate
        method: PATCH
        description: CRUD for clustering job configurations (max 5 per team).
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this clustering job.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: false
      - name: llmanalyticsclusteringjobsdestroy
        method: DELETE
        description: CRUD for clustering job configurations (max 5 per team).
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this clustering job.
          required: true
    - name: api-environments-project_id-llm_analytics-evaluation_config
      path: /api/environments/{project_id}/llm_analytics/evaluation_config/
      operations:
      - name: llmanalyticsevaluationconfigretrieve
        method: GET
        description: Get the evaluation config for this team
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
    - name: api-environments-project_id-llm_analytics-evaluation_config-set_active_key
      path: /api/environments/{project_id}/llm_analytics/evaluation_config/set_active_key/
      operations:
      - name: llmanalyticsevaluationconfigsetactivekeycreate
        method: POST
        description: Set the active provider key for evaluations
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
    - name: api-environments-project_id-llm_analytics-evaluation_reports
      path: /api/environments/{project_id}/llm_analytics/evaluation_reports/
      operations:
      - name: llmanalyticsevaluationreportslist
        method: GET
        description: CRUD for evaluation report configurations + report run history.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: limit
          in: query
          type: integer
          description: Number of results to return per page.
        - name: offset
          in: query
          type: integer
          description: The initial index from which to return the results.
      - name: llmanalyticsevaluationreportslist
        method: GET
        description: CRUD for evaluation report configurations + report run history.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: limit
          in: query
          type: integer
          description: Number of results to return per page.
        - name: offset
          in: query
          type: integer
          description: The initial index from which to return the results.
      - name: llmanalyticsevaluationreportscreate
        method: POST
        description: CRUD for evaluation report configurations + report run history.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
      - name: llmanalyticsevaluationreportscreate
        method: POST
        description: CRUD for evaluation report configurations + report run history.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
    - name: api-environments-project_id-llm_analytics-evaluation_reports-id
      path: /api/environments/{project_id}/llm_analytics/evaluation_reports/{id}/
      operations:
      - name: llmanalyticsevaluationreportsretrieve
        method: GET
        description: CRUD for evaluation report configurations + report run history.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation report.
          required: true
      - name: llmanalyticsevaluationreportsretrieve
        method: GET
        description: CRUD for evaluation report configurations + report run history.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation report.
          required: true
      - name: llmanalyticsevaluationreportsupdate
        method: PUT
        description: CRUD for evaluation report configurations + report run history.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation report.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
      - name: llmanalyticsevaluationreportsupdate
        method: PUT
        description: CRUD for evaluation report configurations + report run history.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation report.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
      - name: llmanalyticsevaluationreportspartialupdate
        method: PATCH
        description: CRUD for evaluation report configurations + report run history.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation report.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: false
      - name: llmanalyticsevaluationreportspartialupdate
        method: PATCH
        description: CRUD for evaluation report configurations + report run history.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation report.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: false
      - name: llmanalyticsevaluationreportsdestroy
        method: DELETE
        description: Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation report.
          required: true
      - name: llmanalyticsevaluationreportsdestroy
        method: DELETE
        description: Hard delete of this model is not allowed. Use a patch API call to set "deleted" to true
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation report.
          required: true
    - name: api-environments-project_id-llm_analytics-evaluation_reports-id-generate
      path: /api/environments/{project_id}/llm_analytics/evaluation_reports/{id}/generate/
      operations:
      - name: llmanalyticsevaluationreportsgeneratecreate
        method: POST
        description: Trigger immediate report generation.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation report.
          required: true
      - name: llmanalyticsevaluationreportsgeneratecreate
        method: POST
        description: Trigger immediate report generation.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation report.
          required: true
    - name: api-environments-project_id-llm_analytics-evaluation_reports-id-runs
      path: /api/environments/{project_id}/llm_analytics/evaluation_reports/{id}/runs/
      operations:
      - name: llmanalyticsevaluationreportsrunslist
        method: GET
        description: List report runs (history) for this report.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation report.
          required: true
        - name: limit
          in: query
          type: integer
          description: Number of results to return per page.
        - name: offset
          in: query
          type: integer
          description: The initial index from which to return the results.
      - name: llmanalyticsevaluationreportsrunslist
        method: GET
        description: List report runs (history) for this report.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this evaluation report.
          required: true
        - name: limit
          in: query
          type: integer
          description: Number of results to return per page.
        - name: offset
          in: query
          type: integer
          description: The initial index from which to return the results.
    - name: api-environments-project_id-llm_analytics-evaluation_summary
      path: /api/environments/{project_id}/llm_analytics/evaluation_summary/
      operations:
      - name: llmanalyticsevaluationsummarycreate
        method: POST
        description: Generate an AI-powered summary of evaluation results.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
    - name: api-environments-project_id-llm_analytics-models
      path: /api/environments/{project_id}/llm_analytics/models/
      operations:
      - name: llmanalyticsmodelsretrieve
        method: GET
        description: List available models for a provider.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: key_id
          in: query
          type: string
          description: Optional provider key UUID. When supplied, models reachable with that specific key are returned (useful
            for Azure OpenAI, where the deployment list depends on t
        - name: provider
          in: query
          type: string
          description: LLM provider to list models for. Must be one of the supported providers.
          required: true
    - name: api-environments-project_id-llm_analytics-provider_key_validations
      path: /api/environments/{project_id}/llm_analytics/provider_key_validations/
      operations:
      - name: llmanalyticsproviderkeyvalidationscreate
        method: POST
        description: Validate LLM provider API keys without persisting them
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
    - name: api-environments-project_id-llm_analytics-provider_keys
      path: /api/environments/{project_id}/llm_analytics/provider_keys/
      operations:
      - name: llmanalyticsproviderkeyslist
        method: GET
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: limit
          in: query
          type: integer
          description: Number of results to return per page.
        - name: offset
          in: query
          type: integer
          description: The initial index from which to return the results.
      - name: llmanalyticsproviderkeyscreate
        method: POST
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
    - name: api-environments-project_id-llm_analytics-provider_keys-trial_evaluations
      path: /api/environments/{project_id}/llm_analytics/provider_keys/trial_evaluations/
      operations:
      - name: llmanalyticsproviderkeystrialevaluationsretrieve
        method: GET
        description: List enabled evaluations currently using trial credits for a given provider.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
    - name: api-environments-project_id-llm_analytics-provider_keys-id
      path: /api/environments/{project_id}/llm_analytics/provider_keys/{id}/
      operations:
      - name: llmanalyticsproviderkeysretrieve
        method: GET
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this llm provider key.
          required: true
      - name: llmanalyticsproviderkeysupdate
        method: PUT
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this llm provider key.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
      - name: llmanalyticsproviderkeyspartialupdate
        method: PATCH
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this llm provider key.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: false
      - name: llmanalyticsproviderkeysdestroy
        method: DELETE
        description: ''
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this llm provider key.
          required: true
    - name: api-environments-project_id-llm_analytics-provider_keys-id-assign
      path: /api/environments/{project_id}/llm_analytics/provider_keys/{id}/assign/
      operations:
      - name: llmanalyticsproviderkeysassigncreate
        method: POST
        description: Assign this key to evaluations and optionally re-enable them.
        outputRawFormat: json
        outputParameters:
        - name: result
          type: object
          value: $.
        inputParameters:
        - name: id
          in: path
          type: string
          description: A UUID string identifying this llm provider key.
          required: true
        - name: body
          in: body
          type: object
          description: Request body (JSON).
          required: true
    - name: api-environments-project_id-llm_analytics-provider_keys-id-dependent_configs
      path: /a

# --- truncated at 32 KB (188 KB total) ---
# Full source: https://raw.githubusercontent.com/api-evangelist/posthog/refs/heads/main/capabilities/posthog-llm-analytics-2.yaml