Repository navigation
FlightCheck: classify ADK invocations as DA - #470
Conversation
Treat FlightCheck runs invoked through the ADK slash-command path as declarative-agent telemetry on every branch except main-ca. Preserve branch-based attribution for CLI, installer, and connect runs. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 95071db8-bd9f-4036-b163-165d5a3dcf09
Send legacy FlightCheck and additive ADK events for the early DA maker-diagnostics path. Preserve diagnostic-only reporting while mapping its bounded outcomes to pass, partial, or fail telemetry. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 95071db8-bd9f-4036-b163-165d5a3dcf09
Emit telemetry for selected DA checkpoints and profiles, retain verified tenant and selected-agent identity, and align connector and invocation-aware agent-type attribution across both telemetry families. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: a4cd1deb-cafc-4d91-ab4a-5c171fcd1108
Dawn Jeong (daeunJe0ng)
left a comment
There was a problem hiding this comment.
[copilot-review] Request changes: the diagnostic outcome mapping is sound, but the new telemetry path can misattribute the selected agent, tenant, and connector, and the invocation-aware agent classification reaches only the legacy event family. Static review of f6dd640; tests and live dashboard behavior were not independently verified.
Dawn Jeong (daeunJe0ng)
left a comment
There was a problem hiding this comment.
[copilot-review] Request changes at 7a3d6aae7160f3e9fd9c75ffa89ca1e1853a1204.
The shared invocation-aware classification is sound, and all four previous attribution findings are fixed for their original triggers.
I withdraw those findings.
One P2 integration issue remains: newly emitted native diagnostics can be reported as Ready by the legacy projection, and the checked-in readiness queries misclassify diagnostic outcomes.
Details and the suggested fix are in the inline comment.
Static review only; tests, builds, live telemetry, and deployed dashboards were not independently exercised.
Preserve inspection-specific legacy outcome labels, including skipped-only local diagnostics. Restrict time-to-green and tenant ready-rate cohorts to explicit readiness verdicts. Cover real DA local producers through both telemetry payloads and guard query predicates. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: a4cd1deb-cafc-4d91-ab4a-5c171fcd1108
Dawn Jeong (daeunJe0ng)
left a comment
There was a problem hiding this comment.
[copilot-review] Approve at 53285b75c0fef722bf0b36e8e3a5756621e8a539. No high-risk blocker identified. Previous attribution findings and the original diagnostic-outcome defects are fixed. The remaining connector success-rate issue is non-blocking and recorded in the existing thread for a separate follow-up PR. Static review only; tests, live telemetry, and deployed dashboards were not independently verified.
Resolve the telemetry guide conflict by retaining diagnostic outcome documentation alongside the newly merged session-recording and validation guidance. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: a4cd1deb-cafc-4d91-ab4a-5c171fcd1108
Summary
--invocation-source adkasdeclarative_agentcustom_agentattribution for runs frommain-capass/partial/failtaxonomyRoot cause
ADK
/flightcheckruns had two independent gaps:agentType=unknown, so DA dashboards filtered them out.The ADK invocation path is authoritative for DA attribution; only the CA shipping branch overrides it.
Live debugging
An instrumented hybrid/local run posted 52 PROD events and received HTTP 204, confirming the collector path is healthy. Raw FlightCheck Kusto remains delayed, with its newest visible row currently dated October 26.
Validation
python -m pytest -q tests/flightcheck/test_telemetry.py tests/flightcheck/test_cli.py(154 passed)python -m ruff check solutions/ess-maker-skills/scripts/flightcheck/telemetry.py solutions/ess-maker-skills/scripts/flightcheck/cli.py tests/flightcheck/test_telemetry.py tests/flightcheck/test_cli.pygit diff --check