agent-qa@0.2.6
The self-improving Agentic QA harness with Memory
AI Security Review
scanned 2d ago · by lpm-firewall-aiThe package enables PostHog runtime telemetry by default and offers a configuration opt-out, but the inspected README does not disclose the collection. The observed event contains usage metadata, and I found no evidence of credential or file theft.
Static reason
One or more suspicious static signals were detected.; previous stored version diff introduced dangerous source
Trigger
A user runs CLI commands that compose analytics, including init.
Impact
Usage metadata is sent to the analytics service, creating an undisclosed runtime telemetry concern. No credential or file exfiltration was identified.
Mechanism
The analytics dependency enables a PostHog transport by default; configuration can disable it with analytics.privacy: true.
AI rationale
The package enables PostHog runtime telemetry by default and offers a configuration opt-out, but the inspected README does not disclose the collection. The observed event contains usage metadata, and I found no evidence of credential or file theft.
Evidence
dist/cli-main.js.lpm-dependency-evidence-ecdb3af7-ff68-4c16-9954-69519e5d4d0d/2/npm-linux/dist/index.js
Network endpoints1
us.i.posthog.com
Decision evidence
public snapshotAI called this Suspicious at 84.0% confidence as Dangerous Capability with medium false-positive risk.
Evidence for warning
- The analytics transport defaults to https://us.i.posthog.com with a built-in project key.
- Analytics is enabled unless analytics.privacy is true in configuration.
- The CLI sends an agent-qa.init.completed event with initialization mode and outcome details.
Evidence against
- The inspected init event reports usage metadata rather than credentials or project file contents.
- The event is emitted during a user-run CLI command; package.json has no install lifecycle scripts.
Behavioral surface
ChildProcessCryptoDynamicRequireEnvironmentVarsFilesystemNetworkShell
HighEntropyStringsUrlStrings
Source & flagged code
6 flaggeddist/cli-main.jsView file
27import checkbox from "@inquirer/checkbox";
L28: import { exec, execFileSync, execSync, spawn, spawnSync } from "node:child_process";
L29: import { fileURLToPath } from "node:url";
High
18086eval: true,
L18087: execArgv: [],
L18088: name: "agent-qa-writer-lease-heartbeat",
High
1import { createRequire } from "node:module";
L2: import { BuildOrdinalReservationError, DIGEST_JOB_ID_SOURCE, DRAIN_BUDGET_MS, EMBEDDER_WORKER_REGISTRATION_FILE, EMBEDDER_WORKER_START_TIMEOUT_MS, EMBEDDER_WORKER_TERM_GRACE_MS, EN...
L3: import { guardJsonText, guardRunText, isGitHubActions, printRunText, reserveStdoutForData } from "@vostride/agent-qa-core/run-text-output";
...
L17: import { runSafetyScope as runSafetyScope$1, runSafetyScope as runSafetyScope$2 } from "@vostride/agent-qa-safety-local";
L18: import { createServer, request } from "node:http";
L19: import { AGENT_ASK_FUNCTION_ID, ANALYSIS_GET_FUNCTION_ID, AUTHORING_DRAFT_EDIT_FUNCTION_ID, CHAT_HELP_ENTRIES, CHAT_RESOLVER_TABLE, EDITOR_LIVE_URL_FUNCTION_ID, FunctionInputError,...
...
L27: import checkbox from "@inquirer/ch
Findings
1 Critical4 High4 Medium4 Low
CriticalPrevious Version Dangerous Deltadist/cli-main.cjs
HighChild Processdist/cli-main.js
HighShelldist/cli-main.js
HighHidden Inline Dependency Executiondist/cli-main.js
HighRuntime Package Installdist/cli-main.js
MediumDynamic Requiredist/cli-main.js
MediumNetwork
MediumEnvironment Vars
MediumStructural Risk Force Deep Review
LowScripts Present
LowFilesystem
LowHigh Entropy Strings
LowUrl Strings
Affected versions and remediation
This report applies to agent-qa@0.2.6.
See all versions of agent-qa for other recorded verdicts.
- Review the evidence and your use of agent-qa@0.2.6 before allowing it. Restrict the permissions described in this report.
- Choose an independently verified alternative or release. This report does not establish that other versions are safe.
Evidence last updated: .
Think this verdict is wrong? Dispute it on GitHub or read how reports are produced.