registry / @empiricalrun/playwright-utils / 0.66.0
@empiricalrun/playwright-utils@0.66.0
Playwright utils for test code repos of our customers
AI Security Review
scanned 3d ago · by lpm-firewall-aiThe flagged OpenAI credential flow is a false positive: the code states it no longer uses OPENAI_API_KEY and sends EMPIRICALRUN_API_KEY to the package's API worker. Webhook requests and local report merging are purpose-related helpers, not install-time or import-time actions.
Static reason
High-risk behavior combination matched malicious policy.
Trigger
Webhook requests run when consumers call the helper functions; report merging runs during reporter finalization in local-testing mode.
Impact
The inspected behavior supports the package's testing and reporting features; no automatic credential exfiltration or unrelated account action was found.
Mechanism
The API client sends the package's Empirical API key to its configured API worker. The local reporter invokes Playwright's merge-reports command.
AI rationale
The flagged OpenAI credential flow is a false positive: the code states it no longer uses OPENAI_API_KEY and sends EMPIRICALRUN_API_KEY to the package's API worker. Webhook requests and local report merging are purpose-related helpers, not install-time or import-time actions.
Evidence
partial-playwright-reportpartial-summary.json
Network endpoints3
api.empirical.runwebhook.siteinbox.empirical.run
Decision evidence
public snapshotAI called this Clean at 97.0% confidence as Benign with low false-positive risk.
Evidence for AI clean decision
- The manifest has no lifecycle scripts; its main entry point is dist/index.js.
- The OpenAI-related code says the package no longer calls OpenAI directly with OPENAI_API_KEY.
- ApiWorkerClient reads EMPIRICALRUN_API_KEY and sends it as a bearer token to its configured API worker.
- Webhook network calls occur inside exported helper functions invoked with explicit arguments.
- The npx Playwright merge command is inside a local test-report helper, called during reporter finalization only when local testing is detected.
Evidence against
- The main entry point imports and re-exports the webhook module, so its helpers are available to consumers.
- The webhook helpers can contact webhook.site or Empirical’s inbox service when called.
- The reporter writes report output files and invokes a subprocess when its local-test path runs.
Behavioral surface
ChildProcessCryptoDynamicRequireEnvironmentVarsFilesystemNetworkShell
Source & flagged code
7 flaggeddist/reporter/local-test.jsView file
6exports.mergeForLocalTest = mergeForLocalTest;
L7: const child_process_1 = require("child_process");
L8: const path_1 = __importDefault(require("path"));
High
Child Process
Package source references child process execution.
dist/reporter/local-test.jsView on unpkg · L613try {
L14: (0, child_process_1.execFileSync)("npx", ["playwright", "merge-reports", outputDir, "--reporter", "html,json"], {
L15: cwd: currentWorkingDir,
High
Runtime Package Install
Package source invokes a package manager install command at runtime.
dist/reporter/local-test.jsView on unpkg · L13dist/kv.jsView file
3exports.KVClient = exports.KvPreconditionFailedError = void 0;
L4: const api_worker_client_1 = require("./api-worker-client");
L5: class KvPreconditionFailedError extends Error {
Findings
2 Critical5 High4 Medium5 Low
CriticalCredential Exfiltrationdist/webhook.js
CriticalTrigger Reachable Dangerous Capabilitydist/webhook.js
HighChild Processdist/reporter/local-test.js
HighShell
HighTrigger Reachable Credential Exfiltrationdist/webhook.js
HighTrigger Reachable External Post Callbackdist/webhook.js
HighRuntime Package Installdist/reporter/local-test.js
MediumDynamic Requiredist/kv.js
MediumNetwork
MediumEnvironment Vars
MediumStructural Risk Force Deep Review
LowScripts Present
LowFilesystem
LowHigh Entropy Strings
Affected versions and remediation
This report applies to @empiricalrun/playwright-utils@0.66.0.
See all versions of @empiricalrun/playwright-utils for other recorded verdicts.
- Review the evidence and your use of @empiricalrun/playwright-utils@0.66.0 before allowing it. Restrict the permissions described in this report.
- Choose an independently verified alternative or release. This report does not establish that other versions are safe.
Evidence last updated: .
Think this verdict is wrong? Dispute it on GitHub or read how reports are produced.