qa-foundry@0.2.4
QA Foundry - AI-Powered QA Automation Platform. Record tests, generate with AI, run Playwright tests, review with HITL, track results.
AI Security Review
scanned 3d ago · by lpm-firewall-aiThe credential transfer is conditional on a user-triggered auth-codegen flow, but it sends the raw captured script to an external AI provider without separate confirmation that login values may be included. This is a real credential-handling risk, though the conditional flow and intended AI extraction purpose make malicious intent uncertain.
Static reason
High-risk behavior combination matched malicious policy.
Trigger
A user stops an auth-codegen session and regex extraction misses the username or password.
Impact
Login credentials for the tested site may be disclosed to the AI provider without a separate confirmation for that transfer.
Mechanism
The handler sends the original Playwright script to the configured Google Generative AI model for credential extraction; hard-coded values in that script are included in the prompt.
AI rationale
The credential transfer is conditional on a user-triggered auth-codegen flow, but it sends the raw captured script to an external AI provider without separate confirmation that login values may be included. This is a real credential-handling risk, though the conditional flow and intended AI extraction purpose make malicious intent uncertain.
Evidence
dist/controllers/generate.controller.js
Decision evidence
public snapshotAI called this Suspicious at 90.0% confidence as Unknown with medium false-positive risk.
Evidence for warning
- When auth-codegen is stopped, the handler uses the captured Playwright script and falls back to AI if either credential field was not extracted.
- The fallback passes the original script as prompt content, including any hard-coded login values it contains.
- The prompt is sent to the configured Google Generative AI model using a project or server Gemini API key.
Evidence against
- The package is an AI-powered browser testing tool, and the helper is explicitly intended to extract credentials for replaying captured login tests.
- The transfer occurs during the user-triggered auth-codegen stop flow and only when regex extraction misses a field.
- The postinstall script installs Playwright browsers and their system dependencies, consistent with the package’s stated purpose.
Behavioral surface
ChildProcessCryptoDynamicRequireEnvironmentVarsEvalFilesystemNetworkShell
Source & flagged code
9 flaggedpackage.jsonView file
•scripts.postinstall = node -e "if (!process.env.QA_FOUNDRY_SKIP_BROWSER_INSTALL) require('child_process').execSync('npx playwright install --with-deps chromium firefox webkit', {stdio:'inherit', cwd:__d...
Critical
Red Install Lifecycle Script
Install-time lifecycle script matches a deterministic static-gate block pattern.
package.jsonView on unpkg•scripts.postinstall = node -e "if (!process.env.QA_FOUNDRY_SKIP_BROWSER_INSTALL) require('child_process').execSync('npx playwright install --with-deps chromium firefox webkit', {stdio:'inherit', cwd:__d...
High
Install Time Lifecycle Scripts
Package defines install-time lifecycle scripts.
package.jsonView on unpkgbin/cli.jsView file
11const fs = require('fs');
L12: const { spawn } = require('child_process');
L13:
High
Child Process
Package source references child process execution.
Findings
1 Critical6 High4 Medium6 Low
CriticalRed Install Lifecycle Scriptpackage.json
HighInstall Time Lifecycle Scriptspackage.json
HighChild Processbin/cli.js
HighShelldist/controllers/generate.controller.js
HighCross File Remote Execution Contextbin/cli.js
HighRuntime Package Installdist/index.js
HighSemantic Analysis Limiteddist/services/AgentPlannerService.js#virtual:normalized:round1
MediumDynamic Requirebin/server.js
MediumNetwork
MediumEnvironment Vars
MediumStructural Risk Force Deep Review
LowScripts Present
LowEvaldist/frontend/assets/index-Dp2Bk49z.js
Affected versions and remediation
This report applies to qa-foundry@0.2.4.
See all versions of qa-foundry for other recorded verdicts.
- Review the evidence and your use of qa-foundry@0.2.4 before allowing it. Restrict the permissions described in this report.
- Choose an independently verified alternative or release. This report does not establish that other versions are safe.
Evidence last updated: .
Think this verdict is wrong? Dispute it on GitHub or read how reports are produced.