registry / @activate-core/test-forge / 0.9.4

@activate-core/test-forge@0.9.4

AI-powered QA automation. Scans a project, drafts journey docs, and generates seeded Jest/Playwright tests. Works in any project, with any AI CLI.

AI Security Review

scanned 3h ago · by lpm-firewall-ai

No confirmed malicious attack surface is established. The package is an explicit QA-generation CLI that invokes a locally configured AI command and writes project test artifacts.

Static reason

One or more suspicious static signals were detected.; previous stored version diff introduced dangerous source

Trigger

User runs `testforge setup`, `discover`, `generate`, `update`, or `run` in a project.

Impact

It can read the target project and create configured test/docs artifacts; these actions are declared, package-aligned, and not install-time.

Mechanism

User-invoked AI-assisted test generation and test-run orchestration.

Rationale

The flagged process and environment-variable primitives implement the documented, explicitly invoked QA workflow. Source inspection found no hidden install-time execution, exfiltration, destructive behavior, remote payload execution, or unauthorized agent-control modification.

Evidence

package.jsondist/cli/index.jsdist/core/config.jsdist/core/ai-generator.jsdist/core/discover.jsdist/core/env-template.jsdist/core/run-tests.jstestforge.config.jsontestforge.mddocs/testforge.diff.md.testforge/source.json.testforge/cache.json.env.testing.examplegenerated-tests/

Decision evidence

public snapshot

AI called this Clean at 95.0% confidence as Benign with low false-positive risk.

Evidence for block

`dist/core/config.js` executes the user/project-configured AI CLI; setup phases grant Claude `acceptEdits`.
`dist/core/run-tests.js` runs configured test commands with `shell: true`, but only through explicit `testforge run`.

Evidence against

`package.json` has no preinstall, install, postinstall, or prepare hook.
`dist/cli/index.js` routes behavior only after an explicit `testforge` command.
`dist/core/ai-generator.js`, `seed-generator.js`, and `harness.js` limit Claude generation calls to read-only tools and write returned code only to generated outputs.
No direct HTTP client, credential transmission, eval/vm use, binary loading, or foreign AI-agent config mutation appears in `dist/`.
`dist/core/env-template.js` extracts environment-variable names and writes an example file; it does not export their values.

Behavioral surface

Source

ChildProcessCryptoEnvironmentVarsFilesystemShell

Supply chain

HighEntropyStrings

ManifestNo manifest risk signals triggered.

scanned 27 file(s), 135 KB of source

Source & flagged code

4 flagged

dist/core/discover.jsView file

Lines 1-36javascript

1/**

2 * testforge — journey discovery.

3 *

4 * Scans a project's source code using the local Claude CLI and asks

5 * it to identify user journeys (login, signup, checkout, etc.), then

6 * write a draft journey markdown file for each one into docs/.

7 *

8 * Important: discovery produces a DRAFT, not the final truth. The AI

9 * will miss some journeys and may guess wrong on others. A developer

10 * is expected to review and fix the generated markdown before relying

11 * on it (this matches the "human review" step of the workflow).

12 *

13 * We let the Claude CLI read the files itself (it has file-reading

14 * tools) rather than stuffing all source code into the prompt, which

15 * keeps this simple and works for projects of any size.

16 */

17import { execFileSync } from 'node:child_process';

18import { loadConfig, splitCommand, withEditTools } from './config.js';

High

Child Process

Package source references child process execution.

dist/core/discover.jsView on unpkg · L16

19import { DEEP_DOC_GUIDANCE } from './doc-guidance.js';

20import { promptConfirm } from './prompt.js';

21import { resolveDocsSource, saveSourceChoice, } from './source-of-truth.js';

22import { analyzeReference, draftDocsFromReference, DIFF_PATH, } from './reference.js';

23/** Scope line: one journey, or all of them. */

24function scopeLines(journey) {

25 return journey

26 ? [

27 `SCOPE: document ONLY the single journey matching "${journey}"`,

28 `(match by name, or by "area/name"). Create just that ONE file and`,

29 `ignore every other journey.`,

30 ``,

31 ]

32 : [`Document EVERY journey in the map (one file each).`, ``];

33}

34/** Build the discovery prompt. Optionally scoped to one journey. */

35export function buildDiscoverPrompt(srcDir, docsDir, journey) {

36 return [

dist/core/run-tests.jsView file

Lines 41-84javascript

41 const env = { ...process.env, ...envVars };

42 const areas = Object.keys(config.testOutput ?? {}).filter((a) => !opts.area || a === opts.area);

43 if

dist/core/ai-generator.jsView file

•matchType = previous_version_dangerous_delta matchedPackage = @activate-core/test-forge@0.5.0 matchedIdentity = npm:[redacted]:0.5.0 similarity = 0.783 summary = stored previous version shares package body but lacks this dangerous source file

Critical

Previous Version Dangerous Delta

This package version adds a dangerous source file absent from the previous stored version; route for source-aware review.

dist/core/ai-generator.jsView on unpkg

Source & flagged code

4 flagged · loading source

dist/core/discover.jsView file

16*/ L17: import { execFileSync } from 'node:child_process'; L18: import { loadConfig, splitCommand, withEditTools } from './config.js';

High

Child Process

Package source references child process execution.

dist/core/discover.jsView on unpkg · L16

dist/core/run-tests.jsView file

72console.log(`$ ${cmd} [cwd: ${root}]`); L73: const res = spawnSync(cmd, { shell: true, cwd: root, env, stdio: 'inherit' }); L74: if (res.status !== 0)

High

Shell

Package source references shell execution.

dist/core/run-tests.jsView on unpkg · L72

61const target = opts.journey ? `${rel}/${opts.journey}` : rel; L62: cmd = `npx playwright test ${target}`; L63: } ... L72: console.log(`$ ${cmd} [cwd: ${root}]`); L73: const res = spawnSync(cmd, { shell: true, cwd: root, env, stdio: 'inherit' }); L74: if (res.status !== 0)

High

Runtime Package Install

Package source invokes a package manager install command at runtime.

dist/core/run-tests.jsView on unpkg · L61

dist/core/ai-generator.jsView file

Critical

Previous Version Dangerous Delta

This package version adds a dangerous source file absent from the previous stored version; route for source-aware review.

dist/core/ai-generator.jsView on unpkg

Findings

1 Critical3 High2 Medium3 Low

CriticalPrevious Version Dangerous Deltadist/core/ai-generator.js

HighChild Processdist/core/discover.js

HighShelldist/core/run-tests.js

HighRuntime Package Installdist/core/run-tests.js

MediumEnvironment Vars

MediumStructural Risk Force Deep Review

LowScripts Present

LowFilesystem

LowHigh Entropy Strings

Source & flagged code

4 flagged

dist/core/discover.jsView file

Lines 1-36javascript

1/**

2 * testforge — journey discovery.

3 *

4 * Scans a project's source code using the local Claude CLI and asks

5 * it to identify user journeys (login, signup, checkout, etc.), then

6 * write a draft journey markdown file for each one into docs/.

7 *

8 * Important: discovery produces a DRAFT, not the final truth. The AI

9 * will miss some journeys and may guess wrong on others. A developer

10 * is expected to review and fix the generated markdown before relying

11 * on it (this matches the "human review" step of the workflow).

12 *

13 * We let the Claude CLI read the files itself (it has file-reading

14 * tools) rather than stuffing all source code into the prompt, which

15 * keeps this simple and works for projects of any size.

16 */

17import { execFileSync } from 'node:child_process';

18import { loadConfig, splitCommand, withEditTools } from './config.js';

High

Child Process

Package source references child process execution.

dist/core/discover.jsView on unpkg · L16

19import { DEEP_DOC_GUIDANCE } from './doc-guidance.js';

20import { promptConfirm } from './prompt.js';

21import { resolveDocsSource, saveSourceChoice, } from './source-of-truth.js';

22import { analyzeReference, draftDocsFromReference, DIFF_PATH, } from './reference.js';

23/** Scope line: one journey, or all of them. */

24function scopeLines(journey) {

25 return journey

26 ? [

27 `SCOPE: document ONLY the single journey matching "${journey}"`,

28 `(match by name, or by "area/name"). Create just that ONE file and`,

29 `ignore every other journey.`,

30 ``,

31 ]

32 : [`Document EVERY journey in the map (one file each).`, ``];

33}

34/** Build the discovery prompt. Optionally scoped to one journey. */

35export function buildDiscoverPrompt(srcDir, docsDir, journey) {

36 return [

dist/core/run-tests.jsView file

Lines 41-84javascript

41 const env = { ...process.env, ...envVars };

42 const areas = Object.keys(config.testOutput ?? {}).filter((a) => !opts.area || a === opts.area);

43 if

dist/core/ai-generator.jsView file

Critical

Previous Version Dangerous Delta

This package version adds a dangerous source file absent from the previous stored version; route for source-aware review.

dist/core/ai-generator.jsView on unpkg