* feat(ghidra): decode Swift String literals in function dossiers Swift passes a String as two words. Small literals keep their UTF-8 bytes inside those words, and immortal large literals keep a count plus a pointer to their bytes biased by 32. Ghidra creates no data reference for either, so analyze_function reported no strings for Swift code. On AArch64 programs that contain Swift metadata, the Ghidra bridge now runs constant propagation over the function and decodes register pairs where Swift consumes a String: consecutive argument registers at calls and tail calls, x0 and x1 at returns, and both registers of one STP. Large literals must resolve to terminated bytes inside one initialized block that is not executable. A pair whose registers both come from conditional selects is skipped, because Ghidra forks each select without correlating the condition and could otherwise pair words from different cases. Decoded values are a derivation from the ABI layout rather than observed references, so they appear in a new optional swift_string_literals field with their source instruction, registers and raw words, and in a matching inspect_analysis_view facet. referenced_strings is unchanged. Refs #2030 * fix(ghidra): bound Swift literal reads and compare decoded strings Large immortal literals are measured against the remaining heap before allocation, and a failed fit stays visible as a limitation. The canonical empty string is kept. Small and large literals now require matching address nullability, and function comparison treats decoded literals as string evidence without equating a missing record to an empty one. * fix(ghidra): budget Swift literal decoding and tighten use sites Large literals now draw on one heap budget per dossier, measured once before decoding, instead of a separate check per literal. A literal that does not fit is listed in a new swift_string_literal_omissions field with its address, byte length and reason, so consumers read omissions from structured data rather than from limitation text. strings_names comparison checks referenced strings and names first and reports a change there even when Swift literal coverage differs; it returns unknown only when those facts match and literal coverage is absent on one side or partial. A computed jump counts as a tail call only when it has no resolved target inside the function, so jump tables no longer qualify, and a return requires a RETURN p-code operation, so traps no longer qualify. Decoded literals keep control characters, which Swift strings may contain and JSON escapes. The Swift verifier builds the literal fixture for arm64 on any Mac host and now also covers the empty string and a literal containing a tab. * fix(ghidra): charge escaped JSON and follow copied selects The Swift literal budget now charges the worst case per UTF-8 byte: UTF-16 text, six escaped JSON characters held in Gson's growing buffer and in the returned String, and the UTF-8 bytes written to the socket. Literals made of control characters can no longer exceed the reserved heap. A jump counts as a tail call only when every resolved target lies outside the function. The conditional select check follows register copies back to their definition, so selects copied into argument registers are recognized like selects written there directly. strings_names reports a change when both dossiers decoded different literals at the same use site, even when either side has omissions; it returns unknown only when no such use site disagrees. * fix(ghidra): bound literal records and trace selects across branches Every Swift literal record now pays a fixed cost against the dossier budget in addition to its text, so many empty or small literals are bounded as well. The first record that does not fit is kept as an omission and decoding stops there, which keeps the omission record itself bounded; omissions now describe small or large literals. The conditional select check searches every predecessor path for the reaching definitions, following register copies, so selects made before a branch into the use block are recognized. A dossier records Swift literals and their omissions together. Coverage reads omissions first, and strings_names compares every use site that neither side omitted: a decoded literal is known where it was recorded, and an absence is known only in a dossier whose decoding examined every use site. * fix(ghidra): stop every flow at the literal budget and route omissions Ending one flow from the evaluator leaves other queued flows running, so the budget now records a shared stop that every flow checks before it examines another instruction. A record that exceeds the budget is routed by that capacity result rather than by whether text was decoded, so a small literal over budget becomes an omission instead of a literal. When coverage is partial, the per site comparison keeps each literal's representation as well as its value, matching the full strings_names projection. * fix(ghidra): keep unresolved Swift tail-call sites unknown --------- Co-authored-by: Cursor Agent <cursoragent@cursor.com> Co-authored-by: morluto <76467478+morluto@users.noreply.github.com>
230 lines
7.4 KiB
JavaScript
230 lines
7.4 KiB
JavaScript
#!/usr/bin/env node
|
|
import assert from "node:assert/strict";
|
|
import { execFile } from "node:child_process";
|
|
import { copyFile, mkdir, mkdtemp, rm } from "node:fs/promises";
|
|
import { tmpdir } from "node:os";
|
|
import { join } from "node:path";
|
|
import { fileURLToPath } from "node:url";
|
|
import { promisify } from "node:util";
|
|
import { Client } from "@modelcontextprotocol/client";
|
|
import { StdioClientTransport } from "@modelcontextprotocol/client/stdio";
|
|
import { inspectGhidraInstallation } from "../dist/ghidra/GhidraInstallation.js";
|
|
import { toolContract } from "../dist/contracts/toolContracts.js";
|
|
import { requireMcpOperationResult } from "./lib/mcp-verifier-results.mjs";
|
|
import { createVerifierRun, completeVerifierRun } from "./lib/verifier-run.mjs";
|
|
|
|
const execute = promisify(execFile);
|
|
const run = createVerifierRun();
|
|
const installation = inspectGhidraInstallation({
|
|
environment: process.env,
|
|
installDir: process.env.GHIDRA_INSTALL_DIR,
|
|
javaHome: process.env.JAVA_HOME,
|
|
});
|
|
if (process.platform !== "darwin" || installation.status !== "available")
|
|
throw new Error(
|
|
"verify:ghidra:swift requires macOS, Ghidra 12.1.4 with its native decompiler, and JDK 21; set GHIDRA_INSTALL_DIR and JAVA_HOME.",
|
|
);
|
|
try {
|
|
await execute("swiftc", ["--version"], { timeout: 10_000 });
|
|
} catch (cause) {
|
|
throw new Error(
|
|
"verify:ghidra:swift requires the host Swift compiler (swiftc).",
|
|
{ cause },
|
|
);
|
|
}
|
|
const root = await mkdtemp(join(tmpdir(), "rea-ghidra-swift-"));
|
|
const client = new Client({ name: "ghidra-swift-verifier", version: "1" });
|
|
const transport = new StdioClientTransport({
|
|
command: process.execPath,
|
|
args: [fileURLToPath(new URL("./rea.mjs", import.meta.url)), "mcp"],
|
|
env: Object.fromEntries(
|
|
Object.entries(process.env).filter(([, value]) => value !== undefined),
|
|
),
|
|
stderr: "pipe",
|
|
});
|
|
const source = fileURLToPath(
|
|
new URL("../tests/conformance/swift/type-inventory.swift", import.meta.url),
|
|
);
|
|
const literalSource = fileURLToPath(
|
|
new URL("../tests/conformance/swift/string-literals.swift", import.meta.url),
|
|
);
|
|
const binary = join(root, "swift-inventory");
|
|
const literalBinary = join(root, "swift-literals");
|
|
const reports = [];
|
|
let literalReport;
|
|
try {
|
|
await execute("swiftc", ["-O", "-g", source, "-o", binary], {
|
|
timeout: 60_000,
|
|
});
|
|
await mkdir(join(root, "copied"));
|
|
const copied = join(root, "copied", "swift-inventory");
|
|
await copyFile(binary, copied);
|
|
// Decoding covers AArch64 register pairs, so build that slice on any Mac host.
|
|
await execute(
|
|
"swiftc",
|
|
[
|
|
"-O",
|
|
"-target",
|
|
"arm64-apple-macosx13.0",
|
|
literalSource,
|
|
"-o",
|
|
literalBinary,
|
|
],
|
|
{ timeout: 60_000 },
|
|
);
|
|
await client.connect(transport);
|
|
for (const [variant, path] of [
|
|
["debug", binary],
|
|
["without-dsym", copied],
|
|
]) {
|
|
await call("open_binary", { path, provider_id: "ghidra" });
|
|
try {
|
|
const procedures = await call("list_procedures", {});
|
|
const inventory = await call("analyze_swift_types", {});
|
|
assert(
|
|
inventory.total > 0,
|
|
"Swift procedures disappeared from the inventory",
|
|
);
|
|
assert(
|
|
inventory.categories.other.count > 0,
|
|
"Top-level Swift symbols were lost",
|
|
);
|
|
const structs = await call("analyze_swift_types", {
|
|
category: "structs",
|
|
});
|
|
assert(
|
|
structs.categories.structs.count > 0,
|
|
"Modern struct symbols were lost",
|
|
);
|
|
const metadata = await call("analyze_swift_types", {
|
|
category: "structs",
|
|
pattern: "VMa",
|
|
});
|
|
assert.equal(
|
|
metadata.total,
|
|
2,
|
|
"Pair and Scorer metadata accessors must both be classified",
|
|
);
|
|
const pair = await call("analyze_swift_types", {
|
|
category: "structs",
|
|
pattern: "Pair",
|
|
});
|
|
assert(pair.total > 0, "Literal name filtering lost Pair symbols");
|
|
const unresolved = await call("analyze_swift_types", {
|
|
category: "structs",
|
|
pattern: "swiftIndirect",
|
|
});
|
|
assert(
|
|
unresolved.unclassified.length > 0,
|
|
"Unsupported categories must remain explicit",
|
|
);
|
|
const entries = Object.values(inventory.categories).flatMap(
|
|
(category) => category.items,
|
|
);
|
|
assert.equal(
|
|
new Set(entries.map((entry) => entry.name)).size,
|
|
inventory.total,
|
|
);
|
|
assert(
|
|
!entries.some(
|
|
(entry) =>
|
|
entry.name === "entry" || entry.name === "_swift_allocObject",
|
|
),
|
|
);
|
|
for (const entry of entries)
|
|
assert(
|
|
procedures.some(
|
|
(procedure) =>
|
|
procedure.address === entry.address &&
|
|
procedure.value === entry.name,
|
|
),
|
|
);
|
|
reports.push({
|
|
variant,
|
|
total: inventory.total,
|
|
structs: structs.total,
|
|
metadata_accessors: metadata.total,
|
|
unclassified: inventory.unclassified.length,
|
|
});
|
|
} finally {
|
|
await call("close_binary", {});
|
|
}
|
|
}
|
|
literalReport = await verifyStringLiterals();
|
|
} finally {
|
|
await client.close();
|
|
await transport.close();
|
|
await rm(root, { recursive: true, force: true });
|
|
}
|
|
console.log(
|
|
JSON.stringify(
|
|
{
|
|
ok: true,
|
|
provider: "ghidra",
|
|
fixtures: reports,
|
|
swift_string_literals: literalReport,
|
|
verifier_run: await completeVerifierRun(run),
|
|
},
|
|
null,
|
|
2,
|
|
),
|
|
);
|
|
|
|
async function call(name, arguments_) {
|
|
const response = await client.callTool(
|
|
{ name, arguments: arguments_ },
|
|
{ timeout: 180_000 },
|
|
);
|
|
if (name === "analyze_swift_types")
|
|
toolContract(name).outputSchema.parse(response.structuredContent);
|
|
return requireMcpOperationResult(response, name);
|
|
}
|
|
|
|
// Literal text lives only in register constants, so it must come from the decoded pairs.
|
|
async function verifyStringLiterals() {
|
|
await call("open_binary", { path: literalBinary, provider_id: "ghidra" });
|
|
try {
|
|
const procedures = await call("list_procedures", {});
|
|
const expected = {
|
|
smallLiteral: [["SleepDisabled", "small"]],
|
|
largeLiteral: [["The power setting could not be changed.", "large"]],
|
|
unicodeLiterals: [
|
|
["café", "small"],
|
|
["Résumé of the naïve décor, written twice", "large"],
|
|
],
|
|
emptyAndControlLiterals: [
|
|
["", "small"],
|
|
["tab\there", "small"],
|
|
],
|
|
returnedLiteral: [["Holding awake", "small"]],
|
|
};
|
|
const decoded = {};
|
|
for (const [name, literals] of Object.entries(expected)) {
|
|
const procedure = procedures.find(({ value }) => value.includes(name));
|
|
assert(procedure, `${name} is missing from the procedure inventory`);
|
|
const dossier = await call("analyze_function", {
|
|
procedure: procedure.address,
|
|
});
|
|
const observed = dossier.swift_string_literals;
|
|
assert(Array.isArray(observed), `${name} recorded no Swift literals`);
|
|
assert.deepEqual(dossier.swift_string_literal_omissions, []);
|
|
assert.deepEqual(
|
|
observed.map(({ value, representation }) => [value, representation]),
|
|
literals,
|
|
);
|
|
for (const literal of observed) {
|
|
assert.deepEqual(literal.registers, ["x0", "x1"]);
|
|
assert.equal(
|
|
literal.address === null,
|
|
literal.representation === "small",
|
|
`${literal.value} storage does not match its representation`,
|
|
);
|
|
}
|
|
decoded[name] = observed.length;
|
|
}
|
|
return decoded;
|
|
} finally {
|
|
await call("close_binary", {});
|
|
}
|
|
}
|