smart_ide/services/ia_dev/git-issues/write-response-spooler.py
Nicolas Cantu 58cc2493e5 chore: consolidate ia_dev module, sync tooling, and harden gateways (0.0.5)
Initial state:
- ia_dev was historically referenced as ./ia_dev in docs and integrations, while the vendored module lives under services/ia_dev.
- AnythingLLM sync and hook installation had error masking / weak exit signaling.
- Proxy layers did not validate proxy path segments, allowing path normalization tricks.

Motivation:
- Make the IDE-oriented workflow usable (sync -> act -> deploy/preview) with explicit errors.
- Reduce security footguns in proxying and script automation.

Resolution:
- Standardize IA_DEV_ROOT usage and documentation to services/ia_dev.
- Add SSH remote data mirroring + optional AnythingLLM ingestion.
- Extend AnythingLLM pull sync to support upload-all/prefix and fail on upload errors.
- Harden smart-ide-sso-gateway and smart-ide-global-api proxying with safe-path checks and non-leaking error responses.
- Improve ia-dev-gateway runner validation and reduce sensitive path leakage.
- Add site scaffold tool (Vite/React) with OIDC + chat via sso-gateway -> orchestrator.

Root cause:
- Historical layout changes (submodule -> vendored tree) and missing central contracts for path resolution.
- Missing validation for proxy path traversal patterns.
- Overuse of silent fallbacks (|| true, exit 0 on partial failures) in automation scripts.

Impacted features:
- Project sync: git pull + AnythingLLM sync + remote data mirror ingestion.
- Site frontends: SSO gateway proxy and orchestrator intents (rag.query, chat.local).
- Agent execution: ia-dev-gateway script runner and SSE output.

Code modified:
- scripts/remote-data-ssh-sync.sh
- scripts/anythingllm-pull-sync/sync.mjs
- scripts/install-anythingllm-post-merge-hook.sh
- cron/git-pull-project-clones.sh
- services/smart-ide-sso-gateway/src/server.ts
- services/smart-ide-global-api/src/server.ts
- services/smart-ide-orchestrator/src/server.ts
- services/ia-dev-gateway/src/server.ts
- services/ia_dev/tools/site-generate.sh

Documentation modified:
- docs/** (architecture, API docs, ia_dev module + integration, scripts)

Configurations modified:
- config/services.local.env.example
- services/*/.env.example

Files in deploy modified:
- services/ia_dev/deploy/*

Files in logs impacted:
- logs/ia_dev.log (runtime only)
- .logs/* (runtime only)

Databases and other sources modified:
- None

Off-project modifications:
- None

Files in .smartIde modified:
- .smartIde/agents/*.md
- services/ia_dev/.smartIde/**

Files in .secrets modified:
- None

New patch version in VERSION:
- 0.0.5

CHANGELOG.md updated:
- yes
2026-04-04 18:36:43 +02:00

67 lines
2.5 KiB
Python

#!/usr/bin/env python3
"""
Update the single spooler file for a message after sending a reply.
One file per message: read the .pending file (same base), add response data and set status to responded, write back.
No separate .response file; no file deletion.
Usage: ./git-issues/write-response-spooler.sh --base <base> --to <addr> --subject "..." --body "..." [--in-reply-to "<msg-id>"]
base = filename base without extension (e.g. 2026-03-14T094530.a1b2c3d4.user_example.com).
"""
from __future__ import annotations
import argparse
import json
import sys
from datetime import datetime, timezone
from pathlib import Path
sys.path.insert(0, str(Path(__file__).resolve().parent))
from project_config import data_issues_dir, load_project_config
def main() -> int:
conf = load_project_config()
if not conf:
print("[write-response-spooler] No project config.", file=sys.stderr)
return 1
spool = data_issues_dir()
spool.mkdir(parents=True, exist_ok=True)
ap = argparse.ArgumentParser(description="Update spooler file in place after sending reply")
ap.add_argument("--base", required=True, help="Base name (e.g. 2026-03-14T094530.a1b2c3d4.user_example.com)")
ap.add_argument("--to", required=True, help="Recipient address")
ap.add_argument("--subject", required=True, help="Subject sent")
ap.add_argument("--body", required=True, help="Body sent")
ap.add_argument("--in-reply-to", default="", help="Message-ID we replied to")
args = ap.parse_args()
base = args.base.strip()
if not base or "/" in base or ".." in base:
print("[write-response-spooler] Invalid --base.", file=sys.stderr)
return 1
path = spool / f"{base}.pending"
if not path.exists():
print(f"[write-response-spooler] No such file: {path.name}", file=sys.stderr)
return 1
try:
data = json.loads(path.read_text(encoding="utf-8"))
except (json.JSONDecodeError, OSError) as e:
print(f"[write-response-spooler] Read error: {e}", file=sys.stderr)
return 1
now = datetime.now(timezone.utc).strftime("%Y-%m-%dT%H:%M:%SZ")
data["status"] = "responded"
data["response"] = {
"in_reply_to_message_id": args.in_reply_to or "",
"to": args.to.strip(),
"subject": args.subject.strip(),
"body": args.body,
"sent_at": now,
}
path.write_text(json.dumps(data, ensure_ascii=False, indent=2), encoding="utf-8")
print(f"[write-response-spooler] Updated {path.name} (status=responded)")
return 0
if __name__ == "__main__":
sys.exit(main())