smart_ide/services/ia_dev/git-issues/mail-list-unread.py
Nicolas Cantu 58cc2493e5 chore: consolidate ia_dev module, sync tooling, and harden gateways (0.0.5)
Initial state:
- ia_dev was historically referenced as ./ia_dev in docs and integrations, while the vendored module lives under services/ia_dev.
- AnythingLLM sync and hook installation had error masking / weak exit signaling.
- Proxy layers did not validate proxy path segments, allowing path normalization tricks.

Motivation:
- Make the IDE-oriented workflow usable (sync -> act -> deploy/preview) with explicit errors.
- Reduce security footguns in proxying and script automation.

Resolution:
- Standardize IA_DEV_ROOT usage and documentation to services/ia_dev.
- Add SSH remote data mirroring + optional AnythingLLM ingestion.
- Extend AnythingLLM pull sync to support upload-all/prefix and fail on upload errors.
- Harden smart-ide-sso-gateway and smart-ide-global-api proxying with safe-path checks and non-leaking error responses.
- Improve ia-dev-gateway runner validation and reduce sensitive path leakage.
- Add site scaffold tool (Vite/React) with OIDC + chat via sso-gateway -> orchestrator.

Root cause:
- Historical layout changes (submodule -> vendored tree) and missing central contracts for path resolution.
- Missing validation for proxy path traversal patterns.
- Overuse of silent fallbacks (|| true, exit 0 on partial failures) in automation scripts.

Impacted features:
- Project sync: git pull + AnythingLLM sync + remote data mirror ingestion.
- Site frontends: SSO gateway proxy and orchestrator intents (rag.query, chat.local).
- Agent execution: ia-dev-gateway script runner and SSE output.

Code modified:
- scripts/remote-data-ssh-sync.sh
- scripts/anythingllm-pull-sync/sync.mjs
- scripts/install-anythingllm-post-merge-hook.sh
- cron/git-pull-project-clones.sh
- services/smart-ide-sso-gateway/src/server.ts
- services/smart-ide-global-api/src/server.ts
- services/smart-ide-orchestrator/src/server.ts
- services/ia-dev-gateway/src/server.ts
- services/ia_dev/tools/site-generate.sh

Documentation modified:
- docs/** (architecture, API docs, ia_dev module + integration, scripts)

Configurations modified:
- config/services.local.env.example
- services/*/.env.example

Files in deploy modified:
- services/ia_dev/deploy/*

Files in logs impacted:
- logs/ia_dev.log (runtime only)
- .logs/* (runtime only)

Databases and other sources modified:
- None

Off-project modifications:
- None

Files in .smartIde modified:
- .smartIde/agents/*.md
- services/ia_dev/.smartIde/**

Files in .secrets modified:
- None

New patch version in VERSION:
- 0.0.5

CHANGELOG.md updated:
- yes
2026-04-04 18:36:43 +02:00

119 lines
4.2 KiB
Python
Executable File

#!/usr/bin/env python3
"""
List unread emails via IMAP (e.g. Proton Mail Bridge). Read-only; does not mark as read.
Only lists messages sent to the configured alias (MAIL_FILTER_TO, default ai.support.lecoffreio@4nkweb.com).
Output is for the agent: each mail with UID, Message-ID, From, To, Subject, Date, body.
Usage: ./git-issues/mail-list-unread.sh
"""
from __future__ import annotations
import email
import imaplib
import sys
from email.header import decode_header
from pathlib import Path
# Add git-issues to path for mail_common
sys.path.insert(0, str(Path(__file__).resolve().parent))
from mail_common import imap_search_criterion_unseen, load_imap_config, repo_root, imap_ssl_context
def decode_header_value(header: str | None) -> str:
if not header:
return ""
from email.header import decode_header as dh
parts = dh(header)
result = []
for part, charset in parts:
if isinstance(part, bytes):
result.append(part.decode(charset or "utf-8", errors="replace"))
else:
result.append(part)
return "".join(result)
def get_text_body(msg: email.message.Message) -> str:
if msg.is_multipart():
for part in msg.walk():
if part.get_content_type() == "text/plain":
payload = part.get_payload(decode=True)
if payload:
return payload.decode(part.get_content_charset() or "utf-8", errors="replace")
return ""
payload = msg.get_payload(decode=True)
if not payload:
return ""
return payload.decode(msg.get_content_charset() or "utf-8", errors="replace")
def is_sent_to_alias(msg: email.message.Message, filter_to: str) -> bool:
"""True if any To/Delivered-To/X-Original-To/Cc header contains the filter address."""
if not filter_to:
return True
headers_to_check = ("To", "Delivered-To", "X-Original-To", "Cc", "Envelope-To")
for name in headers_to_check:
value = msg.get(name)
if value:
decoded = decode_header_value(value).lower()
if filter_to in decoded:
return True
return False
def main() -> None:
cfg = load_imap_config()
if not cfg["user"] or not cfg["password"]:
root = repo_root()
env_path = root / ".secrets" / "git-issues" / "imap-bridge.env"
print("[git-issues] ERROR: IMAP_USER and IMAP_PASSWORD required.", file=sys.stderr)
print(f"[git-issues] Set env or create {env_path}", file=sys.stderr)
sys.exit(1)
mail = imaplib.IMAP4(cfg["host"], int(cfg["port"]))
if cfg["use_starttls"]:
mail.starttls(imap_ssl_context(cfg.get("ssl_verify", True)))
mail.login(cfg["user"], cfg["password"])
mail.select("INBOX")
criterion = imap_search_criterion_unseen()
_, nums = mail.search(None, criterion)
ids = nums[0].split()
if not ids:
print("[git-issues] No unread messages (IMAP UNSEEN, on or after MAIL_SINCE_DATE). For spooler criterion (from/to), use tickets-fetch-inbox.sh and list-pending-spooler.sh.")
mail.logout()
return
shown = 0
for uid in ids:
uid_s = uid.decode("ascii")
_, data = mail.fetch(uid, "(RFC822)")
if not data or not data[0]:
continue
msg = email.message_from_bytes(data[0][1])
if not is_sent_to_alias(msg, cfg.get("filter_to", "")):
continue
mid = msg.get("Message-ID", "").strip()
from_ = decode_header_value(msg.get("From"))
to_ = decode_header_value(msg.get("To"))
subj = decode_header_value(msg.get("Subject"))
date_h = decode_header_value(msg.get("Date"))
body = get_text_body(msg)
print("--- MAIL", f"UID={uid_s}", "---")
print("Message-ID:", mid or "(none)")
print("From:", from_)
print("To:", to_ or "")
print("Subject:", subj)
print("Date:", date_h or "")
print("Body:")
print(body or "(empty)")
print("--- END MAIL ---")
shown += 1
if shown == 0:
print("[git-issues] No unread messages sent to the configured alias (MAIL_FILTER_TO). For spooler (from/to in conf.json), use tickets-fetch-inbox.sh and list-pending-spooler.sh.")
mail.logout()
if __name__ == "__main__":
main()