Nicolas Cantu 58cc2493e5 chore: consolidate ia_dev module, sync tooling, and harden gateways (0.0.5)
Initial state:
- ia_dev was historically referenced as ./ia_dev in docs and integrations, while the vendored module lives under services/ia_dev.
- AnythingLLM sync and hook installation had error masking / weak exit signaling.
- Proxy layers did not validate proxy path segments, allowing path normalization tricks.

Motivation:
- Make the IDE-oriented workflow usable (sync -> act -> deploy/preview) with explicit errors.
- Reduce security footguns in proxying and script automation.

Resolution:
- Standardize IA_DEV_ROOT usage and documentation to services/ia_dev.
- Add SSH remote data mirroring + optional AnythingLLM ingestion.
- Extend AnythingLLM pull sync to support upload-all/prefix and fail on upload errors.
- Harden smart-ide-sso-gateway and smart-ide-global-api proxying with safe-path checks and non-leaking error responses.
- Improve ia-dev-gateway runner validation and reduce sensitive path leakage.
- Add site scaffold tool (Vite/React) with OIDC + chat via sso-gateway -> orchestrator.

Root cause:
- Historical layout changes (submodule -> vendored tree) and missing central contracts for path resolution.
- Missing validation for proxy path traversal patterns.
- Overuse of silent fallbacks (|| true, exit 0 on partial failures) in automation scripts.

Impacted features:
- Project sync: git pull + AnythingLLM sync + remote data mirror ingestion.
- Site frontends: SSO gateway proxy and orchestrator intents (rag.query, chat.local).
- Agent execution: ia-dev-gateway script runner and SSE output.

Code modified:
- scripts/remote-data-ssh-sync.sh
- scripts/anythingllm-pull-sync/sync.mjs
- scripts/install-anythingllm-post-merge-hook.sh
- cron/git-pull-project-clones.sh
- services/smart-ide-sso-gateway/src/server.ts
- services/smart-ide-global-api/src/server.ts
- services/smart-ide-orchestrator/src/server.ts
- services/ia-dev-gateway/src/server.ts
- services/ia_dev/tools/site-generate.sh

Documentation modified:
- docs/** (architecture, API docs, ia_dev module + integration, scripts)

Configurations modified:
- config/services.local.env.example
- services/*/.env.example

Files in deploy modified:
- services/ia_dev/deploy/*

Files in logs impacted:
- logs/ia_dev.log (runtime only)
- .logs/* (runtime only)

Databases and other sources modified:
- None

Off-project modifications:
- None

Files in .smartIde modified:
- .smartIde/agents/*.md
- services/ia_dev/.smartIde/**

Files in .secrets modified:
- None

New patch version in VERSION:
- 0.0.5

CHANGELOG.md updated:
- yes
2026-04-04 18:36:43 +02:00

89 lines
3.0 KiB
Bash
Executable File

#!/usr/bin/env bash
#
# Test Gitea Wiki API for repo 4nk/lecoffre_ng.
# Requires GITEA_TOKEN or .secrets/git-issues/token (same as issues scripts).
# Usage: ./wiki-api-test.sh [--create]
# --create: create a test page then delete it (checks write access).
#
set -euo pipefail
GIT_ISSUES_DIR="${GIT_ISSUES_DIR:-$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)}"
# shellcheck source=lib.sh
source "${GIT_ISSUES_DIR}/lib.sh"
REPO_PATH="/repos/${GITEA_REPO_OWNER}/${GITEA_REPO_NAME}"
# Branch ref for wiki (default branch of wiki repo; use master when wiki is configured on master)
GITEA_WIKI_REF="${GITEA_WIKI_REF:-master}"
WIKI_PAGES="${REPO_PATH}/wiki/pages?ref=${GITEA_WIKI_REF}"
WIKI_PAGE="${REPO_PATH}/wiki/page"
WIKI_NEW="${REPO_PATH}/wiki/new"
do_create=false
while [[ $# -gt 0 ]]; do
case "$1" in
--create) do_create=true; shift ;;
*) log_err "Unknown option: $1"; exit 1 ;;
esac
done
if ! load_gitea_token 2>/dev/null; then
log_err "No GITEA_TOKEN and no .secrets/git-issues/token. Set token to run wiki API tests."
exit 1
fi
require_jq || exit 1
echo "=== 1. GET ${WIKI_PAGES} (list wiki pages) ==="
RESPONSE="$(gitea_api_get "${WIKI_PAGES}")"
if echo "$RESPONSE" | jq -e . &>/dev/null; then
if echo "$RESPONSE" | jq -e 'type == "array"' &>/dev/null; then
COUNT="$(echo "$RESPONSE" | jq 'length')"
log_info "List OK: ${COUNT} page(s)"
echo "$RESPONSE" | jq -r '.[] | " - \(.title)"' 2>/dev/null || echo "$RESPONSE" | jq .
else
log_info "Response: $(echo "$RESPONSE" | jq -c . 2>/dev/null || echo "$RESPONSE")"
fi
else
log_err "Response (first 300 chars): ${RESPONSE:0:300}"
fi
echo ""
echo "=== 2. GET ${WIKI_PAGE}/Home (get one page, ref=${GITEA_WIKI_REF}) ==="
RESPONSE="$(gitea_api_get "${WIKI_PAGE}/Home?ref=${GITEA_WIKI_REF}")"
if echo "$RESPONSE" | jq -e .title &>/dev/null; then
log_info "Page OK: title=$(echo "$RESPONSE" | jq -r .title)"
echo "$RESPONSE" | jq '{ title, html_url, commit_count }'
else
log_info "Response: $(echo "$RESPONSE" | jq -c . 2>/dev/null || echo "${RESPONSE:0:200}")"
fi
if [[ "$do_create" != true ]]; then
log_info "Done. Use --create to test POST wiki page and DELETE."
exit 0
fi
echo ""
echo "=== 3. POST ${WIKI_NEW} (create test page) ==="
TEST_TITLE="Api-test-$(date +%s)"
CONTENT="# Test\nCreated by wiki-api-test.sh. Safe to delete."
CONTENT_B64="$(echo -n "$CONTENT" | base64 -w 0)"
BODY="$(jq -n --arg title "$TEST_TITLE" --arg content "$CONTENT_B64" --arg msg "wiki-api-test.sh" \
'{ title: $title, content_base64: $content, message: $msg }')"
RESPONSE="$(gitea_api_post "${WIKI_NEW}" "$BODY")"
if echo "$RESPONSE" | jq -e .title &>/dev/null; then
log_info "Create OK: $(echo "$RESPONSE" | jq -r .title)"
CREATED_TITLE="$TEST_TITLE"
else
log_err "Create failed: ${RESPONSE:0:300}"
exit 1
fi
echo ""
echo "=== 4. DELETE ${WIKI_PAGE}/${CREATED_TITLE} (remove test page) ==="
RESPONSE="$(gitea_api_delete "${WIKI_PAGE}/${CREATED_TITLE}")"
# DELETE often returns 204 No Content
log_info "Delete sent (204 or empty body = success)."
echo ""
log_info "All wiki API tests completed."