{"title":"자가 치유 테스트 파이프라인","slug":"self-healing-tests","category":"guides","summary":"Synapse 메모리를 사용하여 실패로부터 학습하고 자동으로 적응하는 테스트 파이프라인 구축.","audience":["human","llm"],"tags":["guide","testing","self-healing","ci"],"difficulty":"advanced","updated":"2026-06-27","word_count":236,"read_minutes":1,"lang":"ko","translated":true,"requested_lang":"ko","content_markdown":"\n# 자가 치유 테스트 파이프라인\n\n전통적인 테스트 스위트는 UI가 변경되면 깨집니다. 자가 치유 테스트는 Synapse\n메모리를 사용하여 과거 실패로부터 학습하고 적응합니다 — 불안정한 테스트와\n유지 관리 부담을 줄입니다.\n\n## 개념\n\n```\n┌─────────┐  fails   ┌──────────┐  store   ┌──────────┐\n│  Test   │ ───────▶ │  Synapse │ ───────▶ │ Memories │\n│  Run    │          │  Memory  │          │ (failures)│\n└─────────┘          └──────────┘          └──────────┘\n                           ▲                     │\n                           │   recall            │\n                           │  before next run    │\n                           └─────────────────────┘\n```\n\n1. 테스트 실행\n2. 실패하면, 실패 저장 (무엇이 잘못되었는지, 왜, 어떻게 수정하는지)\n3. 다음 실행: 실행 전 관련 실패 회상\n4. 알려진 수정 자동 적용\n\n## 구현\n\n### 1단계: 테스트 래퍼\n\n각 테스트를 메모리 회상/저장으로 래핑:\n\n```python\nimport requests\nfrom datetime import datetime\n\nURL = \"https://synapse.schaefer.zone\"\nMIND_KEY = \"mk_...\"\n\ndef self_healing_test(test_name, test_fn):\n    \"\"\"Decorator: wrap a test with self-healing memory.\"\"\"\n    def wrapper():\n        # 1. Recall past failures for this test\n        past_failures = requests.get(\n            f\"{URL}/memory/search?q={test_name}+failure\",\n            headers={\"Authorization\": f\"Bearer {MIND_KEY}\"}\n        ).json()\n        \n        # 2. Run test with failure context\n        try:\n            test_fn(known_failures=past_failures)\n        except Exception as e:\n            # 3. Store the failure\n            store_failure(test_name, e, traceback.format_exc())\n            raise\n    \n    return wrapper\n\ndef store_failure(test_name, error, traceback_str):\n    requests.post(f\"{URL}/memory\",\n        headers={\"Authorization\": f\"Bearer {MIND_KEY}\",\n                 \"Content-Type\": \"application/json\"},\n        json={\n            \"category\": \"mistake\",\n            \"key\": f\"test_failure_{test_name}_{datetime.now().isoformat()}\",\n            \"content\": f\"Test: {test_name}\\nError: {error}\\nTrace:\\n{traceback_str}\",\n            \"tags\": [\"test\", \"failure\", test_name],\n            \"priority\": \"high\"\n        })\n```\n\n### 2단계: 적응형 테스트 로직\n\n테스트 내에서 알려진 실패를 확인하고 수정 적용:\n\n```python\n@self_healing_test\ndef test_login_page(browser, known_failures=None):\n    browser.goto(\"https://app.com/login\")\n    \n    # Check if we've seen this page change before\n    if known_failures and known_failures.get(\"results\"):\n        for failure in known_failures[\"results\"]:\n            if \"button moved\" in failure[\"content\"].lower():\n                # Use accessibility label instead of coordinates\n                browser.click(by_label=\"Login button\")\n                return\n    \n    # Default: use coordinates\n    browser.click(x=150, y=400)\n```\n\n### 3단계: 복구 전략\n\n복구 전략을 메모리로 저장:\n\n```python\ndef store_recovery(failure_type, strategy):\n    requests.post(f\"{URL}/memory\",\n        headers={\"Authorization\": f\"Bearer {MIND_KEY}\",\n                 \"Content-Type\": \"application/json\"},\n        json={\n            \"category\": \"skill\",\n            \"key\": f\"recovery_{failure_type}\",\n            \"content\": strategy,\n            \"tags\": [\"test\", \"recovery\", failure_type],\n            \"priority\": \"high\"\n        })\n\n# Store recoveries for common failures\nstore_recovery(\"element_not_found\",\n    \"When element not found by ID, try by CSS class, then by XPath, \"\n    \"then by accessibility label. Take screenshot for debugging.\")\n\nstore_recovery(\"timeout\",\n    \"Increase timeout to 30s. If still fails, check if page is loading \"\n    \"dynamically — wait for specific element instead of fixed time.\")\n\nstore_recovery(\"stale_element\",\n    \"Re-find element before each interaction. Don't cache element references \"\n    \"across page transitions.\")\n```\n\n### 4단계: CI 통합\n\n```yaml\n# .gitlab-ci.yml\ntest:self-healing:\n  script:\n    - export SYNAPSE_MIND_KEY=$SYNAPSE_TEST_MIND_KEY\n    - pytest tests/ --self-healing\n  after_script:\n    # Summarize new failures\n    - python scripts/synapse_failure_summary.py\n```\n\n### 5단계: 실패 분석 대시보드\n\n```python\n# Get all test failures from the last week\nr = requests.get(\n    f\"{URL}/memory/search?q=test+failure\",\n    headers={\"Authorization\": f\"Bearer {MIND_KEY}\"}\n)\n\n# Group by test name\nfailures = {}\nfor mem in r.json().get(\"results\", []):\n    test_name = extract_test_name(mem[\"content\"])\n    failures.setdefault(test_name, []).append(mem)\n\n# Report\nfor test, fails in sorted(failures.items(), key=lambda x: -len(x[1])):\n    print(f\"{test}: {len(fails)} failures\")\n```\n\n## 모범 사례\n\n> [!TIP]\n> - **트레이스백 저장** — 실패한 정확한 줄을 포함\n> - **테스트 이름으로 태그** — 빠른 필터링 가능\n> - **`mistake` 카테고리 사용** — 일반 메모리와 분리\n> - **`high` 우선순위 설정** — 실패는 절대 잊지 않아야 함\n> - **주기적 정리** — 해결된 문제의 메모리 삭제\n> - **민감한 데이터 저장 금지** — 자격 증명, PII\n\n## 저장할 일반적인 실패 패턴\n\n| 실패 유형 | 저장할 내용 |\n|--------------|---------------|\n| 요소를 찾을 수 없음 | 시도한 셀렉터, 페이지 상태, 스크린샷 |\n| 시간 초과 | 대기 시간, 무엇을 기다리고 있었는지 |\n| 어설션 실패 | 예상 값 vs 실제 값 |\n| 네트워크 오류 | URL, 상태 코드, 응답 본문 |\n| 권한 거부 | 필요한 권한, 현재 사용자 역할 |\n\n## 다음 단계\n\n- [자동화된 iOS 테스트](/docs/guides/automated-testing-ios)\n- [메모리 모범 사례](/docs/guides/memory-best-practices)\n- [오류 복구 Cookbook](/docs/llm-cookbook/error-recovery)\n","content_html":"<h1>자가 치유 테스트 파이프라인</h1>\n<p>전통적인 테스트 스위트는 UI가 변경되면 깨집니다. 자가 치유 테스트는 Synapse\n메모리를 사용하여 과거 실패로부터 학습하고 적응합니다 — 불안정한 테스트와\n유지 관리 부담을 줄입니다.</p>\n<h2>개념</h2>\n<pre><code class=\"hljs language-plaintext\">┌─────────┐  fails   ┌──────────┐  store   ┌──────────┐\n│  Test   │ ───────▶ │  Synapse │ ───────▶ │ Memories │\n│  Run    │          │  Memory  │          │ (failures)│\n└─────────┘          └──────────┘          └──────────┘\n                           ▲                     │\n                           │   recall            │\n                           │  before next run    │\n                           └─────────────────────┘</code></pre><ol>\n<li>테스트 실행</li>\n<li>실패하면, 실패 저장 (무엇이 잘못되었는지, 왜, 어떻게 수정하는지)</li>\n<li>다음 실행: 실행 전 관련 실패 회상</li>\n<li>알려진 수정 자동 적용</li>\n</ol>\n<h2>구현</h2>\n<h3>1단계: 테스트 래퍼</h3>\n<p>각 테스트를 메모리 회상/저장으로 래핑:</p>\n<pre><code class=\"hljs language-python\"><span class=\"hljs-keyword\">import</span> requests\n<span class=\"hljs-keyword\">from</span> datetime <span class=\"hljs-keyword\">import</span> datetime\n\nURL = <span class=\"hljs-string\">&quot;https://synapse.schaefer.zone&quot;</span>\nMIND_KEY = <span class=\"hljs-string\">&quot;mk_...&quot;</span>\n\n<span class=\"hljs-keyword\">def</span> <span class=\"hljs-title function_\">self_healing_test</span>(<span class=\"hljs-params\">test_name, test_fn</span>):\n    <span class=\"hljs-string\">&quot;&quot;&quot;Decorator: wrap a test with self-healing memory.&quot;&quot;&quot;</span>\n    <span class=\"hljs-keyword\">def</span> <span class=\"hljs-title function_\">wrapper</span>():\n        <span class=\"hljs-comment\"># 1. Recall past failures for this test</span>\n        past_failures = requests.get(\n            <span class=\"hljs-string\">f&quot;<span class=\"hljs-subst\">{URL}</span>/memory/search?q=<span class=\"hljs-subst\">{test_name}</span>+failure&quot;</span>,\n            headers={<span class=\"hljs-string\">&quot;Authorization&quot;</span>: <span class=\"hljs-string\">f&quot;Bearer <span class=\"hljs-subst\">{MIND_KEY}</span>&quot;</span>}\n        ).json()\n        \n        <span class=\"hljs-comment\"># 2. Run test with failure context</span>\n        <span class=\"hljs-keyword\">try</span>:\n            test_fn(known_failures=past_failures)\n        <span class=\"hljs-keyword\">except</span> Exception <span class=\"hljs-keyword\">as</span> e:\n            <span class=\"hljs-comment\"># 3. Store the failure</span>\n            store_failure(test_name, e, traceback.format_exc())\n            <span class=\"hljs-keyword\">raise</span>\n    \n    <span class=\"hljs-keyword\">return</span> wrapper\n\n<span class=\"hljs-keyword\">def</span> <span class=\"hljs-title function_\">store_failure</span>(<span class=\"hljs-params\">test_name, error, traceback_str</span>):\n    requests.post(<span class=\"hljs-string\">f&quot;<span class=\"hljs-subst\">{URL}</span>/memory&quot;</span>,\n        headers={<span class=\"hljs-string\">&quot;Authorization&quot;</span>: <span class=\"hljs-string\">f&quot;Bearer <span class=\"hljs-subst\">{MIND_KEY}</span>&quot;</span>,\n                 <span class=\"hljs-string\">&quot;Content-Type&quot;</span>: <span class=\"hljs-string\">&quot;application/json&quot;</span>},\n        json={\n            <span class=\"hljs-string\">&quot;category&quot;</span>: <span class=\"hljs-string\">&quot;mistake&quot;</span>,\n            <span class=\"hljs-string\">&quot;key&quot;</span>: <span class=\"hljs-string\">f&quot;test_failure_<span class=\"hljs-subst\">{test_name}</span>_<span class=\"hljs-subst\">{datetime.now().isoformat()}</span>&quot;</span>,\n            <span class=\"hljs-string\">&quot;content&quot;</span>: <span class=\"hljs-string\">f&quot;Test: <span class=\"hljs-subst\">{test_name}</span>\\nError: <span class=\"hljs-subst\">{error}</span>\\nTrace:\\n<span class=\"hljs-subst\">{traceback_str}</span>&quot;</span>,\n            <span class=\"hljs-string\">&quot;tags&quot;</span>: [<span class=\"hljs-string\">&quot;test&quot;</span>, <span class=\"hljs-string\">&quot;failure&quot;</span>, test_name],\n            <span class=\"hljs-string\">&quot;priority&quot;</span>: <span class=\"hljs-string\">&quot;high&quot;</span>\n        })</code></pre><h3>2단계: 적응형 테스트 로직</h3>\n<p>테스트 내에서 알려진 실패를 확인하고 수정 적용:</p>\n<pre><code class=\"hljs language-python\"><span class=\"hljs-meta\">@self_healing_test</span>\n<span class=\"hljs-keyword\">def</span> <span class=\"hljs-title function_\">test_login_page</span>(<span class=\"hljs-params\">browser, known_failures=<span class=\"hljs-literal\">None</span></span>):\n    browser.goto(<span class=\"hljs-string\">&quot;https://app.com/login&quot;</span>)\n    \n    <span class=\"hljs-comment\"># Check if we&#x27;ve seen this page change before</span>\n    <span class=\"hljs-keyword\">if</span> known_failures <span class=\"hljs-keyword\">and</span> known_failures.get(<span class=\"hljs-string\">&quot;results&quot;</span>):\n        <span class=\"hljs-keyword\">for</span> failure <span class=\"hljs-keyword\">in</span> known_failures[<span class=\"hljs-string\">&quot;results&quot;</span>]:\n            <span class=\"hljs-keyword\">if</span> <span class=\"hljs-string\">&quot;button moved&quot;</span> <span class=\"hljs-keyword\">in</span> failure[<span class=\"hljs-string\">&quot;content&quot;</span>].lower():\n                <span class=\"hljs-comment\"># Use accessibility label instead of coordinates</span>\n                browser.click(by_label=<span class=\"hljs-string\">&quot;Login button&quot;</span>)\n                <span class=\"hljs-keyword\">return</span>\n    \n    <span class=\"hljs-comment\"># Default: use coordinates</span>\n    browser.click(x=<span class=\"hljs-number\">150</span>, y=<span class=\"hljs-number\">400</span>)</code></pre><h3>3단계: 복구 전략</h3>\n<p>복구 전략을 메모리로 저장:</p>\n<pre><code class=\"hljs language-python\"><span class=\"hljs-keyword\">def</span> <span class=\"hljs-title function_\">store_recovery</span>(<span class=\"hljs-params\">failure_type, strategy</span>):\n    requests.post(<span class=\"hljs-string\">f&quot;<span class=\"hljs-subst\">{URL}</span>/memory&quot;</span>,\n        headers={<span class=\"hljs-string\">&quot;Authorization&quot;</span>: <span class=\"hljs-string\">f&quot;Bearer <span class=\"hljs-subst\">{MIND_KEY}</span>&quot;</span>,\n                 <span class=\"hljs-string\">&quot;Content-Type&quot;</span>: <span class=\"hljs-string\">&quot;application/json&quot;</span>},\n        json={\n            <span class=\"hljs-string\">&quot;category&quot;</span>: <span class=\"hljs-string\">&quot;skill&quot;</span>,\n            <span class=\"hljs-string\">&quot;key&quot;</span>: <span class=\"hljs-string\">f&quot;recovery_<span class=\"hljs-subst\">{failure_type}</span>&quot;</span>,\n            <span class=\"hljs-string\">&quot;content&quot;</span>: strategy,\n            <span class=\"hljs-string\">&quot;tags&quot;</span>: [<span class=\"hljs-string\">&quot;test&quot;</span>, <span class=\"hljs-string\">&quot;recovery&quot;</span>, failure_type],\n            <span class=\"hljs-string\">&quot;priority&quot;</span>: <span class=\"hljs-string\">&quot;high&quot;</span>\n        })\n\n<span class=\"hljs-comment\"># Store recoveries for common failures</span>\nstore_recovery(<span class=\"hljs-string\">&quot;element_not_found&quot;</span>,\n    <span class=\"hljs-string\">&quot;When element not found by ID, try by CSS class, then by XPath, &quot;</span>\n    <span class=\"hljs-string\">&quot;then by accessibility label. Take screenshot for debugging.&quot;</span>)\n\nstore_recovery(<span class=\"hljs-string\">&quot;timeout&quot;</span>,\n    <span class=\"hljs-string\">&quot;Increase timeout to 30s. If still fails, check if page is loading &quot;</span>\n    <span class=\"hljs-string\">&quot;dynamically — wait for specific element instead of fixed time.&quot;</span>)\n\nstore_recovery(<span class=\"hljs-string\">&quot;stale_element&quot;</span>,\n    <span class=\"hljs-string\">&quot;Re-find element before each interaction. Don&#x27;t cache element references &quot;</span>\n    <span class=\"hljs-string\">&quot;across page transitions.&quot;</span>)</code></pre><h3>4단계: CI 통합</h3>\n<pre><code class=\"hljs language-yaml\"><span class=\"hljs-comment\"># .gitlab-ci.yml</span>\n<span class=\"hljs-attr\">test:self-healing:</span>\n  <span class=\"hljs-attr\">script:</span>\n    <span class=\"hljs-bullet\">-</span> <span class=\"hljs-string\">export</span> <span class=\"hljs-string\">SYNAPSE_MIND_KEY=$SYNAPSE_TEST_MIND_KEY</span>\n    <span class=\"hljs-bullet\">-</span> <span class=\"hljs-string\">pytest</span> <span class=\"hljs-string\">tests/</span> <span class=\"hljs-string\">--self-healing</span>\n  <span class=\"hljs-attr\">after_script:</span>\n    <span class=\"hljs-comment\"># Summarize new failures</span>\n    <span class=\"hljs-bullet\">-</span> <span class=\"hljs-string\">python</span> <span class=\"hljs-string\">scripts/synapse_failure_summary.py</span></code></pre><h3>5단계: 실패 분석 대시보드</h3>\n<pre><code class=\"hljs language-python\"><span class=\"hljs-comment\"># Get all test failures from the last week</span>\nr = requests.get(\n    <span class=\"hljs-string\">f&quot;<span class=\"hljs-subst\">{URL}</span>/memory/search?q=test+failure&quot;</span>,\n    headers={<span class=\"hljs-string\">&quot;Authorization&quot;</span>: <span class=\"hljs-string\">f&quot;Bearer <span class=\"hljs-subst\">{MIND_KEY}</span>&quot;</span>}\n)\n\n<span class=\"hljs-comment\"># Group by test name</span>\nfailures = {}\n<span class=\"hljs-keyword\">for</span> mem <span class=\"hljs-keyword\">in</span> r.json().get(<span class=\"hljs-string\">&quot;results&quot;</span>, []):\n    test_name = extract_test_name(mem[<span class=\"hljs-string\">&quot;content&quot;</span>])\n    failures.setdefault(test_name, []).append(mem)\n\n<span class=\"hljs-comment\"># Report</span>\n<span class=\"hljs-keyword\">for</span> test, fails <span class=\"hljs-keyword\">in</span> <span class=\"hljs-built_in\">sorted</span>(failures.items(), key=<span class=\"hljs-keyword\">lambda</span> x: -<span class=\"hljs-built_in\">len</span>(x[<span class=\"hljs-number\">1</span>])):\n    <span class=\"hljs-built_in\">print</span>(<span class=\"hljs-string\">f&quot;<span class=\"hljs-subst\">{test}</span>: <span class=\"hljs-subst\">{<span class=\"hljs-built_in\">len</span>(fails)}</span> failures&quot;</span>)</code></pre><h2>모범 사례</h2>\n<div class=\"callout callout-ok\"></div><h2>저장할 일반적인 실패 패턴</h2>\n<table>\n<thead>\n<tr>\n<th>실패 유형</th>\n<th>저장할 내용</th>\n</tr>\n</thead>\n<tbody><tr>\n<td>요소를 찾을 수 없음</td>\n<td>시도한 셀렉터, 페이지 상태, 스크린샷</td>\n</tr>\n<tr>\n<td>시간 초과</td>\n<td>대기 시간, 무엇을 기다리고 있었는지</td>\n</tr>\n<tr>\n<td>어설션 실패</td>\n<td>예상 값 vs 실제 값</td>\n</tr>\n<tr>\n<td>네트워크 오류</td>\n<td>URL, 상태 코드, 응답 본문</td>\n</tr>\n<tr>\n<td>권한 거부</td>\n<td>필요한 권한, 현재 사용자 역할</td>\n</tr>\n</tbody></table>\n<h2>다음 단계</h2>\n<ul>\n<li><a href=\"/docs/guides/automated-testing-ios\">자동화된 iOS 테스트</a></li>\n<li><a href=\"/docs/guides/memory-best-practices\">메모리 모범 사례</a></li>\n<li><a href=\"/docs/llm-cookbook/error-recovery\">오류 복구 Cookbook</a></li>\n</ul>\n","urls":{"html":"/docs/guides/self-healing-tests","text":"/docs/guides/self-healing-tests?format=text","json":"/docs/guides/self-healing-tests?format=json","llm":"/docs/guides/self-healing-tests?format=llm"},"translations_available":["en","zh","hi","es","fr","ar","pt","ru","ja","de","it","ko","nl","pl","tr","sv","vi","th","id","uk"]}