test suite แบบดั้งเดิมจะพังเมื่อ UI เปลี่ยน การทดสอบที่ซ่อมแซมตัวเองใช้ Synapse memory เพื่อเรียนรู้จากความล้มเหลวในอดีตและปรับตัว — ลด flaky test และภาระการบำรุงรักษา
\n┌─────────┐ fails ┌──────────┐ store ┌──────────┐\n│ Test │ ───────▶ │ Synapse │ ───────▶ │ Memories │\n│ Run │ │ Memory │ │ (failures)│\n└─────────┘ └──────────┘ └──────────┘\n ▲ │\n │ recall │\n │ before next run │\n └─────────────────────┘ห่อหุ้มการทดสอบแต่ละครั้งด้วยการ recall/store memory:
\nimport requests\nfrom datetime import datetime\n\nURL = "https://synapse.schaefer.zone"\nMIND_KEY = "mk_..."\n\ndef self_healing_test(test_name, test_fn):\n """Decorator: wrap a test with self-healing memory."""\n def wrapper():\n # 1. Recall past failures for this test\n past_failures = requests.get(\n f"{URL}/memory/search?q={test_name}+failure",\n headers={"Authorization": f"Bearer {MIND_KEY}"}\n ).json()\n \n # 2. Run test with failure context\n try:\n test_fn(known_failures=past_failures)\n except Exception as e:\n # 3. Store the failure\n store_failure(test_name, e, traceback.format_exc())\n raise\n \n return wrapper\n\ndef store_failure(test_name, error, traceback_str):\n requests.post(f"{URL}/memory",\n headers={"Authorization": f"Bearer {MIND_KEY}",\n "Content-Type": "application/json"},\n json={\n "category": "mistake",\n "key": f"test_failure_{test_name}_{datetime.now().isoformat()}",\n "content": f"Test: {test_name}\\nError: {error}\\nTrace:\\n{traceback_str}",\n "tags": ["test", "failure", test_name],\n "priority": "high"\n })ภายในการทดสอบ ตรวจสอบความล้มเหลวที่รู้และปรับใช้วิธีแก้:
\n\ndef test_login_page(browser, known_failures=None):\n browser.goto("https://app.com/login")\n \n # Check if we've seen this page change before\n if known_failures and known_failures.get("results"):\n for failure in known_failures["results"]:\n if "button moved" in failure["content"].lower():\n # Use accessibility label instead of coordinates\n browser.click(by_label="Login button")\n return\n \n # Default: use coordinates\n browser.click(x=150, y=400)เก็บกลยุทธ์การกู้คืนเป็น memory:
\ndef store_recovery(failure_type, strategy):\n requests.post(f"{URL}/memory",\n headers={"Authorization": f"Bearer {MIND_KEY}",\n "Content-Type": "application/json"},\n json={\n "category": "skill",\n "key": f"recovery_{failure_type}",\n "content": strategy,\n "tags": ["test", "recovery", failure_type],\n "priority": "high"\n })\n\n# Store recoveries for common failures\nstore_recovery("element_not_found",\n "When element not found by ID, try by CSS class, then by XPath, "\n "then by accessibility label. Take screenshot for debugging.")\n\nstore_recovery("timeout",\n "Increase timeout to 30s. If still fails, check if page is loading "\n "dynamically — wait for specific element instead of fixed time.")\n\nstore_recovery("stale_element",\n "Re-find element before each interaction. Don't cache element references "\n "across page transitions.")# .gitlab-ci.yml\ntest:self-healing:\n script:\n - export SYNAPSE_MIND_KEY=$SYNAPSE_TEST_MIND_KEY\n - pytest tests/ --self-healing\n after_script:\n # Summarize new failures\n - python scripts/synapse_failure_summary.py# Get all test failures from the last week\nr = requests.get(\n f"{URL}/memory/search?q=test+failure",\n headers={"Authorization": f"Bearer {MIND_KEY}"}\n)\n\n# Group by test name\nfailures = {}\nfor mem in r.json().get("results", []):\n test_name = extract_test_name(mem["content"])\n failures.setdefault(test_name, []).append(mem)\n\n# Report\nfor test, fails in sorted(failures.items(), key=lambda x: -len(x[1])):\n print(f"{test}: {len(fails)} failures")| ประเภทความล้มเหลว | \nสิ่งที่ควรเก็บ | \n
|---|---|
| Element not found | \nselector ที่ลอง, สถานะหน้า, screenshot | \n
| Timeout | \nเวลารอ, สิ่งที่กำลังรอ | \n
| Assertion failed | \nค่าที่คาดหวัง vs ค่าจริง | \n
| Network error | \nURL, status code, response body | \n
| Permission denied | \npermission ที่ต้องการ, role ผู้ใช้ปัจจุบัน | \n