Rename Java packages from com.cameleer3 to com.cameleer, module directories from cameleer3-* to cameleer-*, and all references throughout workflows, Dockerfiles, docs, migrations, and pom.xml. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
137 lines
7.5 KiB
Markdown
137 lines
7.5 KiB
Markdown
---
|
|
phase: 02-transaction-search-diagrams
|
|
plan: 03
|
|
subsystem: api, search, database
|
|
tags: [clickhouse, search, dynamic-sql, rest, tree-reconstruction, pagination]
|
|
|
|
requires:
|
|
- phase: 02-transaction-search-diagrams
|
|
provides: "SearchEngine interface, SearchRequest/SearchResult/ExecutionSummary types, DetailService, RawExecutionRow, schema with search columns"
|
|
provides:
|
|
- "ClickHouseSearchEngine with dynamic WHERE building and LIKE escape"
|
|
- "SearchController GET+POST endpoints for transaction search"
|
|
- "DetailController with nested processor tree reconstruction"
|
|
- "Processor snapshot endpoint for per-processor exchange data"
|
|
- "SearchBeanConfig wiring search and detail layer beans"
|
|
affects: []
|
|
|
|
tech-stack:
|
|
added: []
|
|
patterns: [dynamic-sql-where-building, like-escape-injection-prevention, shared-clickhouse-test-isolation]
|
|
|
|
key-files:
|
|
created:
|
|
- cameleer-server-app/src/main/java/com/cameleer/server/app/search/ClickHouseSearchEngine.java
|
|
- cameleer-server-app/src/main/java/com/cameleer/server/app/controller/SearchController.java
|
|
- cameleer-server-app/src/main/java/com/cameleer/server/app/controller/DetailController.java
|
|
- cameleer-server-app/src/main/java/com/cameleer/server/app/config/SearchBeanConfig.java
|
|
- cameleer-server-app/src/test/java/com/cameleer/server/app/controller/SearchControllerIT.java
|
|
- cameleer-server-app/src/test/java/com/cameleer/server/app/controller/DetailControllerIT.java
|
|
- cameleer-server-core/src/test/java/com/cameleer/server/core/detail/TreeReconstructionTest.java
|
|
modified:
|
|
- cameleer-server-app/src/main/java/com/cameleer/server/app/storage/ClickHouseExecutionRepository.java
|
|
- cameleer-server-core/pom.xml
|
|
|
|
key-decisions:
|
|
- "Search tests use correlationId scoping and >= assertions for shared ClickHouse isolation"
|
|
- "findProcessorSnapshot uses ClickHouse 1-indexed array access for per-processor exchange retrieval"
|
|
- "DetailController takes ClickHouseExecutionRepository directly for snapshot access (not through interface)"
|
|
|
|
patterns-established:
|
|
- "Dynamic WHERE building: ArrayList<String> conditions + ArrayList<Object> params with LIKE escape"
|
|
- "Test isolation: scope assertions with unique correlationIds when ClickHouse container is shared"
|
|
|
|
requirements-completed: [SRCH-01, SRCH-02, SRCH-03, SRCH-04, SRCH-05, SRCH-06]
|
|
|
|
duration: 12min
|
|
completed: 2026-03-11
|
|
---
|
|
|
|
# Phase 2 Plan 03: Search Endpoints + Detail Endpoints Summary
|
|
|
|
**ClickHouse search engine with dynamic SQL, GET/POST search endpoints, transaction detail with nested tree reconstruction, and per-processor exchange snapshot endpoint -- 24 tests**
|
|
|
|
## Performance
|
|
|
|
- **Duration:** 12 min
|
|
- **Started:** 2026-03-11T15:19:59Z
|
|
- **Completed:** 2026-03-11T15:32:00Z
|
|
- **Tasks:** 2
|
|
- **Files modified:** 9
|
|
|
|
## Accomplishments
|
|
- ClickHouseSearchEngine with dynamic WHERE clause building supporting 10 filter types (status, time range, duration range, correlationId, global text, body text, header text, error text) with proper LIKE escape
|
|
- SearchController with GET (basic filters via query params) and POST (full JSON body) endpoints at /api/v1/search/executions
|
|
- DetailController with GET /api/v1/executions/{id} returning nested processor tree and GET /api/v1/executions/{id}/processors/{index}/snapshot for exchange data
|
|
- Implemented findRawById and findProcessorSnapshot in ClickHouseExecutionRepository with robust array type handling
|
|
- 13 search integration tests covering all filter types, combinations, pagination, and empty results
|
|
- 6 detail integration tests covering nested tree verification, snapshot retrieval, and 404 handling
|
|
- 5 unit tests for tree reconstruction logic (linear chain, branching, multiple roots, empty, null)
|
|
|
|
## Task Commits
|
|
|
|
Each task was committed atomically:
|
|
|
|
1. **Task 1: ClickHouseSearchEngine, SearchController, and search integration tests** - `82a190c` (feat)
|
|
2. **Task 2: DetailController, tree reconstruction, processor snapshot endpoint** - `0615a98` (feat)
|
|
3. **Task 2 fix: Test isolation for shared ClickHouse** - `079dce5` (fix)
|
|
|
|
## Files Created/Modified
|
|
- `cameleer-server-app/.../search/ClickHouseSearchEngine.java` - Dynamic SQL search with LIKE escape, implements SearchEngine
|
|
- `cameleer-server-app/.../controller/SearchController.java` - GET + POST /api/v1/search/executions endpoints
|
|
- `cameleer-server-app/.../controller/DetailController.java` - GET /api/v1/executions/{id} and processor snapshot endpoints
|
|
- `cameleer-server-app/.../config/SearchBeanConfig.java` - Wires SearchEngine, SearchService, DetailService beans
|
|
- `cameleer-server-app/.../storage/ClickHouseExecutionRepository.java` - Added findRawById, findProcessorSnapshot, array extraction helpers
|
|
- `cameleer-server-app/.../controller/SearchControllerIT.java` - 13 integration tests for search
|
|
- `cameleer-server-app/.../controller/DetailControllerIT.java` - 6 integration tests for detail/snapshot
|
|
- `cameleer-server-core/.../detail/TreeReconstructionTest.java` - 5 unit tests for tree reconstruction
|
|
- `cameleer-server-core/pom.xml` - Added assertj and mockito test dependencies
|
|
|
|
## Decisions Made
|
|
- Search tests use correlationId scoping and >= assertions to remain stable when other test classes seed data in the shared ClickHouse container
|
|
- findProcessorSnapshot accesses ClickHouse arrays with 1-based indexing (Java 0-based + 1)
|
|
- DetailController injects ClickHouseExecutionRepository directly for snapshot access rather than adding a new interface method to ExecutionRepository (snapshot is ClickHouse-specific array indexing)
|
|
|
|
## Deviations from Plan
|
|
|
|
### Auto-fixed Issues
|
|
|
|
**1. [Rule 3 - Blocking] Added assertj and mockito test dependencies to core module**
|
|
- **Found during:** Task 2 (TreeReconstructionTest compilation)
|
|
- **Issue:** Core module only had JUnit Jupiter as test dependency, TreeReconstructionTest needed assertj for assertions and mockito for mock(ExecutionRepository.class)
|
|
- **Fix:** Added assertj-core and mockito-core test-scoped dependencies to cameleer-server-core/pom.xml
|
|
- **Files modified:** cameleer-server-core/pom.xml
|
|
- **Committed in:** 0615a98 (Task 2 commit)
|
|
|
|
**2. [Rule 1 - Bug] Fixed search tests failing with shared ClickHouse data**
|
|
- **Found during:** Task 2 (full test suite verification)
|
|
- **Issue:** SearchControllerIT status and duration count assertions were exact (e.g., "total == 2 FAILED") but other test classes (DetailControllerIT, ExecutionControllerIT) seed additional data in the shared ClickHouse container, causing count mismatches
|
|
- **Fix:** Changed broad count assertions to use >= for status tests, and scoped duration/time tests with unique correlationId filters
|
|
- **Files modified:** SearchControllerIT.java
|
|
- **Committed in:** 079dce5 (fix commit)
|
|
|
|
---
|
|
|
|
**Total deviations:** 2 auto-fixed (1 blocking, 1 bug)
|
|
**Impact on plan:** Both auto-fixes necessary for compilation and test stability. No scope creep.
|
|
|
|
## Issues Encountered
|
|
- Pre-existing IngestionSchemaIT flaky test (nullSnapshots_insertSucceedsWithEmptyDefaults) fails intermittently when run alongside other test classes due to Awaitility timeout on shared data. Not related to this plan's changes. Already documented in 02-01-SUMMARY.
|
|
|
|
## User Setup Required
|
|
|
|
None - no external service configuration required.
|
|
|
|
## Next Phase Readiness
|
|
- Phase 2 complete: all search, detail, and diagram endpoints implemented
|
|
- All 6 SRCH requirements satisfied
|
|
- Ready for Phase 3 (Agent Management) which has no dependency on Phase 2
|
|
|
|
## Self-Check: PASSED
|
|
|
|
All 7 created files verified present. All 3 task commits verified in git log.
|
|
|
|
---
|
|
*Phase: 02-transaction-search-diagrams*
|
|
*Completed: 2026-03-11*
|