CBG-5327: Wire up REST API to document channel history compaction by RIT3shSapata · Pull Request #8275 · couchbase/sync_gateway

RIT3shSapata · 2026-05-15T09:24:22Z

CBG-5327

Describe your PR here...

Added routes and handlers for get and post requests of document channel history compaction
Created a get document channel history function
Added test coverage for the http requests
Updated the Document Channel history compaction to store the compacted channels as set instead of array
Updated Open API spec

Pre-review checklist

Removed debug logging (fmt.Print, log.Print, ...)
Logging sensitive data? Make sure it's tagged (e.g. base.UD(docID), base.MD(dbName))
Updated relevant information in the API specifications (such as endpoint descriptions, schemas, ...) in docs/api

Dependencies (if applicable)

Link upstream PRs
- ~~Upstream PR: CBG-5326: Function to handle document channel history compaction #8218~~
Update Go module dependencies when merged

Integration Tests

Copilot

Pull request overview

This PR wires document channel history compaction into the Admin REST API and adds a REST-accessible way to inspect a document’s channel revocation history.

Changes:

Added Admin REST routes and handlers for getting document channel history and compacting channel history.
Added GetDocChannelHistory plus updated compaction output to deduplicate compacted channel names.
Added REST/API tests and updated OpenAPI path documentation.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 7 comments.

Show a summary per file

File	Description
`rest/routing.go`	Registers new Admin channel history GET and compaction POST routes.
`rest/doc_api.go`	Adds request/response handling for channel history APIs.
`rest/api_test.go`	Adds REST coverage and updates compaction expectations for deduplicated channels.
`docs/api/paths/admin/keyspace-_history.yaml`	Updates documented GET channel history response schema.
`docs/api/paths/admin/keyspace-_history-compact.yaml`	Updates compaction response description.
`db/crud.go`	Adds channel history retrieval and deduplicates compacted channel results.

Comments suppressed due to low confidence (2)

docs/api/paths/admin/keyspace-_history.yaml:17

This description conflicts with the implemented behavior and the new test for a channel that is revoked and then re-added: such a channel is still returned because it has revocation history. Rephrase this to say active channel memberships without any revocation history are not included, rather than implying all currently assigned channels are excluded.

    names to the sequences at which the document was removed from each channel. Only channels
    that have been revoked at least once are included; channels the document is currently
    assigned to are excluded.

docs/api/paths/admin/keyspace-_history.yaml:34

This map response is missing the repository’s OpenAPI convention of naming additionalProperties keys with x-additionalPropertiesName (for example, docs/api/paths/admin/keyspace-_history-compact.yaml:59-61 uses it for doc IDs). Add an appropriate key name such as channel_name to keep generated docs consistent.

            additionalProperties:
              type: array

Copilot

Pull request overview

Copilot reviewed 7 out of 7 changed files in this pull request and generated 3 comments.

+  '/{keyspace}/_channel_history/{docid}':
    $ref: './paths/admin/keyspace-_history.yaml'
-  '/{keyspace}/_history/compact':
+  '/{keyspace}/_channel_history/compact':


+		if err != nil && !base.IsDocNotFoundError(err) {
+			return err


+            additionalProperties:
+              type: array
+              items:
+                type: integer
+                format: int64
+                minimum: 0
+              description: Sequences at which the document was removed from this channel.


Copilot

Pull request overview

Copilot reviewed 7 out of 7 changed files in this pull request and generated 8 comments.

+func (h *handler) handleGetDocChannelHistory() error {
+	h.assertAdminOnly()
+
+	if !h.collection.UseXattrs() {
+		return fmt.Errorf("xattrs not enabled")
+	}


adamcfraser

Posted text cleanup from our discussion - final review pending decisions on discussion items.

- added route for get request and the handler - created a get channel history function and added test coverage

- add route and handler to handle http request - add test coverage for http request - use set instead of array to store compacted channels

- add docstrings to all functions - updated api spec

Copilot

Pull request overview

Copilot reviewed 8 out of 8 changed files in this pull request and generated 8 comments.

Comments suppressed due to low confidence (4)

docs/api/paths/admin/keyspace-_channel_history-compact.yaml:56

The documented 200 response schema doesn’t match the actual handler output. The code returns an object with a compacted_channels property (array of strings), but this spec currently describes an object with additionalProperties (and an unrelated x-additionalPropertiesName: doc_id). Update the schema to define compacted_channels as a property and remove the additionalProperties mapping.
docs/api/paths/admin/keyspace-_channel_history-compact.yaml:37
The request schema allows seq with minimum: 0, but the handler currently returns 400 when seq==0. Either allow 0 (treat as a valid no-op) or update the OpenAPI schema/description to require seq >= 1 so the contract matches runtime behavior.
docs/api/paths/admin/keyspace-_channel_history-compact.yaml:59
The description has a grammar typo: “A array of all the compacted channels” should be “An array of all the compacted channels”.
docs/api/paths/admin/keyspace-_channel_history-compact.yaml:67
operationId in this file still references the old _history endpoint name (post_keyspace-_history-compact), but the path is now /_channel_history/{docid}/compact. Update the operationId to match the new endpoint naming to avoid collisions/confusion in generated clients.

RIT3shSapata · 2026-05-26T14:50:52Z

+	err := h.readJSONInto(&req)
+	if err != nil {
+		return base.HTTPErrorf(http.StatusBadRequest, "invalid JSON: %v", err)
+	}
+
+	if req.Seq == 0 {
+		return base.HTTPErrorf(http.StatusBadRequest, "missing seq")
+	}


changing the open api spec

+          schema:
+            type: object
+            additionalProperties:
+              type: array
+              items:
+                type: integer
+                format: int64
+                minimum: 0
+              description: Sequences at which the document was removed from this channel.
+            description: Map of channel names to their revocation sequences.


adamcfraser

Generally looks good, one naming suggestion and then some comments about response ordering.

- rename a few functions - refactor the format of the response being sent for get channel history

adamcfraser · 2026-05-29T18:21:50Z

+	})
+
+	chanHistoryMap := make(map[string][]uint64)
+	for _, entry := range chanHistoryEntries {


Once you convert this to a map, we're going to lose the ordering from chanHistoryEntries. The map itself will be unordered, and then JSON serialization of a map is going to order by keys.

So if we want the output to be ordered by sequence, we'd need to change it from a map of channel names to a slice of structs. Let's not make that change in this PR, and revisit the question of sorting by sequence.

This reverts commit 1cd59b9.

adamcfraser

Generally looks good, I think copilot suggestion to sort channels by name for the compact response is correct.

)

RIT3shSapata requested a review from Copilot May 15, 2026 09:24

RIT3shSapata self-assigned this May 15, 2026

Copilot started reviewing on behalf of RIT3shSapata May 15, 2026 09:25 View session

Copilot AI reviewed May 15, 2026

View reviewed changes

RIT3shSapata mentioned this pull request May 15, 2026

CBG-5328: Add audit events for document channel history compaction #8276

Merged

6 tasks

RIT3shSapata force-pushed the CBG-5327 branch from 5b0c9a4 to ccc3f2e Compare May 15, 2026 18:07

RIT3shSapata requested review from adamcfraser and Copilot May 15, 2026 18:08

RIT3shSapata assigned adamcfraser and unassigned RIT3shSapata May 15, 2026

Copilot started reviewing on behalf of RIT3shSapata May 15, 2026 18:09 View session

Copilot AI reviewed May 15, 2026

View reviewed changes

adamcfraser assigned RIT3shSapata and unassigned adamcfraser May 19, 2026

RIT3shSapata force-pushed the CBG-5326 branch from 6b1e9b0 to 6632a76 Compare May 21, 2026 09:49

RIT3shSapata force-pushed the CBG-5327 branch from 38d85f7 to fee7c13 Compare May 21, 2026 11:01

RIT3shSapata requested a review from Copilot May 21, 2026 11:02

Copilot started reviewing on behalf of RIT3shSapata May 21, 2026 11:03 View session

Copilot AI reviewed May 21, 2026

View reviewed changes

RIT3shSapata assigned adamcfraser and unassigned RIT3shSapata May 21, 2026

RIT3shSapata force-pushed the CBG-5326 branch from 3620da7 to 65e314e Compare May 25, 2026 09:09

adamcfraser requested changes May 25, 2026

View reviewed changes

Comment thread docs/api/paths/admin/keyspace-_history.yaml Outdated

Comment thread docs/api/paths/admin/keyspace-_history-compact.yaml Outdated

Comment thread docs/api/paths/admin/keyspace-_history-compact.yaml Outdated

adamcfraser assigned RIT3shSapata and unassigned adamcfraser May 25, 2026

RIT3shSapata force-pushed the CBG-5327 branch from fee7c13 to f10db00 Compare May 26, 2026 12:14

Base automatically changed from CBG-5326 to main May 26, 2026 14:01

RIT3shSapata added 3 commits May 26, 2026 19:34

wire up the rest api to document channel history compaction

bfedcc6

- added route for get request and the handler - created a get channel history function and added test coverage

wire up post request to compact channel history

70b8917

- add route and handler to handle http request - add test coverage for http request - use set instead of array to store compacted channels

add documentation

9cfef82

- add docstrings to all functions - updated api spec

Copilot AI reviewed May 26, 2026

View reviewed changes

RIT3shSapata added 2 commits May 26, 2026 19:45

change the assertion from equal to ElementsMatch

62132c2

fixes based on co pilot comments

45d0775

adamcfraser requested changes May 26, 2026

View reviewed changes

Comment thread rest/doc_api.go Outdated

Comment thread db/crud.go

Comment thread db/crud.go Outdated

Comment thread db/crud.go Outdated

fixes based on pr comments

1cd59b9

- rename a few functions - refactor the format of the response being sent for get channel history

RIT3shSapata requested a review from adamcfraser May 27, 2026 11:35

RIT3shSapata assigned RIT3shSapata and adamcfraser and unassigned adamcfraser and RIT3shSapata May 27, 2026

adamcfraser requested changes May 29, 2026

View reviewed changes

adamcfraser assigned RIT3shSapata and unassigned adamcfraser May 29, 2026

RIT3shSapata added 2 commits June 1, 2026 14:26

Revert "fixes based on pr comments"

7e006a5

This reverts commit 1cd59b9.

rename functions and remove enablexattr check from handler

e81fc85

RIT3shSapata requested a review from adamcfraser June 1, 2026 09:01

RIT3shSapata assigned adamcfraser and unassigned RIT3shSapata Jun 1, 2026

sort the sequences

ba9e696

adamcfraser requested changes Jun 1, 2026

View reviewed changes

Comment thread db/crud.go Outdated

adamcfraser assigned RIT3shSapata and unassigned adamcfraser Jun 1, 2026

sort channels by name

19d9166

RIT3shSapata requested a review from adamcfraser June 1, 2026 16:19

RIT3shSapata assigned adamcfraser and unassigned RIT3shSapata Jun 1, 2026

adamcfraser approved these changes Jun 1, 2026

View reviewed changes

RIT3shSapata merged commit dd81b5c into main Jun 1, 2026
51 checks passed

RIT3shSapata deleted the CBG-5327 branch June 1, 2026 16:26

RIT3shSapata added a commit that referenced this pull request Jun 5, 2026

CBG-5327: Wire up REST API to document channel history compaction (#8275

65ab5d0

)

Uh oh!

Conversation

RIT3shSapata commented May 15, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Pre-review checklist

Dependencies (if applicable)

Integration Tests

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

adamcfraser left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

RIT3shSapata May 26, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

adamcfraser left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

adamcfraser May 29, 2026

Choose a reason for hiding this comment

Uh oh!

adamcfraser left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

RIT3shSapata commented May 15, 2026 •

edited

Loading