APIs › Document & File Utilities › File Duplicate Detection

File Duplicate Detection

Groups a set of files into exact-duplicate sets by cryptographic digest and reports the reclaimable bytes.

POST /v1/files/duplicate-detect $0.01 per call

Specification

Endpoint

POST /v1/files/duplicate-detect

Price

$0.01 per call · tier standard_data

Payment

x402 on X Layer (chain 196) · settled in USDG or USDT0 · scheme exact

Data source

Local sandboxed processing of the uploaded file

Timeout

120 seconds

Max request

20 MB

Version

1.0.0

Calling it

The first call returns a 402 with the payment challenge. Retry with a signed authorisation in the X-PAYMENT header — see the payment guide for the exact shape.

curl -i -X POST "https://api.dana-edu.pp.ua/v1/files/duplicate-detect" \
  -H "content-type: application/json" \
  -d '{ ... }'

Response

Real output, captured by running this endpoint at build time — not written by hand. Volatile fields such as timestamps are elided. Captured 2026-07-30.

{
  "algorithm": "sha256",
  "file_count": 3,
  "unique_files": 2,
  "duplicate_groups": 1,
  "reclaimable_bytes": 173,
  "duplicates": [
    {
      "digest": "cd1312e32cc15c90a053c02ada0eb9402578eec1c1bdd8837bdfa246a4c9e60c",
      "count": 2,
      "size_bytes": 173,
      "reclaimable_bytes": 173,
      "files": [
        {
          "filename": "<varies per call>",
          "size_bytes": 173
        },
        {
          "filename": "<varies per call>",
          "size_bytes": 173
        }
      ]
    }
  ],
  "method": "exact sha256 digest of full file content. Two files match only if they are byte-identical; near-duplicates are not detected here — use /v1/image/duplicate-detect for perceptually similar images."
}

Every response is wrapped in the same envelope: data plus warnings, sources, confidence, informational_only and a measured processing_ms. See the envelope reference.

Related endpoints