APIs › Kurdish, Arabic & Text Utilities › Text Encoding Cleanup

Text Encoding Cleanup

Repairs mojibake from double-decoded UTF-8, removes BOMs and zero-width characters, and normalises line endings, listing every fix applied.

POST /v1/text/encoding-cleanup $0.003 per call

Specification

Endpoint

POST /v1/text/encoding-cleanup

Price

$0.003 per call · tier micro_data

Payment

x402 on X Layer (chain 196) · settled in USDG or USDT0 · schemes exact, aggr_deferred

Data source

Deterministic local computation on caller-supplied text

Timeout

15 seconds

Max request

1 MB

Version

1.0.0

Calling it

The first call returns a 402 with the payment challenge. Retry with a signed authorisation in the X-PAYMENT header — see the payment guide for the exact shape.

curl -i -X POST "https://api.dana-edu.pp.ua/v1/text/encoding-cleanup" \
  -H "content-type: application/json" \
  -d '{ ... }'

Response

Real output, captured by running this endpoint at build time — not written by hand. Volatile fields such as timestamps are elided. Captured 2026-07-30.

{
  "text": "دانا test\n",
  "changed": true,
  "fixes_applied": [
    {
      "fix": "removed_zero_width",
      "detail": "ZERO WIDTH SPACE",
      "occurrences": 1
    },
    {
      "fix": "removed_zero_width",
      "detail": "ZERO WIDTH NO-BREAK SPACE (BOM)",
      "occurrences": 1
    },
    {
      "fix": "line_endings",
      "detail": "CRLF/CR → LF",
      "occurrences": 1
    }
  ],
  "original_length": 17,
  "cleaned_length": 14,
  "replacement_characters_present": 0
}

Every response is wrapped in the same envelope: data plus warnings, sources, confidence, informational_only and a measured processing_ms. See the envelope reference.

Related endpoints