Medical & Healthcare

Batch Processing Clinical Text

Run large-scale batch NER, PII extraction, or de-identification over many clinical notes on-device with OpenMed, with sharding, checkpointing, resumability, and append-only JSONL output. Use when the user needs to process a corpus or folder of notes, de-identify a dataset, run NER over thousands of documents, build a resumable batch pipeline, or stream results to JSONL without holding everything in memory. Covers process_batch / BatchProcessor / BatchItem / BatchResult, the operation= selector (analyze_text | extract_pii | deidentify), iter_process streaming, the PHI-safe on_progress callback, chunking long documents, and no-PHI logging. Produces a resumable batch runner over an OpenMed model.

Publisher / source
maziyarpanahi/openmed (found on GitHub top repositories)
Upstream record
maziyarpanahi/openmed
Version
Version 1
Published
Publication review
Approved for publication
Content fingerprint
39bbd95d26feba307a8af5dd11f997f2fb28acc368cd164daa74af3532f2700c