AWED-PIPER: Agents, Web Applications & Expert Detectors for Personally Identifiable Information Protection & Fine-grained Named Entity Recognition across 36 languages for 6.6 Billion Speakers
Abstract
AWED-PIPER is an open-source multilingual framework that combines fine-grained named entity recognition with reversible synthetic PII pseudonymization across 36 languages using expert detector models and sequence labeling.
Named Entity Recognition (NER) and Personally Identifiable Information (PII) anonymization are critical tasks in Natural Language Processing (NLP) for information extraction and privacy preservation. We introduce AWED-PIPER, an open-source framework comprising agentic tools, interactive web applications, and 54 state-of-the-art expert detector models that provide unified Fine-grained Named Entity Recognition (FgNER) and reversible synthetic PII pseudonymization across 36 languages spoken by over 6.6 billion people. The system couples fine-grained multilingual sequence labeling with script-aware regex detectors to identify contextual entities (Person, Location, Organization, Medical) as well as structured technical PII (Emails, native-script Phone Numbers, IP Addresses, Credit Cards). AWED-PIPER offers a dual capability: full FgNER entity extraction and privacy-preserving reversible anonymization with persistent placeholders and de-anonymization dictionary mappings. The suite spans global languages to extremely low-resource vulnerable languages like Bodo, Manipuri, Bishnupriya, and Mizo. The resources can be accessed here: PII Protector Agentic Tool: (https://github.com/PrachuryyaKaushik/AWED-PIPER), FgNER Agentic Tool: (https://github.com/PrachuryyaKaushik/AWED-FiNER), PII Web Application: (https://hf.co/spaces/prachuryyaIITG/AWED_PII_Protector), FgNER Web Application: (https://hf.co/spaces/prachuryyaIITG/AWED-FiNER), and Edge-deployable Expert Detector Models: (https://hf.co/collections/prachuryyaIITG/awed-piper).
Get this paper in your agent:
hf papers read 2601.10161 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash