new

Get trending papers in your email inbox!

Subscribe

Daily Papers

byAK and the research community

Sep 8

AWED-PIPER: Agents, Web Applications & Expert Detectors for Personally Identifiable Information Protection & Fine-grained Named Entity Recognition across 36 languages for 6.6 Billion Speakers

Named Entity Recognition (NER) and Personally Identifiable Information (PII) anonymization are critical tasks in Natural Language Processing (NLP) for information extraction and privacy preservation. We introduce AWED-PIPER, an open-source framework comprising agentic tools, interactive web applications, and 54 state-of-the-art expert detector models that provide unified Fine-grained Named Entity Recognition (FgNER) and reversible synthetic PII pseudonymization across 36 languages spoken by over 6.6 billion people. The system couples fine-grained multilingual sequence labeling with script-aware regex detectors to identify contextual entities (Person, Location, Organization, Medical) as well as structured technical PII (Emails, native-script Phone Numbers, IP Addresses, Credit Cards). AWED-PIPER offers a dual capability: full FgNER entity extraction and privacy-preserving reversible anonymization with persistent placeholders and de-anonymization dictionary mappings. The suite spans global languages to extremely low-resource vulnerable languages like Bodo, Manipuri, Bishnupriya, and Mizo. The resources can be accessed here: PII Protector Agentic Tool: (https://github.com/PrachuryyaKaushik/AWED-PIPER), FgNER Agentic Tool: (https://github.com/PrachuryyaKaushik/AWED-FiNER), PII Web Application: (https://hf.co/spaces/prachuryyaIITG/AWED_PII_Protector), FgNER Web Application: (https://hf.co/spaces/prachuryyaIITG/AWED-FiNER), and Edge-deployable Expert Detector Models: (https://hf.co/collections/prachuryyaIITG/awed-piper).

  • 2 authors
·
Aug 15