Got OpenAI's privacy filter model running on-device via ExecuTorch
r/LocalLLaMA
•
Generative AI
Been experimenting with running OpenAI's privacy filter model on mobile through ExecuTorch. Sharing in case it's useful to others working on similar problems. Setup: - Runtime: ExecuTorch - Memory footprint: ~600 MB RAM - Bridge: react-native-executorch The model handles arbitrary text - emails, documents, chat logs, pasted notes, transcripts - and flags sensitive content reasonably well across all of them. Quality holds up better than I expected; it catches the kinds of PII and sensitive material you'd actually want flagged, not just trivial pattern matches.