@umituz/react-native-ai-content-moderation

Content moderation service for AI applications. Supports text, image, video, and voice content validation.

Installation

npm install @umituz/react-native-ai-content-moderation

Usage

Basic Usage

import {
  contentModerationService,
  ContentPolicyViolationError,
} from "@umituz/react-native-ai-content-moderation";

// Moderate text content
const result = await contentModerationService.moderate({
  contentType: "text",
  content: "Your text content here",
});

if (!result.isAllowed) {
  throw new ContentPolicyViolationError(result.violations);
}

Configuration

import { contentModerationService } from "@umituz/react-native-ai-content-moderation";

contentModerationService.configure({
  validationLimits: {
    maxTextLength: 5000,
    maxVoiceTextLength: 3000,
    maxUriLength: 1024,
  },
  suggestionMessages: {
    explicit_content: "Please remove explicit content",
    violence: "Please remove violent content",
  },
});

Custom Rules

import { rulesRegistry } from "@umituz/react-native-ai-content-moderation";

rulesRegistry.addRule({
  id: "custom-001",
  name: "Custom Rule",
  description: "My custom moderation rule",
  contentTypes: ["text"],
  severity: "high",
  violationType: "spam",
  patterns: ["\\bspam\\b"],
  enabled: true,
});

Sync Moderation

const { isAllowed, violations } = contentModerationService.moderateSync(
  "content",
  "text"
);

API

contentModerationService

• moderate(context) - Async moderation
• isContentAllowed(content, type) - Check if content is allowed
• moderateSync(content, type) - Sync moderation
• configure(config) - Configure the service

rulesRegistry

• getRules() - Get all rules
• getRulesByContentType(type) - Get rules by content type
• addRule(rule) - Add a custom rule
• removeRule(id) - Remove a rule
• enableRule(id) / disableRule(id) - Toggle rule
• resetToDefaults() - Reset to default rules

ContentPolicyViolationError

• getUserMessage() - Get user-friendly message
• getViolationTypes() - Get violation types
• hasViolationType(type) - Check for specific violation
• getSeverityLevel() - Get highest severity

License

MIT