CallFX

Provider-agnostic video call SDK with real-time AR filters and effects.

⚠️ Status: early development. This package is a placeholder. There is no usable API yet. Follow github.com/samvika/callfx for progress.

What it will be

CallFX is two independent layers:

1. A provider-neutral video effects pipeline — background blur, virtual backgrounds, beauty filters, colour LUTs and Snapchat-style 3D face masks, applied as a plain MediaStreamTrack in → MediaStreamTrack out transform. It works with any video stack: raw getUserMedia, LiveKit, Agora, Daily, or your own WebRTC code. Built on WebGL2 and MediaPipe, with inference running off the render thread.

2. A swappable transport layer — one API for joining rooms, publishing and subscribing to tracks, with adapters for different backends (LiveKit first, plain peer-to-peer and mediasoup to follow), plus capability negotiation and an escape hatch to the underlying client so you never get locked out of provider-specific features.

You can use either layer on its own.

Planned packages

| Package | Purpose | | --- | --- | | @callfx/effects | Effects pipeline — standalone, no transport dependency | | @callfx/effects-ar | 3D face masks (three.js + glTF) | | @callfx/core | Transport interface and room model | | @callfx/livekit | LiveKit adapter | | @callfx/p2p | Peer-to-peer adapter with pluggable signalling | | @callfx/react | React and Next.js bindings |

License

MIT