What is SG Com?

The SG Com SDK provides access to Speech Graphics' real-time audio-driven facial animation technology, enabling developers to build applications with avatars driven by voice.

SG Com converts an audio stream into high-fidelity facial animation which may be streamed to other endpoints. The processing delay between input and output is 50 milliseconds.

The SDK includes:

• SG Com API, a C API

• SG Com Unreal Engine Plugin, for easy integration into the Unreal Engine

C# bindings and sample Unity integrations are also available on request.

SG Com features

• Accurate lip sync in any language for any character

• Automatic detection of emotion (positive, negative, neutral)

• Automatic detection of nonverbal vocalizations such as laughter and grunts

• Automatic detection of audible breaths

• Full-face expressions, driven by detected emotion or vocalizations

• Head motion appropriate for the current speech

• Chest breath motion that is timed with the speech and audible breath

• Blinks and eye microdarts

• Fully live and interruptable behavior

• Idle behavior during quiet periods

• Roles for both speaking and listening (reacting to speech)

• Variety of live behavior controls with which to direct the behavior mode, facial expression, and characteristics such as intensity and speed of movements or frequency of changes

• Notifications for changes in behavior mode, expression, voice activity and breath