Skip to main content
The Simli integrations in LiveKit Agents and Pipecat work with Trinity-2 faces as they are, with Simli’s default 768x768 video. Both now take Trinity-2’s options, such as a 16:9 video, the avatar’s position or a starting camera: livekit-plugins-simli from 1.8.10, and Pipecat from 1.16. Upgrade if you can. This page keeps the workarounds for older releases.

LiveKit Agents

Trinity-2 options: upgrade to livekit-plugins-simli 1.8.10

From 1.8.10, the plugin’s SimliConfig takes the Trinity-2 options itself and sends the plain face ID, so no workaround is needed. See Trinity-2 options in the LiveKit guide.
The plugin’s SimliConfig sends Simli only the face ID, with a legacy style suffix, and the time limits. Its public create_json() method builds the body of the POST /compose/token request, so a subclass can override it: this one sends the plain face ID and adds the Trinity-2 fields.
Use it in place of simli.SimliConfig:
Remove it when you upgrade to livekit-plugins-simli 1.8.10 or later.

Pipecat

Upgrade to Pipecat 1.16

From 1.16, SimliVideoService takes Trinity-2 framing through framing=SimliVideoService.Framing(...), sends the avatar’s video from the start of the session, and passes GPT-Live’s voice to Simli. None of the workarounds below are needed. See Trinity-2 options in the Pipecat guide.

Trinity-2 options: the Simli SDK’s config

Pipecat’s SimliVideoService has no Trinity-2 options yet. It runs the Simli Python SDK, which sends every field of its SimliConfig to Simli when the session starts, so the starter adds the framing fields there. It’s from our Pipecat starter:
Set the transport’s video to the same size, at Simli’s 25 fps:
_simli_client is a private attribute of SimliVideoService, so this can break when Pipecat changes it. A fix that adds these options to Pipecat’s Simli service is pending upstream.Remove it when that fix is in the Pipecat release you use and SimliVideoService takes the Trinity-2 options itself.

No video until the bot first speaks

SimliVideoService doesn’t pass on any video until the bot’s first audio (pipecat#4832). The starter has the bot greet the user as soon as they connect, so the avatar appears with the greeting.Remove it when the fix, pipecat#5033, is in the Pipecat release you use. You can then let the user speak first if you like.

Use OpenAI Realtime, not GPT-Live

Pipecat’s SimliVideoService ignores the audio frames Pipecat’s GPT-Live service produces, so with GPT-Live the avatar never moves. The starter uses OpenAIRealtimeLLMService instead. The same pending upstream fix to Pipecat’s Simli service covers this.Remove it when that fix is in the Pipecat release you use. GPT-Live then works with Simli like any other voice.