Skip to content

Add dynamic endpointing#1441

Open
rosetta-livekit-bot[bot] wants to merge 2 commits into
mainfrom
looneys-cheered-whiskys
Open

Add dynamic endpointing#1441
rosetta-livekit-bot[bot] wants to merge 2 commits into
mainfrom
looneys-cheered-whiskys

Conversation

@rosetta-livekit-bot
Copy link
Copy Markdown
Contributor

Summary

  • Port dynamic endpointing state from Python agents to JS, including EMA-based min/max endpoint delay updates.
  • Wire audio recognition to feed user and agent speech timing into endpointing, and use dynamic delays during EOU detection.
  • Add a patch changeset for @livekit/agents.

Testing

  • pnpm --filter @livekit/agents build:types
  • pnpm vitest run agents/src/voice/turn_config/utils.test.ts agents/src/voice/audio_recognition_backchannel.test.ts

Notes

  • pnpm --filter @livekit/agents api:check is blocked by the existing API Extractor limitation on export * as ___ in dist/index.d.ts.

@changeset-bot
Copy link
Copy Markdown

changeset-bot Bot commented May 8, 2026

🦋 Changeset detected

Latest commit: 58f4d56

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 31 packages
Name Type
@livekit/agents Patch
@livekit/agents-plugin-anam Patch
@livekit/agents-plugin-assemblyai Patch
@livekit/agents-plugin-baseten Patch
@livekit/agents-plugin-bey Patch
@livekit/agents-plugin-cartesia Patch
@livekit/agents-plugin-cerebras Patch
@livekit/agents-plugin-deepgram Patch
@livekit/agents-plugin-elevenlabs Patch
@livekit/agents-plugin-fishaudio Patch
@livekit/agents-plugin-google Patch
@livekit/agents-plugin-hedra Patch
@livekit/agents-plugin-hume Patch
@livekit/agents-plugin-inworld Patch
@livekit/agents-plugin-lemonslice Patch
@livekit/agents-plugin-liveavatar Patch
@livekit/agents-plugin-livekit Patch
@livekit/agents-plugin-minimax Patch
@livekit/agents-plugin-mistral Patch
@livekit/agents-plugin-mistralai Patch
@livekit/agents-plugin-neuphonic Patch
@livekit/agents-plugin-openai Patch
@livekit/agents-plugin-phonic Patch
@livekit/agents-plugin-resemble Patch
@livekit/agents-plugin-rime Patch
@livekit/agents-plugin-runway Patch
@livekit/agents-plugin-sarvam Patch
@livekit/agents-plugin-silero Patch
@livekit/agents-plugins-test Patch
@livekit/agents-plugin-trugen Patch
@livekit/agents-plugin-xai Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no potential bugs to report.

View in Devin Review to see 6 additional findings.

Open in Devin Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants