Options
All
  • Public
  • Public/Protected
  • All
Menu

Interface AudioVideoFacade

Hierarchy

Implemented by

Index

Properties

Methods

Properties

Optional Readonly transcriptionController

transcriptionController: TranscriptionController

Methods

addAudioMixObserver

addContentShareObserver

addDeviceChangeObserver

addObserver

addVideoTile

bindAudioElement

  • bindAudioElement(element: HTMLAudioElement): Promise<void>

bindVideoElement

  • bindVideoElement(tileId: number, videoElement: HTMLVideoElement): void

captureVideoTile

  • captureVideoTile(tileId: number): ImageData

chooseAudioOutput

  • chooseAudioOutput(deviceId: string): Promise<void>

chooseVideoInputQuality

  • chooseVideoInputQuality(width: number, height: number, frameRate: number): void

createAnalyserNodeForAudioInput

demoteFromPrimaryMeeting

  • demoteFromPrimaryMeeting(): void
  • Remove the promoted attendee from the Primary meeting. This client will stop sharing audio, video, and data messages. This will revert the end-user to precisely the state they were before a call to promoteToPrimaryMeeting

    This will have no effect if there was no previous successful call to promoteToPrimaryMeeting. This may result in AudioVideoObserver.audioVideoWasDemotedFromPrimaryMeeting but there is no need to wait for that callback to revert UX, etc.

    Returns void

enableSVCForContentShare

  • enableSVCForContentShare(enable: boolean): void

enableSimulcastForContentShare

getAllRemoteVideoTiles

getAllVideoTiles

getCurrentMeetingAudioStream

  • getCurrentMeetingAudioStream(): Promise<MediaStream>

getLocalVideoTile

getRTCPeerConnectionStats

  • getRTCPeerConnectionStats(selector?: MediaStreamTrack): Promise<RTCStatsReport>
  • This API will be deprecated in favor of ClientMetricReport.getRTCStatsReport().

    It makes an additional call to the getStats API and therefore may cause slight performance degradation.

    Please subscribe to metricsDidReceive(clientMetricReport: ClientMetricReport) callback, and get the raw RTCStatsReport via clientMetricReport.getRTCStatsReport().

    Parameters

    • Optional selector: MediaStreamTrack

    Returns Promise<RTCStatsReport>

getRemoteVideoSources

getVideoInputQualitySettings

getVideoTile

hasStartedLocalVideoTile

  • hasStartedLocalVideoTile(): boolean

listAudioInputDevices

  • listAudioInputDevices(forceUpdate?: boolean): Promise<MediaDeviceInfo[]>

listAudioOutputDevices

  • listAudioOutputDevices(forceUpdate?: boolean): Promise<MediaDeviceInfo[]>

listVideoInputDevices

  • listVideoInputDevices(forceUpdate?: boolean): Promise<MediaDeviceInfo[]>

mixIntoAudioInput

  • mixIntoAudioInput(stream: MediaStream): MediaStreamAudioSourceNode

pauseContentShare

  • pauseContentShare(): void

pauseVideoTile

  • pauseVideoTile(tileId: number): void

promoteToPrimaryMeeting

  • Allows an attendee in a Replica meeting to immediately transition to a Primary meeting attendee without need for reconnection. The promise should always return a session status even upon failure (i.e. it should never reject). See the guide for more information.

    The resolved MeetingSessionStatus will contain a MeetingSessionStatusCode of the following:

    • MeetingSessionStatusCode.OK: The promotion was successful (i.e. session token was valid, there was room in the Primary meeting, etc.), audio will begin flowing and the attendee can begin to send data messages, and content/video if the call is not already at limit.
    • MeetingSessionStatusCode.AudioAuthenticationRejected: Credentials provided were invalid when connection attempted to Primary meeting. There may be an issue with your mechanism which allocates the Primary meeting attendee for the Replica meeting proxied promotion. This also may indicate that this API was called in a non-Replica meeting.
    • MeetingSessionStatusCode.AudioCallAtCapacity: Credentials provided were correct but there was no room in the Primary meeting. Promotions to Primary meeting attendee take up a slot, just like regular Primary meeting attendee connections and are limited by the same mechanisms.
    • MeetingSessionStatusCode.SignalingBadRequest or MeetingSessionStatusCode.SignalingInternalServerError: Other failure, possibly due to disconnect or timeout. These failures are likely retryable.

    Application code may also receive a callback on AudioVideoObserver.videoAvailabilityDidChange to indicate they can begin to share video.

    chime::DeleteAttendee on the Primary meeting attendee will result in AudioVideoObserver.audioVideoWasDemotedFromPrimaryMeeting to indicate the attendee is no longer able to share.

    Any disconnection will trigger an automatic demotion to avoid unexpected or unwanted promotion state on reconnection. If the attendee still needs to be an interactive participant in the Primary meeting, promoteToPrimaryMeeting should be called again with the same credentials.

    This function should not be called until the first one resolves.

    Parameters

    Returns Promise<MeetingSessionStatus>

    Promise which resolves to a session status for the request. See possible options above.

realtimeCanUnmuteLocalAudio

  • realtimeCanUnmuteLocalAudio(): boolean

realtimeIsLocalAudioMuted

  • realtimeIsLocalAudioMuted(): boolean

realtimeMuteLocalAudio

  • realtimeMuteLocalAudio(): void

realtimeSendDataMessage

  • realtimeSendDataMessage(topic: string, data: any, lifetimeMs?: number): void

realtimeSetCanUnmuteLocalAudio

  • realtimeSetCanUnmuteLocalAudio(canUnmute: boolean): void

realtimeSubscribeToAttendeeIdPresence

  • realtimeSubscribeToAttendeeIdPresence(callback: (attendeeId: string, present: boolean, externalUserId?: string, dropped?: boolean, posInFrame?: RealtimeAttendeePositionInFrame) => void): void

realtimeSubscribeToFatalError

  • realtimeSubscribeToFatalError(callback: (error: Error) => void): void

realtimeSubscribeToLocalSignalStrengthChange

  • realtimeSubscribeToLocalSignalStrengthChange(callback: (signalStrength: number) => void): void

realtimeSubscribeToMuteAndUnmuteLocalAudio

  • realtimeSubscribeToMuteAndUnmuteLocalAudio(callback: (muted: boolean) => void): void

realtimeSubscribeToReceiveDataMessage

  • realtimeSubscribeToReceiveDataMessage(topic: string, callback: (dataMessage: DataMessage) => void): void

realtimeSubscribeToSetCanUnmuteLocalAudio

  • realtimeSubscribeToSetCanUnmuteLocalAudio(callback: (canUnmute: boolean) => void): void

realtimeSubscribeToVolumeIndicator

realtimeUnmuteLocalAudio

  • realtimeUnmuteLocalAudio(): boolean

realtimeUnsubscribeFromReceiveDataMessage

  • realtimeUnsubscribeFromReceiveDataMessage(topic: string): void

realtimeUnsubscribeFromVolumeIndicator

realtimeUnsubscribeToAttendeeIdPresence

  • realtimeUnsubscribeToAttendeeIdPresence(callback: (attendeeId: string, present: boolean, externalUserId?: string, dropped?: boolean, posInFrame?: RealtimeAttendeePositionInFrame) => void): void

realtimeUnsubscribeToFatalError

  • realtimeUnsubscribeToFatalError(callback: (error: Error) => void): void

realtimeUnsubscribeToLocalSignalStrengthChange

  • realtimeUnsubscribeToLocalSignalStrengthChange(callback: (signalStrength: number) => void): void

realtimeUnsubscribeToMuteAndUnmuteLocalAudio

  • realtimeUnsubscribeToMuteAndUnmuteLocalAudio(callback: (muted: boolean) => void): void

realtimeUnsubscribeToSetCanUnmuteLocalAudio

  • realtimeUnsubscribeToSetCanUnmuteLocalAudio(callback: (canUnmute: boolean) => void): void

removeAllVideoTiles

  • removeAllVideoTiles(): void

removeAudioMixObserver

removeContentShareObserver

removeDeviceChangeObserver

removeLocalVideoTile

  • removeLocalVideoTile(): void

removeObserver

removeVideoTile

  • removeVideoTile(tileId: number): void

removeVideoTilesByAttendeeId

  • removeVideoTilesByAttendeeId(attendeeId: string): number[]

setAudioProfile

setContentAudioProfile

Optional setContentShareVideoCodecPreferences

setDeviceLabelTrigger

  • setDeviceLabelTrigger(trigger: () => Promise<MediaStream>): void

Optional setVideoCodecSendPreferences

  • Set codec preferences for this clients send stream in order of most preferred to least preferred. The controller will fallback for one of two reasons

    • The codec is not supported by the browser
    • Another client that has joined the conference does not support receiving the video. Note that if another client does not support any of the codecs provided the sender will not fallback, and that client will not be able to receive from this sender.

    If there is no overlap between what is passed in and what is supported by the browser, this function may not have any effect, and the default set of codecs for this browser will be used.

    Parameters

    Returns void

setVideoMaxBandwidthKbps

  • setVideoMaxBandwidthKbps(maxBandwidthKbps: number): void

start

  • start(options?: { signalingOnly?: boolean }): void
  • Start the meeting session. By default this will connect and begin sending and receiving audio, depending on the implementation.

    This method also allows you to provide options for how connection occurs.

    The only supported option is signalingOnly. Specifying this option will cause the controller to only connect the meeting signaling channel. This can be performed relatively early in the join lifecycle (e.g., prior to choosing audio devices), which can improve join latency.

    Your code is responsible for calling start again without signalingOnly to complete connection.

    Parameters

    • Optional options: { signalingOnly?: boolean }

      Passing signalingOnly: true will cause only the initial signaling connection to occur.

      • Optional signalingOnly?: boolean

    Returns void

startAudioInput

startContentShare

  • startContentShare(stream: MediaStream): Promise<void>

startContentShareFromScreenCapture

  • startContentShareFromScreenCapture(sourceId?: string, frameRate?: number): Promise<MediaStream>

startLocalVideoTile

  • startLocalVideoTile(): number

startVideoInput

startVideoPreviewForVideoInput

  • startVideoPreviewForVideoInput(element: HTMLVideoElement): void

stop

  • stop(): void

stopAudioInput

  • stopAudioInput(): Promise<void>

stopContentShare

  • stopContentShare(): void

stopLocalVideoTile

  • stopLocalVideoTile(): void

stopVideoInput

  • stopVideoInput(): Promise<void>

stopVideoPreviewForVideoInput

  • stopVideoPreviewForVideoInput(element: HTMLVideoElement): void

subscribeToActiveSpeakerDetector

  • subscribeToActiveSpeakerDetector(policy: ActiveSpeakerPolicy, callback: (activeSpeakers: string[]) => void, scoresCallback?: (scores: {}) => void, scoresCallbackIntervalMs?: number): void

unbindAudioElement

  • unbindAudioElement(): void

unbindVideoElement

  • unbindVideoElement(tileId: number, cleanUpVideoElement?: boolean): void

unpauseContentShare

  • unpauseContentShare(): void

unpauseVideoTile

  • unpauseVideoTile(tileId: number): void

unsubscribeFromActiveSpeakerDetector

  • unsubscribeFromActiveSpeakerDetector(callback: (activeSpeakers: string[]) => void): void

Generated using TypeDoc