Pjj!k*dZddlmZddlZddlZddlZddlZddlmZmZddl m Z m Z m Z m Z ddlmZddlmZddlmZdd lmZdd lmZmZmZmZej6eZe Zdd ZejAd e d f ddZ!y)u routers/websocket.py ───────────────────────────────────────────────────────────────── WebSocket endpoint: /ws/{session_id}?token= Protocol (JSON frames): CLIENT → SERVER: { "type": "text", "content": "..." } { "type": "audio_b64", "audio_b64": "" } { "type": "end_session" } { "type": "ping" } SERVER → CLIENT: { "type": "text_delta", "content": "token" } { "type": "text_done", "content": "full response", "turn": N } { "type": "audio_chunk", "audio_b64": "" } { "type": "audio_done" } ← signals end of audio stream for this turn { "type": "sentiment", "data": {...} } { "type": "transcription","content": "..." } { "type": "error", "content": "message" } { "type": "pong" } { "type": "session_end", "turn": N } AUDIO FORMAT NOTE: audio_chunk payloads contain raw signed-16-bit little-endian PCM @ 24 kHz mono (no WAV header). The frontend AudioEngine decodes each chunk directly into an AudioBuffer — zero buffering, zero lag. Backend: openai_service.stream_tts_chunks must use response_format="pcm". ) annotationsN)datetimetimezone) APIRouterQuery WebSocketWebSocketDisconnect)WebSocketState) ChatMessage)store) decode_token)analyse_sentimentstream_ai_responsestream_tts_chunkstranscribe_audiocK|jtjk7ry |jt j |d{y7#t $rYywxYww)zBest-effort send. Skips if the socket has already disconnected so we don't trip the "WebSocket is not connected" RuntimeError storm Starlette raises after the client closes.N) client_stater CONNECTED send_textjsondumps Exception)wsobjs k/Users/priyanka/Documents/AI_Agent_Assessment/pepole_hub_candidate/people_hub_candidate/routes/websocket.py_sendr:sM .222 ll4::c?+++    s:A 'A A AA A AA AA z/ws/{session_id})defaultct Kjd{tjdd}|r9 |jdrt |dkDrd}nt |}t |}|sYddl m }|js2td d d d{jd d{ytjdtjd{s0td dd d{jd{ytj j"d{s0td dd d{jd{yddddd.fd d/fd d0fd d1fd hdd2fd d3fd }d4fd d5fd d6d7fd }|d{} | rm| j%ddk(rY| j%dxsdj'} | dvr0| d<tjd | | d!k(rd{d} j(s|d{d8fd# } | r| | d{} | s t+ j-d{} t/j0| }| |d{} | snB tj<d{j>t@jBk(r jd{yy7 #t$r"}tjd|Yd}~d}~wwxYw777v7`7K7&77773#t$r!}tjd"|Yd}~Vd}~wwxYw7E7*7#t.j2$rtjd$YKwxYw7#t*$rtjd%Y0t4$r}d&t7|j9vsd't7|j9vrtjd(n1tj;d)|d*td d+d d{7Yd}~d}~wt$r<}tj;d,|d*td d+d d{7Yd}~d}~wwxYw7#t$r!}tjd-|Yd}~d}~wwxYw7#t$rYywxYw# tj<d{7n,#t$r }tjd-|Yd}~nd}~wwxYwj>t@jBk(r* jd{7w#t$rYwwxYwwxYww)9Nz[WS] connected session=%sFzak:Tz$[WS] auth error session=%s reason=%sr)settingserrorzAuthentication failedtypecontenti1)codeu4[WS] no/invalid token — allowing in APP_DEBUG modezSession not foundzScenario not foundvoice)mode video_avatar video_voicec,jddk(S)Nr(videoget conn_statesr _video_modez roleplay_ws.._video_modes~~f%00c&jdS)zVoice to use for any TTS call on this connection. Returns the avatar-paired voice once it's been picked, else None so stream_tts_chunks() falls back to the env default.r*r-r/sr _tts_voicezroleplay_ws.._tts_voices~~m,,r2cKdrdSddlm}d}tddxsdj}|r4|t |j vr|}t jd||s)|j}t jd ||d<|j|d <td||j|d d{|S7w) uPick an avatar lazily, on first use of video mode. Stored on the connection so subsequent turns reuse the same face — AND the same matched voice. Selection precedence: 1. session.selected_avatar — set by the avatar-picker modal when IS_VIDEO_ROLEPLAY_SELECTION=true. 2. seeded random pick keyed off session_id — the existing behaviour when the picker is disabled or the candidate didn't make a choice. r)r video_enginerselected_avatarNz,[WS] avatar from picker session=%s avatar=%s)seedz'[WS] avatar random session=%s avatar=%sr*)r$avatar avatar_url) servicesr7getattrstripsetlist_available_avatarsloginfo pick_avatarvoice_for_avatarrr;)r7r:pickedr0session session_idrs r_ensure_avatarz#roleplay_ws.._ensure_avatars n %n- -)'#4d;ArHHJ fL$G$G$I JJF HHCZQW X!--:->F HH> F S%+ >"&2%B%B6%J =!B( &11&9      sCCCCc Kjstddid{ys3t| 23d{}td|dd{!tddid{ d{t}t| 23d{} |j t j |/777y6tddid{7y7}7p7M#t$r }tjd|Yd}~xd}~wwxYw6 d d l m } d{7}|jt||d{7}td |d |d |d|jdddd{7n#t$r}tjd|dtdt!|dd{7|rsd}t#|} t%d t'| |D]M} t| | | |z} tdt j(| j+ddd{7OYd}~nd}~wwxYwtddid{7yw)uwEmit TTS for the AI's reply according to the active mode. chat: no TTS, no video — just the audio_done sentinel so the frontend state machine keeps cycling. voice: stream PCM chunks live as before; frontend plays them through AudioEngine. video: collect the full PCM into a buffer, run Wav2Lip, and send a video_ready frame with the cached/generated MP4 URL. Audio chunks are NOT forwarded to the client in this mode — the video has its own audio track baked in, so playing both would double the voice. r$ audio_doneN)r' audio_chunk)r$ audio_b64video_renderingz[WS][video] bad TTS chunk: %srr6 video_readyurlr:cachedfallbackF)r$rOr:rPrQz([WS][video] both render paths failed: %sTexc_info video_errorr#iascii)voice_onrr bytearrayextendbase64 b64decoderrAwarningr<r7get_or_generatebytesr.r"str memoryviewrangelen b64encodedecode) full_responserKpcm_bufaudio_chunk_b64excr7r:resultCHUNKmvisegrHr4r1scenariors r_stream_tts_responsez)roleplay_ws.._stream_tts_responsesc  V\23 3 3 } &7}JL%Y SkB[ QRRR B!23444+%6}JL%Y B/ Bv//@A= 4 SR&ZV\23 3 3  5  B B ;SAA B&Z  -)+++F'77gOOOF)"5M"8,"8,"JJz59     II@#PTI U]s3xHI I I!(q#b'51A1QY0C$1%+%5%5c%:%A%A'%J%2  B.///s*I/CI/CCCI/CI/2C03I/C2 I/"D"&C4'D"*I/,$C6I/CI/I/)C,*I/2I/4D"6 D?DI/DI/$F4D75#FE3F F FI/ I3IGA2III I/II/(I+)I/> ठीक हाँ हांतैयारlet's all right of course sounds goodgookyepyesyupletsokaysureyeahbeginreadystartalright absolutelycx|xsdjjsytfdDS)NrFc3&K|]}|v yw)N).0wts r z:roleplay_ws.._is_ready_response..,s0lowerany)textr _READY_WORDSs @r_is_ready_responsez'roleplay_ws.._is_ready_response$s7 ZR   & & ( 0<000r2c DKjr/jxsdjjdnd}|rd|d}nd}jj t d|t jtjjtjd{|jd D]}td |d zd d{td |dd d{|d{y7]7177 w)uwFirst AI turn: friendly greeting that doubles as a mic test. We deliberately don't run this through the LLM — keeping the wording deterministic means the cache key for the Wav2Lip / ffmpeg-dub render is stable across sessions, so every candidate after the first one gets an instant cached video instead of a 30-90 s render. rrzHi z2! How are you today? Shall we start the interview?z:Hi there! How are you today? Shall we start the interview? assistantroler% timestampN text_deltar# text_doner$r%turn)candidate_namer>splitmessagesappendr rnowrutc isoformatr save_sessionr)namegreetingtokrnrFrs r_send_greetingz#roleplay_ws.._send_greeting.s ELDZDZ&&,"335;;=a@`b TF"TUHSH  ll8<<0::<!    )))>>#&C\cCiHI I I'B1MNNN"8,,, * JN,sHB7D :D;-D (D)D DD DD D D D c  K|j}|sy js jjt d|t j tjj |rd _tj d{d jd} jjt d|t j tjjd}t j 23d{}||z }td|d d{&d} jjt d |t j tjjtj d{|j!dD]}td|dzd d{td|ddd{ |d{y jjt d|t j tjjd}t j 23d{}||z }td|d d{&7 77n6t dd  jd < jjt d |t j tjjd _tj d{7td| jdd{7 |d{7y7777w776 xjdz c_ jjt d |t j tjjtj d{7td| jdd{7t#j$t'|} |d{7 |d{7}t)|t*rtd|dd{7n,#t,$r } t.j1d| Yd} ~ nd} ~ wwxYw j j2k\r#td jdd{7yyw)z8Handle one learner turn: stream AI reply + optional TTS.NuserrTzYou are u. The candidate has just confirmed they're ready to begin. Start the interview now — open with your first scripted line in character.rrr#z[ready])rr%rrruXNo problem — just say 'yes' or 'I'm ready' whenever you'd like to start the interview.rr sentiment)r$dataz[WS] sentiment skipped: %s session_endr$r)r> greeting_donerrr rrrrrr r ai_characterrrrrasyncio create_taskr isinstancedictrrAr[turns)ropening_prompt full_openingdeltanudgerrdsentiment_tasksentiment_resultrgrrnrmrFrs r_process_learner_textz*roleplay_ws.._process_learner_textNsJzz|  $$    # #KT",,x||4>>@% "$'(,%((111x4456$$   '' &ll8<<8BBD) " #5g6F6F#QN% E)L\e$LMMMCE    # #K %",,x||4>>@% $$W- - -{{3'B#) LMMM([UANO O O&u- - -   ll8<<0::<!   -g.>.>I F% U "M\eDE E Em2NM$R (3 'R  $  '' $l&ll8<<8BBD) ! ((111BW^WcWc deee*<888 .M O - F EJ    !ll8<<0::<!    )))B$LL    !,,->t-DE #=111 ;%333 *D1B>N OPPP ; KK4c : : ; <<8>> )]GLLIJ J J *s[BT !J,"BT $J5(J/)J5,T J2A5T :N;-T (N)T NT N A3T N N  NT &N'T /J52T 5BT M"T (M+)T 9M<:T T T  T  NT BT P"T 8P;9.T 'Q*(T .R"3Q64'R"RR"!T " S +ST S  8T TT cK tj|}t|jd{}|r(t d|dd{|d{yt dddd{y7F7/7!7 #t $r<}t jd|t dd|dd{7Yd}~yd}~wwxYww)z+Transcribe audio blob then process as text.N transcriptionr#rz [WS] audio error session=%s: %sr"zAudio processing failed: )rYrZr language_coderrrAr")rLrawrrgrrFrGrs r_process_audioz#roleplay_ws.._process_audios ]##I.C)#w/D/DEEDBT JKKK+D111BR HIII FK1J ] II8*c JW;TUXTY9Z[\ \ \ ]sC .BA:B A< BA>B!C "B4B5B9C :B<B>BB C ,C7B:8C=C CC cK tjj|d{} t j |S7#tjtf$rYywxYw#t j$rYywxYww)N)timeout)rwait_for receive_text TimeoutErrorrrloadsJSONDecodeError) timeout_srrs r_drain_first_frame_or_timeoutz2roleplay_ws.._drain_first_frame_or_timeoutsv (():INNC ::c? " O$$i0  ##  sUB(A AA A)BA A&#B%A&&B)A?<B>A??Br$r(chatr'r,z"[WS] mode (pre-open)=%s session=%sr,S] avatar pick failed: %scK|jdd}|dk(rt ddid{y|dk(r!|jddd{y|dk(r!|jddd{y|dk(rY|jdxsd j}|d vr1|d<tj d | |d k(rd{yy|dk(r"t djdd{ytjd| y7777K#t $r }tj d |Yd}~yd}~wwxYw7Qw)Nr$rpingpongrr%rLr(r'rz[WS] mode=%s session=%sr,r end_sessionrrFz([WS] unknown message type=%s session=%sT) r.rr>rArBrr[rdebug) msgmtypenew_modergrHrrr0rFrGrs r _dispatchzroleplay_ws.._dispatchsdGGFB'EB 0111&%&+CGGIr,BCCC"!+%$SWW["%=>>>&GGFO6w==?99)1Jv&HH6*M7*#1#333 -'B MNNN DeZX'2C>4(LKK(EsKK LOs|)ED%ED%E8D9AE D#D!D##E=E>EEE!D## E ,EEE  Ez[WS] invalid JSON session=%sz[WS] disconnected session=%sz not connectedacceptz)[WS] client closed mid-stream session=%sz"[WS] runtime error session=%s: %srRzSession ended unexpectedly.z[WS] error session=%s: %sz%[WS] save_session at close failed: %s)returnbool)rz str | None)rr^)rdr^rNone)rr^rr)rr)rr^rr)rLr^rr)g?)rfloat)rrrr)"rrArB startswithrar rrr[configr! APP_DEBUGrcloser get_session get_scenario scenario_idr.r>rr rrrr RuntimeErrorr^rr"rrr r)rrGtokenauth_okdecodedrgr!rrpending_first_msgrr keep_goingraw_msgrrrHrrrrnr4r1r0rmrFs`` @@@@@@@@@@@r roleplay_wsrFs6 ))+HH ):6G  Q&u:>"G&u-w- #!!W9PQR R R(((% % %  JK%%j11G B5HIJJJhhj''(;(;< C P P Q S % 2J=KX >, DKK =sCCD #<< .''  ;ZH . > 0*= Y c#hnn. .(c#hnn>N2N HH@* M II:JVZI [W9VWX X X U . C$ OB5RSTTT U . F KK? E E F !   F$$W- - - F KK? E E F ??n66 6 hhj     7sV8L-V88L0;&V8!M"V8;M!<2V8.M$/V8M'V8M* 'V8M-V8 M0!V88M39A V8M6A"V8< M<M9M< V8O%$N)%O%N,$O%'N/(O%-N2 O% O"O%T S!0S1S!5V8T&T'T+V80 M9MV8MV8!V8$V8'V8*V8-V80V83V86V89M<< N&N!V8!N&&V8)O%,O%/O%2)OO%OO%%ST SA8RR R T  S+S S  ST ST S!! T *TV8T  V8T TV8TV8 V5"U:T=;UV5 U* U% V5%U** V5 V%V!V%$V5% V1.V50V11V55V8)rrrrrr)rrrGr^rr^)"__doc__ __future__rrrYrloggingrrfastapirrrr starlette.websocketsr models.schemasr r<r services.authr services.openai_servicerrrr getLogger__name__rArouterr websocketrrr2rrs:# 'DD/&&g!   $%r"www w&wr2