AI Model Wiki

    Skip to main content
    45 min
    Lesson 3 of 5

    Speaker Diarization & Analysis

    From the course Speech-to-Text & Audio AI

    Advanced Audio Intelligence

    Speaker Diarization

    Identify who said what in multi-speaker audio:

    // AssemblyAI with speaker diarization
    const transcript = await assembly.transcripts.transcribe({
      audio_url: audioUrl,
      speaker_labels: true,
    });
    
    for (const utterance of transcript.utterances) {
      console.log(`Speaker ${utterance.speaker}: ${utterance.text}`);
    }
    // Speaker A: Welcome to the meeting.
    // Speaker B: Thank you. Let's discuss the project.
    

    Sentiment Analysis on Speech

    const transcript = await assembly.transcripts.transcribe({
      audio_url: audioUrl,
      sentiment_analysis: true,
    });
    
    for (const result of transcript.sentiment_analysis_results) {
      console.log(`[${result.sentiment}] ${result.text}`);
    }
    

    Additional Audio Features

    • Auto chapters: Automatically segment long audio into topics
    • Entity detection: Extract names, dates, locations from speech
    • Content moderation: Flag sensitive or inappropriate content
    • Language detection: Identify the spoken language automatically
    • Translation: Transcribe and translate simultaneously

    Meeting Intelligence Pipeline

    1. Record: Capture meeting audio (Zoom, Teams, in-person)
    2. Transcribe: Convert to text with speaker labels
    3. Analyze: Extract action items, decisions, topics
    4. Summarize: Use an LLM to create meeting notes
    5. Distribute: Share structured notes with attendees

    Key Takeaways

    • •Speaker diarization identifies individual speakers in audio
    • •Sentiment analysis reveals emotional tone throughout conversations
    • •Meeting intelligence combines transcription, analysis, and summarization
    • •Advanced features include auto-chapters, entity detection, and translation
    0 of 5 lessons marked complete

    Progress is kept in this browser only.