45 min
Lesson 3 of 5
Speaker Diarization & Analysis
From the course Speech-to-Text & Audio AI
Advanced Audio Intelligence
Speaker Diarization
Identify who said what in multi-speaker audio:
// AssemblyAI with speaker diarization
const transcript = await assembly.transcripts.transcribe({
audio_url: audioUrl,
speaker_labels: true,
});
for (const utterance of transcript.utterances) {
console.log(`Speaker ${utterance.speaker}: ${utterance.text}`);
}
// Speaker A: Welcome to the meeting.
// Speaker B: Thank you. Let's discuss the project.
Sentiment Analysis on Speech
const transcript = await assembly.transcripts.transcribe({
audio_url: audioUrl,
sentiment_analysis: true,
});
for (const result of transcript.sentiment_analysis_results) {
console.log(`[${result.sentiment}] ${result.text}`);
}
Additional Audio Features
- Auto chapters: Automatically segment long audio into topics
- Entity detection: Extract names, dates, locations from speech
- Content moderation: Flag sensitive or inappropriate content
- Language detection: Identify the spoken language automatically
- Translation: Transcribe and translate simultaneously
Meeting Intelligence Pipeline
- Record: Capture meeting audio (Zoom, Teams, in-person)
- Transcribe: Convert to text with speaker labels
- Analyze: Extract action items, decisions, topics
- Summarize: Use an LLM to create meeting notes
- Distribute: Share structured notes with attendees
Key Takeaways
- •Speaker diarization identifies individual speakers in audio
- •Sentiment analysis reveals emotional tone throughout conversations
- •Meeting intelligence combines transcription, analysis, and summarization
- •Advanced features include auto-chapters, entity detection, and translation
0 of 5 lessons marked complete
Progress is kept in this browser only.