CS5720 - Week 6
Slide 102 of 120

Types of Sequence Problems

πŸ”΅
One-to-One
Traditional neural networks. Each input produces exactly one output, no sequence dependency.
Input
β†’
Network
β†’
Output
  • β€’ Image classification
  • β€’ Credit scoring
  • β€’ Medical diagnosis
πŸ”΅βž‘οΈπŸŸ‘πŸŸ‘πŸŸ‘
One-to-Many
Single input generates a sequence of outputs. Creating sequential content from fixed input.
Image
β†’
RNN
β†’
Word₁
Wordβ‚‚
Word₃
  • β€’ Image captioning
  • β€’ Music generation
  • β€’ Video description
πŸŸ‘πŸŸ‘πŸŸ‘βž‘οΈπŸ”΅
Many-to-One
Sequence of inputs produces a single output. Analyzing entire sequence to make one prediction.
Word₁
Wordβ‚‚
Word₃
β†’
RNN
β†’
Sentiment
  • β€’ Sentiment analysis
  • β€’ Document classification
  • β€’ Activity recognition
πŸŸ‘πŸŸ‘πŸŸ‘βž‘οΈπŸ”΄πŸ”΄πŸ”΄
Many-to-Many
Sequence input produces sequence output. Complex transformations between different sequences.
En₁
Enβ‚‚
En₃
β†’
RNN
β†’
Fr₁
Frβ‚‚
Fr₃
  • β€’ Language translation
  • β€’ Text summarization
  • β€’ Video captioning

Problem Type Comparison

Problem Type Input Output Complexity Key Challenge
One-to-One Fixed size Fixed size Simple Feature extraction
One-to-Many Fixed size Variable sequence Medium When to stop generating
Many-to-One Variable sequence Fixed size Medium Sequence aggregation
Many-to-Many Variable sequence Variable sequence High Alignment and length
πŸ’‘ Choosing the Right Type:
The problem type determines your network architecture. Understanding these patterns helps you choose the right approach for your specific use case!
Prepared by Dr. Gorkem Kar