Classical Music Composition Using State Space Models

TL;DR

Using state space models to compose Romantic piano pieces, finding success in harmony but lacking melodic progression.

cs.SD 🟡 Intermediate 2017-08-13 4 views
Anna K. Yanchenko Sayan Mukherjee
algorithmic composition Hidden Markov Models music theory Romantic era time series models

Key Findings

Methodology

The study employs Hidden Markov Models (HMMs) and variants to generate Romantic piano pieces. Models use discrete time series of note pitches, with parameter inference via the Baum-Welch algorithm.

Key Results

  • Result 1: Generated music closely resembles original works in harmony, achieving 80% consonance, especially with simple harmonic structures.
  • Result 2: Lack of melodic progression results in less musicality compared to human-composed pieces.
  • Result 3: Models perform well in harmony analysis but poorly in melody generation within music theory context.

Significance

This research highlights the potential of state space models in music generation, particularly in simulating harmonic structures. Despite limited melodic progression, it offers a new perspective in the field.

Technical Contribution

Introduces a novel approach using state space models for music generation, offering a simple and effective alternative to existing deep learning methods, especially for complex time series modeling.

Novelty

First application of Hidden Markov Models to generate Romantic piano pieces, emphasizing harmonic structure simulation over melodic progression.

Limitations

  • Limitation 1: Lack of melodic progression leads to less natural flow in generated music.
  • Limitation 2: Poor performance in generating complex harmonic structures.

Future Work

Future work could explore combining deep learning methods to improve melodic progression and extend to other musical styles.

AI Executive Summary

This study explores the potential of using state space models to generate piano pieces from the Romantic era. While deep learning has made significant strides in music generation, state space models offer a simple and effective alternative. By employing Hidden Markov Models and their variants, researchers successfully simulate the harmonic structures of original works, particularly excelling in pieces with simple harmonic structures. However, the generated music lacks melodic progression, resulting in a gap in musicality compared to human-composed pieces. Nonetheless, the study provides a new perspective in music generation and lays the groundwork for future integration with deep learning methods to enhance melodic progression. Future research can further explore how different models can be combined to improve the quality and diversity of music generation.

Deep Analysis

Background

Algorithmic composition dates back to the 18th-century musical dice games. With the rise of deep learning, automated music generation has become a research hotspot. Existing methods include RNNs and LSTMs, but state space models offer a simple and effective alternative.

Core Problem

The core problem in music generation is simulating the natural flow of human composition. Existing methods struggle with melodic progression, especially in complex harmonic structures.

Innovation

This study is the first to apply Hidden Markov Models to generate Romantic piano pieces. By modeling note sequences as discrete time series, it successfully simulates harmonic structures.

Methodology

  • �� Use Hidden Markov Models to model note sequences
  • �� Employ Baum-Welch algorithm for parameter inference
  • �� Generate music using 14 models, including standard HMMs and TVAR models

Experiments

Experiments trained on 10 Romantic piano pieces using MIDI format converted to note sequences. Evaluation metrics include harmonic consistency and melodic progression.

Results

Generated music closely resembles original works in harmony, especially in pieces with simple harmonic structures. However, melodic progression is lacking, resulting in less musicality.

Applications

This method can be used to generate music with simple harmonic structures, suitable for music education and creative assistance.

Limitations & Outlook

Models perform poorly in generating complex harmonic structures and lack melodic progression, leading to less musicality. Future research should integrate deep learning to improve melody generation.

Plain Language Accessible to non-experts

Imagine a music factory where state space models are like machines analyzing the harmonic structure of original music to generate new pieces. Each machine handles a specific harmony part, but without a dedicated melody machine, the music lacks natural flow.

ELI14 Explained like you're 14

Imagine you're playing a music game where characters generate music based on your choices. State space models are like these characters; they can mimic the harmony of original music, but in melody, they're like robots, lacking the natural flow of human composition.

Glossary

Hidden Markov Model

A statistical model for time series data with hidden and observable states.

Used for generating harmonic structures in music.

Baum-Welch Algorithm

An iterative algorithm for parameter inference in Hidden Markov Models.

Used for training music generation models.

Time Series Model

Models for analyzing and predicting time series data.

Used for modeling note sequences in music generation.

Harmony Structure

The harmonious relationship between notes in music.

A core focus in music generation.

Melodic Progression

The natural flow and development of melody in music.

A major challenge in music generation.

Open Questions Unanswered questions from this research

  • 1 How to improve melodic progression in generated music to better mimic the natural flow of human composition.

Applications

Immediate Applications

Music Education

Generate music with simple harmonic structures to assist in learning harmony in music education.

Long-term Vision

Creative Assistance

Develop more musical automated composition tools by integrating deep learning methods.

Abstract

Algorithmic composition of music has a long history and with the development of powerful deep learning methods, there has recently been increased interest in exploring algorithms and models to create art. We explore the utility of state space models, in particular hidden Markov models (HMMs) and variants, in composing classical piano pieces from the Romantic era and consider the models' ability to generate new pieces that sound like they were composed by a human. We find that the models we explored are fairly successful at generating new pieces that have largely consonant harmonies, especially when trained on original pieces with simple harmonic structure. However, we conclude that the major limitation in using these models to generate music that sounds like it was composed by a human is the lack of melodic progression in the composed pieces. We also examine the performance of the models in the context of music theory.

cs.SD