Skip to main content

Advertisement

Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Soundscape Design Through Evolutionary Engines

Abstract

Two implementations of an Evolutionary Sound Synthesis method using the Interaural Time Difference (ITD) and psychoacoustic descriptors are presented here as a way to develop criteria for fitness evaluation. We also explore a relationship between adaptive sound evolution and three soundscape characteristics: keysounds, key-signals and sound-marks. Sonic Localization Field is defined using a sound attenuation factor and ITD azimuth angle, respectively (Ii, Li). These pairs are used to build Spatial Sound Genotypes (SSG) and they are extracted from a waveform population set. An explanation on how our model was initially written in MATLAB is followed by a recent Pure Data (Pd) implementation. It also elucidates the development and use of: parametric scores, a triplet of psychoacoustic descriptors and the correspondent graphical user interface.

References

  1. [1]

    T. Bäck, Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms,Oxford Univ. Press. 1996.

  2. [2]

    S. Todd and W. Latham. Evolutionary Art and Computers. Academic Press, 1992.

  3. [3]

    D. E. Goldberg. The Race, the Hurdle, and the Sweet Spot: Lessons from Genetic Algorithms for the Automation of Design Innovation and Creativity. In: Evolutionary Design by Computers, Bentley, P. (ed.), Morgan Kaufmann Publisher, San Francisco, pages 105–118, 1999.

  4. [4]

    J.A. Biles, Gen Jam: A Genetic Algorithm for Generating Jazz Solos. InProceedings of the 1994 International Computer Music Conference, (ICMC94), pages 131–137, 1994. http://www.it.rit.edu/~jab/GenJam.html, Jan. 2008.

  5. [5]

    E. R. Miranda, On the evolution of music in a society of self-taught digital creatures.Digital Creativity, 14:1:29–42, 2003.

  6. [6]

    T.J. Mitchell and A.G. Pipe. Convergence Synthesis of Dynamic Frequency Modulation Tones Using an Evolution Strategy. In Applications on Evolutionary Computing, Springer Verlag, Berlin, EvoMusart Conference, Computer Lectures Vol. 3449:533–538, 2005.

  7. [7]

    J. McDermott, N. J.L. Griffith and Michael O’Neill. Evolutionary Computation Applied to Sound Synthesis. In The Art of Artificial Evolution, J. Romero and P. Machado (eds.), Springer Verlag, Berlin, Natural Computing Series, ISSN 1619-7127, pages 81–101, 2008.

  8. [8]

    A. Moroni, J. Manzolli, F. von Zuben, R. Gudwin. Vox Populi: An Interactive Evolutionary System for Algorithmic Music Composition.Leonardo Music Journal, San Francisco, USA, MIT Press, Vol. 10:49–54, 2000.

  9. [9]

    S. Fels and J. Manzolli. Interactive, Evolutionary Textured Sound Composition. InProceedings of the 6th Eurographics Workshop on Multimedia, pages 153–164, 2001.

  10. [10]

    J. Manzolli, J. E. Fornari, A. Maia Jr. and F. Damiani. The Evolutionary Sound Synthesis Method. In Proceedings of theACM Multimedia Conference, page 585–587, ISBN:1-58113-394-4. USA, 2001.

  11. [11]

    J. Fornari, A Maia Jr., J. Manzolli. Creating Soundscapes using Evolutionary Spatial Control. In Applications of Evolutionary Computing, Lectures in Computer Science, Springer-Verlag Berlin/Heidelberg, Vol. 4448:517–526, 2007.

  12. [12]

    J. Fornari, A. Maia Jr., J. Manzolli. Interactive Soundscape Design with Evolutionary Sound. InProceedings of the 2007 International Computer Music Conference (ICMC 2007), Copenhagen, Denmark, pages 427–430, 2007.

  13. [13]

    M. Caetano., J. Manzolli, and F. J. von Zuben, Application of an Artificial Immune System in a Compositional Timbre Design Technique. In C. Jacob et al. (eds.): ICARIS 2005, Lecture Notes in Computer Science 3627, pages 389–403, 2005.

  14. [14]

    Holland, J. H. Adaptation in Natural and Artificial Systems. University of Michigan Press, 1975.

  15. [15]

    J. Blauert. Spatial hearing: the psychophysics of human sound localization. Cambridge: MIT Press, 1997.

  16. [16]

    V. Pulkki, Virtual sound source positioning using vector base amplitude panning.Journal of the Audio Engineering Society, Vol. 45:456–66, 1997.

  17. [17]

    J. M. Chowning. The simulation of moving sound sources. InProceedings of the Audio Engineering Society 39th Convention, New York, NY, USA, 19:1: 2–6, Jan. 1971.

  18. [18]

    M. Cohen, J. Herder and W. L. Martens. Cyberspatial Audio Technology.J. Acous. Soc. Jap., 20:6:389–395, Nov. 1999.

  19. [19]

    T. Barbieri, A. Bianchi, and L. Sbattella. Minus-Two: Multimedia, Sound Spatialization and 3D Representation for Cognitively Impaired Children. In Computer helping people with Special Needs, Lecture Notes in Computer Science, Springer-Verlag Berlin /Heidelberg, Vol. 3118: 1054–1061, 2004.

  20. [20]

    J. B. Kelly and D. P. Phillips. Coding of Interaural time differences of transients in auditory cortex of Rattus norvegicus: Implications for the evolution of mammalian sound localization.Hearing Research, 55:1:39–44. 1991.

  21. [21]

    S.T. Birchfield, S.T. and R. Gangishetty. Acoustic Localization by Interaural Level Difference. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Philadelphia, Pennsylvania, Vol. 4:1109–1112, D.O.I. 10.1109/ICASSP.2005.1416207, 2005.

  22. [22]

    D. S. Brungart and W. M. Rabinowitz. Auditory localization of nearby sources. Head-related transfer functions.The Journal of the Acoustical Society of America, 106:3:1465–1479, Sept. 1999.

  23. [23]

    J. Murray, S. Wermter, H. Erwin. Auditory robotic tracking of sound sources using hybrid crosscorrelation and recurrent networks. In Proceedings of the IEEE/RSJ Intelligent Robots and Systems (IROS 2005), pages 3554–3559 D. O. I. 10.1109/IROS.2005.1545093, 2005.

  24. [24]

    R. Murray Schafer. The Soundscape. ISBN 0-89281-455-1, 1977.

  25. [25]

    B. Truax. Handbook for Acoustic Ecology. ISBN 0-88985-011-9, 1978.

  26. [26]

    M. Leman, V. Vermeulen, L. de Voogdt, D. Moelants, D., & Lesaffre, M. Correlation of Gestural Musical Audio Cues. In Proceedings of Gesture-Based Communication in Human-Computer Interaction: 5th International Gesture Workshop, GW 2003, pages 40–54, 2004.

  27. [27]

    Dahlsteds, P. Evolution in Creative Sound Design. In Evolutionary Computer Music, (ed.) E.R. Miranda & J.L. Biles, Springer-Verlag London, pages 79–99, 2007.

  28. [28]

    L. H. H. Law, S. Phon-Amnuaisuk. Towards Music Fitness Evaluation with the Hierarchical SOM. In Applications of Evolutionary Computing, LNCS, Springer Berlin, Vol. 4974/2008, pages 443–452, 2008.

  29. [29]

    J. Manzolli. continuaMENTE: Integrating Percussion, Audiovisual and Improvisation. To be published in the Proceedings of the International Computer Music Conference (ICMC 2008), Belfast, Irland, 2008.

Download references

Author information

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Fornari, J., Maia, A. & Manzolli, J. Soundscape Design Through Evolutionary Engines. J Braz Comp Soc 14, 51–64 (2008). https://doi.org/10.1007/BF03192564

Download citation

Keywords

  • sound synthesis
  • artificial evolution
  • genetic algorithms
  • sonic spatialization
  • acoustic descriptors