Skip to main content
Ingenium Logo

You are leaving IngeniumCanada.org

✖


This link leads to an external website that Ingenium does not control. Please read the third-party’s privacy policies before entering personal information or conducting a transaction on their site.

Have questions? Review our Privacy Statement

Vous quittez IngeniumCanada.org

✖


Ce lien mène à un site Web externe qu'Ingenium ne contrôle pas. Veuillez lire les politiques de confidentialité des tiers avant de partager des renseignements personnels ou d'effectuer une transaction sur leur site.

Questions? Consultez notre Énoncé de confidentialité

Ingenium The Channel

Langue

  • Français
Search Toggle

Menu des liens rapides

  • Ingenium Locations
  • Shop
  • Donate
  • Join
Menu

Main Navigation

  • Browse
    • Categories
    • Media Types
    • Boards
    • Featured Stories
  • About
    • About The Channel
    • Content Partners

AI-Generated sound therapy for critically ill patients

Share
5 m
Mar 30, 2022
Categories
Communications
Categories
Computing
Earth & Environment
Health & Wellness
Medicine
Media
Article
Profile picture for user Corona Guan Wang
By: Corona Guan Wang
Ingenium – Canada's Museums of Science and Innovation
Autumn vista of a river winding between pine trees and snow-capped mountains.
Photo Credit
Pixabay from Pexels

At the start of 2022, I joined Ingenium – Canada’s Museums of Science and Innovation as a research assistant. Ingenium curators Dr. Tom Everrett (Communications) and Dr. David Pantalony (Physical Sciences and Medicine) invited me to write about a research project that I am currently affiliated with called Autonomous Adaptive Soundscape (AAS). 

The AAS is an intelligent bio-algorithmic system that selects therapeutic soundscapes to relax ICU patients, via application of machine learning and autonomic biosignals. The system uses sensors to monitor how an ICU patient is feeling, and then delivers therapeutic soundscapes to match.

The AAS project is funded by the Canadian New Frontiers in Research Fund, the Alberta Machine Intelligence Institute, and by a Pilot Seed Grant from the University of Alberta Office of VP Research. The project is led by Professor of Music Michael Frishkopf (Principal Investigator), with Professors Martha Steenstrup, Abram Hindle, Osmar Zaiane, and Michael Cohen (Computer Science, University of Aizu, Japan), Elisavet Papathanassoglou (Nursing), and Demetrios James Kutsogiannis (Critical Care Medicine), along with a team of researchers and participants from diverse backgrounds. The project draws on several research fields including Sound Studies, Sound Therapy, Composition and Sound Design, Machine Learning, Critical Care, Nursing, and Rehabilitation Medicine.

Critically ill patients often experience significant levels of mental and physical stress. Anxiety, mood disorders, sleep deprivation, and delirium related to stress are common. Sound and music therapy is a non-invasive and low-cost method to relieve stress with very limited side effects. 

Compared to music therapists, who are not continuously available, AAS has the potential to provide a diverse range of sound and music treatments – tailored to the specific needs of each patient – and is available constantly and around the clock.

The basic idea of the AAS is a three-point feedback loop, connecting a patient, an AI machine learning agent, and a sound generator. The AI agent interprets in real time the patient’s current stress level by means of a biosensor measuring autonomic signals, such as pulse rate or galvanic skin response. If stress appears to be increasing, the AI agent can then signal the sound generator to try a new soundscape. The patient then hears these soundscapes, completing the loop. 

The key technological components thus involve biosensors, which measure the body and produce biosignals; an interpreter, which analyzes biosignals and produces environment and reward signals; a learning component, which uses environment and reward signals to select a soundscape; and a soundscape generator, which selects, filters, or combines selected sounds from a sound library. 

In this way, AAS operates on its own as an adaptive and automatic sound generator that can function 24 hours a day, 7 days a week. No active or conscious engagement with the system is needed from the patient, though an “off” switch is provided for patients and health care providers.

The project team is composed of a diverse group including academics, graduate students, health professionals, and volunteers. As a team member, part of my role is to curate a global soundscape library with Greg Mulyk, another team member who is a sound designer and programmer. 

Since joining the AAS team in March 2020, I have collected more than 600 soundscapes from all over the world. This sound library includes natural sounds, musical sounds, speech, environmental noises, and synthetic sounds. 

Greg and I have cataloged the collected sounds according to geographical and cultural areas, sonic properties, and environmental types such as biomes for natural sounds.

Since patients come from various cultural, ethnic, and geographical backgrounds, and suffer from varied medical conditions, different patients may respond best to different soundscapes, and their preferred relaxing sounds may also vary over time. 

The most suitable soundscapes for a specific patient depend on factors such as the patient’s health status, linguistic and demographic profile, and listening preferences.

Soundscapes that work for some patients may also become repetitive over time, in which case the AI agent will interpret and select another sound set based on predictions from biosignal responses. 

Based on such possibilities, Greg and I attempt to build a soundscape library that is as diverse as possible in many aspects, in order to draw on a wide selection of sonic types and sources. The collection features a wide range of natural sounds that represent various biomes (e.g., beaches, forests, lakes) and places (e.g., countries, continents, and latitudes). We also included musical sounds such as singing bowls, and folk music from various regions worldwide. All the soundscapes collected are then edited and processed into seamless loops ready for play by the AAS sound generator. After editing, soundscapes are steady, relaxing, and without noticeable sonic events. 

Some of the raw, unedited soundscapes are currently reflected on an evolving global sound map. You can learn more about the AAS project here.


Enjoying the Ingenium Channel? Help us improve your experience with a short survey!

Share your insights
Tags
Sound and Music Therapy, music, health sciences, Machine Learning, sound, soundscapes
Author(s)
Profile picture for user Corona Guan Wang
Corona Guan Wang

Corona Wang is a PhD candidate in Musicology at the University of Alberta. Her research is focused on music in television. Corona's background includes sound design, composition, sound recording, and audio post-production.

Related Stories

A red plastic telephone with the handset off of the base on a light grey table. There are scratches on the phone which is an angular design. The rotary dial is on the handset and attached to the base by a red spiral cord.

A Phone Call from Below the Arctic Ice - The 50th Anniversary of Arctic III Sub-Igloo Phone Call to Prime Minister Pierre Elliott Trudeau

A bushplane, the de Havilland Canada DHC-2 Beaver, on display at the Canada Aviation and Space Museum. A new text panel sits in front of the aircraft: a gray structure with wood-tone side panels and dark metal legs. Its backlit surface presents the name of the aircraft, a selection of images, and interpretive texts. A life-size display of a dock sits to the right, followed by another aircraft and panel.

Whispering Loudly: An Update about the “Quiet Updates”

Louis Victor Jules Vierne (3rd from left), composer and organist of Notre-Dame de Paris cathedral at the keyboard of the Coupleux Givelet electronic organ, Poste Parisien radio station, Paris, France. Anon., “L’orgue des ondes du ‘Poste parisien’ est inauguré.” Le Petit Parisien, 27 October 1932, 1.

The melodious saga of two French pioneers of electronic music who deserve to be better known: Joseph Armand Marie Givelet and Édouard Éloy Coupleux

Cropped photograph of the 1874 ear phonautograph showing the mouthpiece and ear components.

Reconstructing a lost object: can you identify this component in Alexander Graham Bell's 1874 ear phonautograph?

A close-up view of a radio pill a few moments before the first volunteer patient swallowed it. Anon., “Science – Radio Made to Swallow.” Life, 29 April 1957, 74.

Take one of these pills and your innards will call me in the morning: The digestive saga of… the radio pill

A black and white photograph of a walking path lined with tulips, and a large building in the background with tall spires.

Ingenium Archives “City Series”: Ottawa

John D’Alton Woodlock with one of his sons, Peter Woodlock, in front of the family television set, Iberville, Québec, summer of 1949. Arthur Prévost, “Dix ans avant CBFT – À Iberville, on a la TV depuis 14 ans!...” Le Petit Journal, 14 January 1962, A-49.

But sadly, like so many great minds, Québec television pioneer John D’Alton Woodlock was gone too soon – and quickly forgotten

A woman is silhouetted in front of a circular, glowing showcase presenting the Koenig Sound Analyser. The title, “Seeing Sound” is visible on the wall.

Mind the gap: The positive impact of multi-sensory experiences

An overall view of one of the first telephone networks in Canada, Montréal, Québec, 1878. Anon., “Le premier téléphone qui ait jamais été installé à Montréal.” La Presse, 27 January 1912, 5.

They were among the first to reach out and touch someone: A look at one of the first telephone networks in Canada

A three-part, spliced image of a parched and cracked area of soil, an atom encircled with electrons, and the surface of the Moon.

3 things you should know about salty soil, invisibility, and Canada’s lunar rover

The Vertol Model 42 of Skyrotors Limited of Arnprior, Ontario, chartered by Spartan Air Services Limited of Ottawa, Ontario, as part of Operation High Tower. Anon., “Operation High Tower.” The Ottawa Citizen, 8 November 1961, 3.

Your mission, should you choose to accept it, is to move stuff around: Spartan Air Services Limited of Ottawa, Ontario, the Ottawa radio station CFRA and Operation High Tower

Joseph Alphonse Ouimet. Anon., “Le pionnier de la télévision préférait la radio à une bicyclette neuve.” La Patrie, 5 November 1961, 26.

“The pioneer of television preferred radio to a new bicycle:” An overview of the career of Joseph Alphonse Ouimet, a founding father of Canadian television

Footer

About The Channel

The Channel

Contact Us

Ingenium
P.O. Box 9724, Station T
Ottawa ON K1G 5A3
Canada

613-991-3044
1-866-442-4416
contact@IngeniumCanada.org
  • Facebook
  • Instagram
  • Twitter
  • Channel

    • Channel Home
    • About the Channel
    • Content Partners
  • Visit

    • Online Resources for Science at Home
    • Canada Agriculture and Food Museum
    • Canada Aviation and Space Museum
    • Canada Science and Technology Museum
    • Ingenium Centre
  • Ingenium

    • Ingenium Home
    • About Ingenium
    • The Foundation
  • For Media

    • Newsroom
    • Awards

Connect with us

Subscribe to our newsletter to receive the latest Ingenium news straight to your inbox!

Sign Up

Legal Bits

Ingenium Privacy Statement

© 2023 Ingenium

Symbol of the Government of Canada
  • Browse
    • Categories
    • Media Types
    • Boards
    • Featured Stories
  • About
    • About The Channel
    • Content Partners