SONIFICATION

About

Data Sonification is the representation of data by means of sound signals, so it is the analog of scientific visualization, where we deal with auditory instead of visual images. Generally speaking any sonification procedure is a mathematical mapping from a certain data set (numbers, strings, images, ...) to a sound string.

Data sonification is currently used in several fields, for different purposes: science and engineering, education and training, since it provides a quick and effective data analysis and interpretation tool. Although most data analysis techniques are exclusively visual in nature (i.e. are based on the possibility of looking at graphical representations), data presentation and exploration systems could benefit greatly from the addition of sonification capacities.

Installation

To install this portlet the WAR file has to be deployed into the application server.

As soon as the portlet has been successfully deployed on the Science Gateway the administrator has to configure:

  • the list of e-Infrastructures where the application can be executed;
  • some additional application settings.

1.) To configure a generic e-Infrastructure, the following settings have to be provided:

Enabled: A true/false flag which enables or disable the generic e-Infrastructure;

Infrastructure: The acronym to reference the e-Infrastructure;

VOName: The VO for this e-Infrastructure;

TopBDII: The Top BDII for this e-Infrastructure;

WMS Endpoint: A list of WMS endpoint for this e-Infrastructure (max. 10);

MyProxyServer: The MyProxyServer for this e-Infrastructure;

eTokenServer: The eTokenServer for this e-Infrastructure;

Port: The eTokenServer port for this e-Infrastructure;

Serial Number: The MD5SUM of the robot certificate to be used for this e-Infrastructure;

In the following figure is shown how the portlet has been configured to run simulation on the EUMEDGRID-Support e-Infrastructure.

../../_images/SONIFICATION_settings.jpg

2.) To configure the application, the following settings have to be provided:

AppID: The ApplicationID as registered in the UserTracking MySQL database (GridOperations table);

Software TAG: The list of software tags requested by the application;

SMTP Host: The SMTP server used to send notification to users;

Sender: The FROM e-mail address to send notification messages about the jobs execution to users;

In the figure below is shown how the application settings have been configured to run on the CHAIN-REDS Science Gateway.

../../_images/SONIFICATION_settings2.jpg

Usage

To run the simulation the user has to:

  • click on the third accordion of the portlet and,
  • select the input file (e.g. .ski or .mid files) OR select a demo from the list as shown in the below figure:
../../_images/SONIFICATION_inputs.jpg

Each simulation will produce:

  • std.txt: the standard output file;
  • std.err: the standard error file;
  • .wav: the final MIDI file produced during the sonification process;
  • .png: a list of 3D rendering images produced with POVRay if enabled.
../../_images/midilogo_medium.gif

If MIDI Analysis is enabled, a compilation of functions to analyze and visualize MIDI files in the Matlab computing environment will be used.

A typical simulation produces, at the end, the following files:

]$ tree DataSonificationSimulationStarted_148682
DataSonificationSimulationStarted_148682/
├── messages.mid
├── output.README
├── Text2Midi.err
└── Text2Midi.out

References

  • Proceedings of the International Conference on Computational Science, ICCS2010, doi:10.1016/j.procs.2010.04.043: “Data sonification of volcano sesmograms and Sound/Timbre recountruction of ancient musical instruments with Grid infrastructures” – May, 2010 Amsterdam, The Netherlands [1];

Contributor(s)

Please feel free to contact us any time if you have any questions or comments.

Authors:

Roberto BARBERA - Italian National Institute of Nuclear Physics (INFN),

Giuseppe LA ROCCA - Italian National Institute of Nuclear Physics (INFN),

Mariapaola SORRENTINO - Conservatory of Music of Avellino ([4]),

Domenico VICINANZA - DANTE (DANTE)