WebGL and Web Audio software lightweight components for multimedia education

Authors:Xin Chang,Kivanc,Yuksel,Wladyslaw Skarbek

The paper presents the results of our recent work on development contemporary computing tools for multimedia education using WebGL and Web Audio -- the W3C standards.Using literary programming paradigm the WEBSA educational platform was developed. It offers for a user (student), the access to expandable collection of WEBgl Shaders and web Audio scripts. In its front-end WEBSA is featured by flexible user interface exclusively based on HTML5 and its Javascript functionalities ready to use in the most popular WEB browsers. Contrary to typical web applications we do not use any additional framework. Instead the DC2 web application had been developed which is a simple multimedia authoring system with facilities to Describe an educational theme, Configure related applications, Display their results, and finally to let the wiki readers to make Comments visible for authors. For the back-end platforms a lightweight Node.js and CherryPy web servers are used. The unique feature of DC2 is the option of literary programming, offered for both, the author and the reader in order to improve interactivity to lightweight WebGL and Web Audio components. For instance users can define: source audio nodes including synthetic sources,destination audio nodes, and nodes for audio processing such as: sound wave shaping, spectral band filtering, convolution based modification, etc. In case of WebGL beside of classic graphics effects based on mesh and fractal definitions, the novel image processing analysis by shaders is offered like nonlinear filtering, histogram of gradients, and Bayesian classifiers.

keywords: multimedia education, WEBGL, Web Audio, literary programming

Author: Xin Chang
Conference: Title