Speaker
Description
The Space for Interdisciplinary Experiments on Sounds (SInES, University of Vienna) has developed in recent years more than 80 browser-based applications for audio analysis, AI-driven audio feature estimation, (re)synthesis, and video tracking at https://sinestools.univie.ac.at. Following a "upload file – click analyze – download results" philosophy, these free tools leverage modern JavaScript libraries (e.g., TensorFlow.js, Essentia.js) to democratize advanced methods previously requiring high costs or expert programming skills.Recent updates in 2025/2026 introduce powerful new capabilities: | - Audio Analysis & AI: Harmonic Tension Analyser, Masking/Timbral Blending Score Estimator, a Room Acoustics Tool (room acoustic analysis according to ISO3382), Modulation Power Spectrum Analysis etc. New AI models include Speech Emotion Classifiers, Phoneme Recognizer, and musical instrument/ensemble detection. | - Spectral (Re)Synthesis & Editing: A Spectral Editor allows "Photoshop-style" sonogram editing. New tools enable harmonic-percussive separation, Formant shifting, spectrum- and modulation transfer, spectral gating, sound morphing, and artifact-free time-stretching. | - Tracking & Motion: A Face Muscle Tracking Tool allows for the analysis of 52 facial attributes. A new unified interface (based on human.js) now combines pose, face, and hand tracking. Previous SInES Tools for tracking poses, hands, faces, emotions, and points in videos have been completely redesigned (Frame-by-frame resolution, improved AI models) | - SInES Helpers: The collection of statistics tools (ANOVA, PCA, Cluster Analysis) has been extended by browser-based calibrated audio recording and AI-supported sample-slicing. | These and other SInES Tools will be presented at the Forum Acusticum and are available for immediate use online at https://sinestools.univie.ac.at.