5G-Enabled Internet of Musical Things Architectures for Remote Immersive Musical Practices

IEEE Open Journal of the Communications Society, Год журнала: 2024, Номер 5, С. 4691 - 4709

Опубликована: Янв. 1, 2024

Networked Music Performances (NMPs) involve geographically-displaced musicians performing together in real-time. To date, scarce research has been conducted on how to integrate NMP systems with immersive audio rendering techniques able enrich the musicians' perception of sharing same acoustic environment. In addition, use wireless technologies for NMPs largely overlooked. this paper, we propose two architectures Immersive (INMPs), which differ physical positions computing blocks constituting 3D toolchain. These leverage a backend specifically conceived support remote musical practices via Software Defined Networking methods, and takes advantage orchestration, slicing, Multi-access Edge Computing (MEC) capabilities 5G. Moreover, illustrate machine learning algorithms network traffic prediction packet loss concealment. Traffic predictions at multiple time scales are utilized achieve an optimized placement Virtual Network Functions hosting mixing processing functionalities within available MEC sites, depending users' geographical locations current load conditions. An analysis technical requirements INMPs using is provided, along their performance assessment simulators.

Язык: Английский

---

Integration of IoT and blockchain for decentralized management and ownership in the metaverse

International Journal of Communication Systems, Год журнала: 2023, Номер 36(18)

Опубликована: Сен. 4, 2023

Summary This manuscript provides an in‐depth exploration of metaverses, charting their historical development, technological foundations, and potential multifarious applications. It critically assesses the prevailing challenges explores pathways for evolution these expansive, virtual environments. In shedding light on wide‐ranging implications it navigates societal, cultural, regulatory, economic landscapes. further elucidates symbiosis between Internet Things (IoT) presenting empirical evidence derived from purpose‐built IoT frameworks metaverse A series experiments were conducted to affirm hypothesis that integration into utilities, including advanced concepts such as smart buildings, intricate task power grid management, precision‐centric domain agriculture, can drive significant progress. Quantitative findings provide compelling marked improvements in energy conservation, cost‐efficiency, operational effectiveness arising incorporation use cases. With observed mean 25% 17% cost reduction, impressive 22% increase efficiency, specifically realms building applications this study underscores pressing need sustained research development initiatives emerging.

Язык: Английский

---

Musical Metaverse Playgrounds: exploring the design of shared virtual sonic experiences on web browsers

Опубликована: Окт. 26, 2023

The "Musical Metaverse" (MM) promises a new dimension of musical expression, creation, and education through shared virtual environments. However, the research on MM is in its infancy. Little work has been done to understand capabilities user experience. One cause can be found lack technologies capable providing high-quality audio streaming, complex enough interactions within worlds. Two promising candidates for bridging these gaps are web such as WebXR Web Audio, whose combination potentially allow more accessible interoperable networked immersive experiences. To explore this possibility, we developed two prototypes playgrounds. We leveraged Networked-AFrame, Audio with Tone.js Essentia.js create test sonic experiences that conveniently run browsers integrated into commercially available standalone Head-Mounted Displays. first playground focuses facilitating creation multi-user application real-time sound synthesis binaural rendering. second explores analysis music information retrieval creating audio-reactive A preliminary evaluation playgrounds also presented, which revealed some usability issues as: accessing URLs headset, ambiguity ownership tools, impact algorithms perceived audio-visual latency. Finally, paper outlines future discusses possible developments applications web-based

Язык: Английский

---

Immersive networked music performance systems: identifying latency factors

2021 Immersive and 3D Audio: from Architecture to Automotive (I3DA), Год журнала: 2023, Номер unknown, С. 1 - 6

Опубликована: Сен. 5, 2023

Music playing with binaural systems has thus far received remarkably little attention by the research community. Such an activity is particularly relevant for case of networked music performances (NMPs), where geographically displaced musicians play together over a telecommunication network. Recent findings obtained in simulated settings have shown preference spatialized listening during collaborative using headphones, as opposed to conventional stereophonic systems. This result highlighted need enhance current NMP spatial rendering acoustic scene, leading development immersive performance (INMP) A crucial aspect that needs be addressed contribution audio system overall latency processing and transmission chain between network nodes. In this paper, we provide overview INMP topic identify contributions components system. We then relate such state-of-the-art hardware software Based on our analysis, draw concluding remarks discuss open challenges progressing field.

Язык: Английский

---

Exploring the assessment of musical praxis through ICT in the academic context

Frontiers in Education, Год журнала: 2024, Номер 9

Опубликована: Авг. 30, 2024

The evaluation of musical praxis involves a nuanced assessment performer competencies within the intricate dynamics elements, often hindered by subjective influences and transient nature performance. This study investigates integration Information Communication Technology (ICT) tools to enhance instrumental evaluation, focusing on French horn applicants University Valencia Philharmonic Orchestra (OFUV). Employing descriptive observational methodology utilizing MAXQDA application for analysis, examines key aspects interpretation through individual recordings. Results demonstrate that ICT applications facilitate transparent precise performance aspects, underscoring importance incorporating these in performative education. In this regard, 89% participants found feedback be very useful. Leveraging audio-video recordings offers promising avenue comprehensive providing clearer advocating their educational authorities instructors foster objective pedagogy.

Язык: Английский

---

Evaluation of Compressed Higher-Order Ambisonics at Off-Center Listening Positions

Опубликована: Сен. 30, 2024

This paper evaluates the quality of OPUS-compressed 1st-, 3rd-, and 5th-order Ambisonics at off-center listening positions in a studio with hemispherical loudspeaker arrangement. The audio signals were compressed 16, 32, 64 kb/ $s$ per channel compared to an uncompressed reference experiment. Audio scenes comprised frontally panned speech music without surrounding reverberation. experiment reveals requirements Am-bisonics order bandwidth achieve excellent dependence material position for streaming spatial across different venues.

Язык: Английский

---

Investigation of Server–Based Spatial Audio for Metaverse Concert Distribution

Опубликована: Сен. 30, 2024

Modern music delivery contexts include the real-time distribution of musical performances as immersive media ('metaverse concerts') to online audiences. This paper details an investigatory deployment a novel server-based spatial audio rendering system for this context, considering practical wireless Virtual Reality (VR) audience endpoint. Ambisonic auralisation is provided with 6 Degrees Freedom (6DoF) using Spatial Impulse Response (SIR) interpolation approach which efficient large-scale distribution. Binaural distributed mobile device at endpoint low-latency Network Music Performance (NMP) streaming software. Improvement in achieved relative that possible on consumer HMDs. Latency measurements suggest acceptable motion-sound latency not device, however may be achievable other contexts, or optimised systems.

Язык: Английский

---

Holodeck: A Research Framework for Distributed Multimedia Concert Performances

Опубликована: Сен. 30, 2024

This paper presents the Holodeck project, a multi-room research framework designed to support distributed multimedia concert performances. Developed through an inter-lab collaboration at New York University, platform leverages Corelink engine, flexible and unified data routing system that facilitates immersive, interactive experiences across diverse networked environments. The enables real-time streaming synchronization of various types, including audio, video, motion-capture data, thus supporting design implementation augmented Network Music Performances (NMPs). Discussion around case studies large-scale concerts illustrates system's capabilities potential applications. In pilot exploration, has been used gather preliminary on quality experience from both audiences musicians. aims enhance telepresence realism in remote collaborations, contributing development new methodologies artistic practices also discusses technical challenges solutions associated with implementing such adaptive future work regarding its usage immersive NMPs.

Язык: Английский

---

Presence and Flow in Virtual and Mixed Realities for Music-Related Educational Settings

Опубликована: Сен. 30, 2024

Music in Extended Reality (XR) is increasingly present both academic and industrial research. While XR applications are more prevalent STEM education, there growing interest the use of for music education. This study investigates how multi-user scenarios affect perceived social presence flow music-related tasks, as dimensions positively correlate with learning satisfaction effectiveness. Using PatchWorld Fortnite under different Virtual Mixed conditions, participants played interactive musical memory games. Initial results indicate significant differences but not perception depending on modality, providing valuable insights design effective XR-based teaching tools.

Язык: Английский

---

Locally Adapted Immersive Environments for Distributed Music Performances in Mixed Reality

Опубликована: Сен. 30, 2024

The integration of network-based music performance with immersive media technology opens new compelling avenues for live collaborative multimedia concerts and exhibitions. This paper presents a development workflow creating cohesive environments network performances, where an exhibition node is connected to remote ensemble. These rely on the usage local characterization data, such as room acoustic measurements digital twin assets, render mix audio motion-capture streams, capable merging performers into single shared display streamed eXtended Reality devices. Spatialization auralization techniques are used add realism auditory elements ground them in acoustics by musicians stage audiences. resulting "hybrid" combines virtual-reality mixed-reality principles create specific type novel interactive concert experience.

Язык: Английский

---