CODE 90690 ACADEMIC YEAR 2023/2024 CREDITS 6 cfu anno 1 DIGITAL HUMANITIES - INTERACTIVE SYSTEMS AND DIGITAL MEDIA 11661 (LM-92) - GENOVA SCIENTIFIC DISCIPLINARY SECTOR ING-INF/05 LANGUAGE English TEACHING LOCATION GENOVA SEMESTER 2° Semester MODULES Questo insegnamento è un modulo di: MULTIMEDIA PROCESSING TEACHING MATERIALS AULAWEB OVERVIEW After recalling foundational concepts concerning sound production and perception, this course introduces the students to the major techniques for acquisition, analysis, processing, and synthesis of sound and music content in digital form. AIMS AND CONTENT LEARNING OUTCOMES This course aims at providing students with theoretical and practical foundational knowledge about digital processing of sound and music content. Initially, the focus will be on sound as a physical and perceptual phenomenon. Then, techniques for digital acquisition and play back of sound will be addressed, including examples of techniques for automatic analysis and processing of sound in the time and frequency domains. Finally, hints will be provided about the most relevant techniques for sound synthesis and about existing algorithms for music information processing (e.g., for automatic analysis of melody, rhythm, and harmony). AIMS AND LEARNING OUTCOMES The course aims to guide students in acquiring a theoretical and practical knowledge of the most important techniques for: (i) digital sound capturing and playback, (ii) automated analysis of the audio signal in the time and frequency domains, (iii) automated analysis of music content, (iv) digital audio processing, and (v) digital synthesis of sound and music content. Upon completion of the course it is assumed that students will: - know the most important techniques for acquiring sound with special reference to digital acquisition; - know techniques for analyzing the most important characteristics of a sound; - know techniques for processing/editing sound content; - know the most important techniques for digital sound synthesis; - are able to apply these techniques in concrete examples. PREREQUISITES None. TEACHING METHODS The module includes theoretical lectures, with the visual support of slides, in which the concepts are introduced and the individual techniques under study are analyzed, and practical lectures, which can be carried out on a computer, in which students will have the opportunity to apply the concepts learned and experiment with the techniques in practice. Working students and students with certified DSA, disability or other special educational needs are advised to contact the lecturer at the beginning of the course to agree on teaching and examination arrangements that, while respecting the teaching objectives, take into account individual learning patterns. SYLLABUS/CONTENT Recalling acoustics and psychoacoustics: sound, simple harmonic motion, equation of motion for a simple harmonic motion and its parameters. Amplitude: physical intensity of sound, perceived intensity of sound (loudness). Frequency: pure sounds, complex sounds, harmonic series (fundamental frequency, harmonics), noise, perceived frequency of sound (pitch). Phase: phase alignment and cancellation. Spectrum: definition, examples, introduction to the Fourier transform. Transients: envelop, ADSR. Spectrogram. Timber. Acquisition, representation and storage of sound content: analog acquisition, recording and playback: acquisition devices (microphones: major typologies and features), amplifiers, recording devices, playback devices (loudspeakers: major typologies and features). Digital acquisition, recording and playback: analog to digital conversion (sampling, quantization, and coding), digital to analog conversion. Sound analysis: audio frames, analysis of an audio signal in the time domain (algorithms for measuring sound intensity, algorithm for estimating the fundamental frequency), analysis of an audio signal in the frequency domain (algorithms for measuring timbral brightness), auditory modelling. Sound processing: processing of an audio signal in the time domain (inversion, delay, variations of the dynamic range), processing of an audio signal in the frequency domain (filtering, equalization). Introduction to sound synthesis: techniques for transformation, direct generation, and deformation. Examples: subtractive synthesis, additive synthesis, and FM synthesis. Introduction to music computing: music as a composition of sounds. Physical level. Perceptual level. Performance level. Symbolic level. Structural level. Digital representation of music: the MIDI standard. Automated analysis of music content: algorithms for extracting melodic (melodic contour), rythmic (onset detection, beat tracking, and tempo tracking), and harmonic (key finding) features. Exercises. RECOMMENDED READING/BIBLIOGRAPHY Educational material includes: The slides presented during classes. Material related to the exercises, which is made available together with each exercise. Material can be downloaded from AulaWeb. In principle, the notes taken during the lectures and the material available on AulaWeb are sufficient for preparing for the final exam. For students wishing to read a textbook, we recommend: Vincenzo Lombardo, Andrea Valle. Audio e multimedia. Apogeo. Students who cannot attend lectures as well as students with disabilities or learning disorders can contact the teacher to get further indication about the educational material. TEACHERS AND EXAM BOARD GUALTIERO VOLPE Ricevimento: The lecturer is available by appointment at his office on the top floor of Villa Bonino, Viale Causa 13, 16145, Genoa, or at Casa Paganini, Piazza S. Maria in Passione 34, 16123, Genoa, or remotely on the Microsoft Teams platform. To make an appointment, send an e-mail to gualtiero.volpe@unige.it Exam Board ELEONORA CECCALDI (President) GUALTIERO VOLPE (President) ANNALISA BARLA (President Substitute) LESSONS LESSONS START https://easyacademy.unige.it/portalestudenti/index.php?view=easycourse&_lang=it&include=corso Class schedule The timetable for this course is available here: Portale EasyAcademy EXAMS EXAM DESCRIPTION The exam consists of an interview with the teacher. Students with disabilities or learning disorders are allowed to use specific modalities and supports that will be determined on a case-by-case basis in agreement with the Delegate of the Engineering courses in the Committee for the Inclusion of Students with Disabilities. Students are invited to contact the teachers and copy the Delegate (https://unige.it/commissioni/comitatoperlinclusionedeglistudenticondisabilita.html). ASSESSMENT METHODS During the interview, the teacher will assess the knowledge the student has of the major topics of the course, the clarity, and the deepness of presentation. Exam schedule Data appello Orario Luogo Degree type Note 16/02/2024 09:00 GENOVA Esame su appuntamento 05/09/2024 10:00 GENOVA Esame su appuntamento 13/09/2024 09:00 GENOVA Esame su appuntamento FURTHER INFORMATION Master theses are available concerning the topics presented in the course in areas of interest for the scientific and technological research carried out at the Casa Paganini – InfoMus research center of DIBRIS – University of Genoa (www.casapaganini.org). For students who are interested in a master thesis on these topics, the course provides the theoretical and practical knowledge, which is needed to carry out the work in the thesis. Students with disabilities or learning disorders are allowed to use specific modalities and supports that will be determined on a case-by-case basis in agreement with the Delegate of the Engineering courses in the Committee for the Inclusion of Students with Disabilities. Students are invited to contact the teachers and copy the Delegate (https://unige.it/commissioni/comitatoperlinclusionedeglistudenticondisabilita.html).
