CODE 60279 ACADEMIC YEAR 2019/2020 CREDITS 5 cfu anno 2 INTERNET AND MULTIMEDIA ENGINEERING 10378 (LM-27) - GENOVA SCIENTIFIC DISCIPLINARY SECTOR ING-INF/03 LANGUAGE English TEACHING LOCATION GENOVA SEMESTER 1° Semester TEACHING MATERIALS AULAWEB AIMS AND CONTENT LEARNING OUTCOMES The course aims at providing theory and techniques for architectural and functional design of interactive cognitive dynamic systems. Topics are related to data fusion, mutilevel bayesian state estimation and their application to cognitive video and radio domains. Project based learning allows students to acquire design capabilities in the field. AIMS AND LEARNING OUTCOMES -Basic and advanced knowledge on design of telecommunication systems frameworks for context-aware multisensorial processing of signals and data in cognitive agents - Knowledge on methods and techniques for acquisition, representaion and processing of proprioreceptive and extero multisensorial signals in cognitive dynamic agents (e.g. semi autonomous&autonomous vehicles like drones, cars, robots) cognitive radios, etc.) - Knowledge on methods and techniques for Multisensor Data Fusion: coupled hierarchical processing of multisensorial signals. Machine leraning for experience driven learning od Dynamic Fusion models from sequences of multiple sensorial data. - Knowledge om methods and techniques based on Cognitive Dynamic Systems theory for Situation awareness and Self awareness in artificial cognitive agents - Knowledge and capabilities on case studies: design of Self Awareness frameowrk for autonomous systems (dataset on cars robots and drones ) - Knowledge and capabilities to use and apply multisensorial signal processing tools and algorithms for acuisition, , experience driven machine learning for estimation of Data Fusion hierarchical models,, usage of learned models for inference related to dynamic state estimation of agent and its contextual environment situation . TEACHING METHODS Lessons for sharing knowledge Laboratory lessons to reinforce and assess capabilities SYLLABUS/CONTENT Cognitive Telecommunications Systems: an introduction Signal Processing and Cognitive Systems: Bio inspired models Acquisition, representation and inference in Cognitive Dynamic systems Data fusion architectural models Data fusion levels and techniques Temporal and Spatial alignment State estimation (Kalman filter, Particle Filter, Switching models, Hierarchical filters) Situation Awareness and Threat Assessment Probabilistic Graphical Models and Dynamic Bayesian Networks Attractors and Bayesian inference DBNs as experiences models Haykin model Damasio models Friston model Machine learning models for interaction modeling: Unsupervised and supervised clustering of big data self Organizing Maps, Growing Neural Gas, Gaussian Processes, Dirichlet model Mapping of learned models onto DBNs Incremental learning of multiple models based on agent experiencesabnormal situations Applying knowledge and understanding in lab Basic language and tools inytroduction (matlab, C++, datasets used) I Case studies: autonomous car, lego robots, drones and simulators. Applied Experiments using programming techniques and tools Filtering methods on data from dataset; Single agent proprioreceptive and exteroceptive models Self awareness coupled interaction models. Making Judgements: Interactive and Cognitive Systems project oriented techniques Case study identification Interaction system goal identification (entities, service, evaluation performances) State of the art description Project design: architectural and technique level Slide presentation Small team collaborative project definition; project management Individuating Emerging techniques in Cognitive Telecommunications domain Learning and communications skills: Bibliographic search on scientific data bases (e.g. IEEEE Explore) Conference style oral slide presentation RECOMMENDED READING/BIBLIOGRAPHY - A. R. Damasio, Looking for Spinoza: Joy, Sorrow, and the Feeling Brain, 1st ed. Orlando: Harcourt, 2003. [Online]. Available:http://lccn.loc.gov/2002011347 - S. Haykin, Cognitive Dynamic Systems: Perception-action Cycle, Radar and Radio, ser. Cognitive Dynamic Systems: Perception–action Cycle, Radar, and Radio. Cambridge University Press, 2012. - P. R. Lewis, M. Platzner, B. Rinner, J. Torresen, and X. Yao, Eds., Selfaware Computing Systems: An Engineering Approach. Springer, 2016. S. Haykin, Cognitive Dynamic Systems: Perception-action Cycle, Radar and Radio, ser. Cognitive Dynamic Systems: Perception–action Cycle, Radar, and Radio. Cambridge University Press, 2012. - P. R. Lewis, M. Platzner, B. Rinner, J. Torresen, and X. Yao, Eds., Selfaware Computing Systems: An Engineering Approach. Springer, 2016. - K. J. Friston, B. Sengupta, and G. Auletta, “Cognitive dynamics: From attractors to active inference,” Proceedings of the IEEE, vol. 102, no. 4, pp. 427–445, 2014. [Online]. Available: https://doi.org/10.1109/JPROC.2014.2306251 - S. Haykin and J. M. Fuster, “On cognitive dynamic systems: Cognitive neuroscience and engineering learning from each other,” Proceedings of the IEEE, vol. 102, no. 3, pp. 608–628, 2014. TEACHERS AND EXAM BOARD CARLO REGAZZONI Ricevimento: Students can ask appointments for clarifications, explanations on course subjects by sending e-mail at Carlo.Regazzoni@unige.it Exam Board CARLO REGAZZONI (President) SILVANA DELLEPIANE LUCIO MARCENARO LESSONS Class schedule The timetable for this course is available here: Portale EasyAcademy EXAMS EXAM DESCRIPTION Project + Oral ASSESSMENT METHODS Project plus oral project discussion Project can be done either - producing results using course tools on a experience simulated or acquired from a real agent - considering a student selected application involving a agent and a CDS and producing a poster to discuss how course techniques can be applied on it Oral will consist in preparing slides related to the project to be discussed with relation to course concepts Exam schedule Data appello Orario Luogo Degree type Note 16/01/2020 10:15 GENOVA Orale 30/01/2020 10:15 GENOVA Orale 13/02/2020 10:15 GENOVA Orale 11/06/2020 10:15 GENOVA Orale 25/06/2020 10:15 GENOVA Orale 16/07/2020 10:15 GENOVA Orale 30/07/2020 10:15 GENOVA Orale 27/08/2020 10:15 GENOVA Orale 17/09/2020 10:15 GENOVA Orale