<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class=""><br class=""></div><div class=""><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class="">Boa tarde colegas,<o:p class=""></o:p></span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class="">Boa tarde à comunidade estudantil do DEEC,</span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class=""> </span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class="">Gostava de vos convidar para uma palestra do Prof. João Filipe Henriques, antigo aluno de mestrado e de doutoramento do DEEC, que está de visita a Coimbra. </span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class="">O doutor João Henriques é Research Fellow da Royal Academy of Engineering e investigador no Visual Geometry Group na Universidade de Oxford.</span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><br class=""></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class="">Tópico da Palestra “<b class="">Le</b><span style="font-family: "Segoe UI"; font-size: 16px;" class=""><b class="">arning Location-Consistent Visual Features</b></span>".<o:p class=""></o:p></span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class=""> </span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class="">Dia: <b class="">04-Abril</b> (quinta-feira)<o:p class=""></o:p></span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class="">Hora: Início às <b class="">16h00</b><o:p class=""></o:p></span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class="">Duração : aproximadamente 60min</div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class="">Local: Anfiteatro do ISR<o:p class=""></o:p></span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class="">Mais detalhes: ver abaixo.<o:p class=""></o:p></span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class=""> </span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class="">Com os melhores cumprimentos<o:p class=""></o:p></span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class="">Jorge Batista</span></div></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class=""><br class=""></span></div><div style="margin: 0cm; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" style="font-size: 14px;" class=""><span style="font-family: Helvetica;" class="">Jorge Manuel M.C. Pereira Batista</span><br style="font-family: Helvetica;" class=""><span style="font-family: Helvetica;" class="">Associate Professor w/ Habilitation</span><br style="font-family: Helvetica;" class=""><span style="font-family: Helvetica;" class="">ISR Senior Researcher</span><br style="font-family: Helvetica;" class=""><span style="font-family: Helvetica;" class="">DEEC/FCTUC</span><br style="font-family: Helvetica;" class=""><span style="font-family: Helvetica;" class="">University of Coimbra</span><br style="font-family: Helvetica;" class=""><span style="font-family: Helvetica;" class="">Coimbra, PORTUGAL</span></span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class=""><span style="font-family: Helvetica; font-size: 12px;" class=""><br class=""></span></span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class=""><span style="font-family: Helvetica; font-size: 12px;" class=""><br class=""></span></span></div><div style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><span lang="PT" class=""><span style="font-family: Helvetica; font-size: 12px;" class="">_________________________________________________________________________________________________</span></span></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class="">Dr. João Henriques is a Research Fellow of the Royal Academy of Engineering, working at the Visual Geometry Group (VGG) at the University of Oxford. His research focuses on computer vision and deep learning, with the goal of making machines more perceptive, intelligent and capable of helping people. He created the KCF and SiameseFC visual object trackers, which won the highly competitive VOT Challenge twice, and are widely deployed in consumer hardware, from Facebook apps to commercial drones. His research spans many topics: robot mapping and navigation, including reinforcement learning and 3D geometry; multi-agent cooperation and "friendly" AI; as well as various forms of learning, from self-supervised, causal, and meta-learning, including optimisation theory.</div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class="">In this talk I will discuss recent work on learning location-consistent visual features, and time-permitting will also briefly discuss recent work on robotics.</div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class="">"LoCo: Memory-Efficient Learning of Location-Consistent Features "</div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class="">Image feature extractors are rendered substantially more useful if different views of the same 3D location yield similar features. A feature extractor that achieves this goal even under significant viewpoint changes must recognise not just the semantic categories present in a scene, but also understand how different objects relate to each other in three dimensions.</div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class="">We present a method for memory-efficient learning of location-consistent features that reformulates and approximates the smooth average precision objective. This novel loss function enables improvements in memory efficiency by a factor of 2000, mitigating a key bottleneck of previous methods and allowing much larger models to be trained with the same computational resources.</div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class="">"Rapid Motor Adaptation for Robotic Manipulator Arms "</div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class="">Developing generalizable manipulation skills is a core challenge in embodied AI. This includes generalization across diverse task configurations, encompassing variations in object shape, density, friction coefficient, and external disturbances such as forces applied to the robot. </div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class="">Rapid Motor Adaptation (RMA) offers a promising solution to this challenge.</div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class="">It posits that essential hidden variables influencing an agent's task performance, such as object mass and shape, can be effectively inferred from the agent's action and proprioceptive history. </div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class="">Drawing inspiration from RMA in locomotion and in-hand rotation, we use depth perception to develop agents tailored for rapid motor adaptation in a variety of manipulation tasks.</div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: "Segoe UI"; font-size: 16px;" class="">We evaluated our agents on four challenging tasks from the Maniskill2 benchmark, namely pick-and-place operations with hundreds of objects from the YCB and EGAD datasets, peg insertion with precise position and orientation, and operating a variety of faucets and handles, with customized environment variations.</div></div><div class=""><br class=""></div></body></html>