Lisbon Unit for Learning and Intelligent Systems

The LUMLIS Machine Learning Reading Group @ INESC-ID

This Machine Learning Reading Group meets regularly to discuss research topics on different sub-fields of Machine Learning.

Reading Group Schedule

Summer Term 2020 Tuesdays at 1:00 PM
Date	Presenter	Topic
Feb 4	Alexandre Borges	Deep Residual Learning - [paper]
Feb 11	João Monteiro	Densely Connected Convolutional Networks - [paper]
Mar 3	Tomás Oliveira	EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks - [paper]
Apr 7	Miguel Freire	Playing Atari with Deep Reinforcement Learning - [paper]
Apr 21	Arlindo Oliveira	ImageNet Classification with Deep Convolutional Meural Networks - [paper]
May 5	Luís Borges	Passage Re-ranking with BERT - [paper]
May 19	Rita Ramos	Show, Attend and Tell: Neural Image Caption Generation with Visual Attention - [paper]
Jun 2	Arlindo Oliveira	Generative Adversarial Nets - [paper]
Jun 16	Miguel Monteiro	Stochastic Segmentation Networks: Modelling Spatially Correlated Aleatoric Uncertainty - [paper]
Jul 7	Dinis Rodrigues	Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks - [paper]

Winter Term 2020 - 2021 Tuesdays at 1:00 PM
Date	Presenter	Topic
Sep 8	Inês Filipe	Very Deep Convolutional Networks for Large-Scale Image Recognition - [paper]
Sep 22	André Godinho	Recipes for building an open-domain chatbot - [paper]
Sep 29	André Cavalheiro	Recurrent Neural Networks - [book chapter]
Oct 6	Rita Ramos	GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks - [paper]
Oct 13	Dinis Rodrigues	Automated Stenosis Detection and Classification in X-ray Angiography Using Deep Neural Network - [paper]
Oct 20	João Moura	Language Models are Few-Shot Learners - [paper]
Oct 27	João Monteiro	Self-training with Noisy Student improves ImageNet classification - [paper]
Nov 3	João Rico	Semi-Supervised Classification with Graph Convolutional Networks - [paper]
Nov 10	Pedro Stralen	Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey - [paper]
Nov 17	João Cardoso	A Simple Framework for Contrastive Learning of Visual Representations - [paper]
Nov 24	Rafael Pedro	Rotate to Attend: Convolutional Triplet Attention Module - [paper]
Dec 15	Tiago Mesquita	Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer - [paper]
Dec 22	Mário Cardoso	STConvS2S: Spatiotemporal Convolutional Sequence to Sequence Network for Weather Forecasting - [paper]
Jan 5	Susana Vinga	Structured sparsity regularization for analyzing high-dimensional omics data - [paper]
Jan 12	Manuel Coimbra	Modeling Relational Data with Graph Convolutional Networks - [paper]
Jan 19	Mário Figueiredo	The free-energy principle a unified brain theory - [paper]
Jan 26	Tiago Oliveira	Informed Machine Learning – A Taxonomy and Survey of Integrating Knowledge into Learning Systems - [paper]
Feb 2	Daniel Oliveira	Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering - [paper]
Feb 9	João Cardoso	COVID-19 Deterioration Prediction via Self-Supervised Representation Learning and Multi-Image Prediction - [paper]
Feb 16	Mário Cardoso	RepVGG: Making VGG-style ConvNets Great Again - [paper]
Feb 23	João Barata	LambdaNetworks: Modeling long-range Interactions without Attention - [paper]

Summer Term 2021 Tuesdays at 1:00 PM
Date	Presenter	Topic
Mar 2	Rita Ramos	CPTR: Full Transformer Network for Image Captioning - [paper]
Mar 16	João Lourenço Silva	SA-UNet: Spatial Attention U-Net for Retinal Vessel Segmentation - [paper]
Mar 30	Beatriz Vieira	Generative Pretraining from Pixels - [paper]
Apr 13	Arlindo Oliveira	The Consciousness Prior - [paper]
Apr 27	Alexandre Borges	Combining Off and On-Policy Training in Model-Based Reinforcement Learning - [paper]
May 11	Nuno Infante	CheXpert++: Approximating the CheXpert labeler for Speed, Differentiability, and Probabilistic Output - [paper]
May 25	Rita Ramos	Unifying Vision-and-Language Tasks via Text Generation - [paper]
June 22	João Lourenço Silva	Encoder-Decoder Architectures for Clinically Relevant Coronary Artery Segmentation - [paper]
June 29	Arlindo Oliveira	Modeling the geospatial evolution of COVID-19 using spatio-temporal convolutional sequence-to-sequence neural networks - [paper]

Winter Term 2021 - 2022 Tuesdays at 1:00 PM
Date	Presenter	Topic
Sep 21	Miguel Freire	CutPaste: Self-Supervised Learning for Anomaly Detection and Localization - [paper]
Sep 28	Gonçalo Raposo	Efficient Nearest Neighbor Language Models - [paper]
Oct 12	Rafael Pedro	ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases - [paper]
Oct 19	Rita Ramos	Towards General Purpose Vision Systems - [paper]
Nov 2	João Lourenço Silva	Emerging Properties in Self-Supervised Vision Transformers - [paper]
Nov 9	Isabel Coutinho	"Why Should I Trust You?": Explaining the Predictions of Any Classifier - [paper]
Nov 16	João Barata	Deep Learning for Remote Sensing Image Captioning (M.Sc. thesis)
	Miguel Freire	Evaluating generalization in Deep Reinforcement Learning with Procedurally Generated Environments (M.Sc. thesis)
Nov 23	João Silva	Deep Convolutional Encoder-Decoder Architectures for Clinically Relevant Coronary Artery Segmentation (M.Sc. thesis)
	Rafael Pedro	Improving the Performance of Computer Vision Models with Attention Mechanisms (M.Sc. thesis)
Nov 30	Xavier Araújo	A Modular Architecture for Model-Based Deep Reinforcement Learning (M.Sc. thesis)
	Helena Oliveira	Deep Learning-based Video Coding: Benchmarking and One Step Forward (M.Sc. thesis)
Dec 7	Pedro Mendes	HyperJump: Accelerating HyperBand via Risk Modelling - [paper]
Dec 14	Luís Borges	Learning Discrete Representations via Constrained Clustering for Effective and Efficient Dense Retrieval - [paper]
Jan 11	José Martinho	nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation - [paper]
Jan 18	Gonçalo Oliveira	Siamese Neural Networks for One-shot Image Recognition - [paper]
Jan 25	Gonçalo Raposo	Improving language models by retrieving from trillions of tokens - [paper]
Feb 1	João Daniel Silva	Learning Transferable Visual Models From Natural Language Supervision - [paper]
Feb 8	Gonçalo Oliveira	Attention-based Deep Multiple Instance Learning - [paper]
Feb 15	Joseph J. Paton	Manipulation of striatal population dynamics using temperature warps judgment of time - [paper]

Summer Term 2022 Tuesdays at 1:00 PM
Date	Presenter	Topic
Mar 15	João Silva	A ConvNet for the 2020s - [paper]
Mar 29	Bálint Magyar	Sanity Checks for Saliency Maps - [paper]
Apr 12	Diogo Moura	FLAVA: A Foundational Language And Vision Alignment Model - [paper]
May 10	Batriz Vieira	Using a Siamese Network to Accurately Detect Ischemic Stroke in Computed Tomography Scans - [paper]
May 24	Tiago Marques	Building integrative systems-level models for neuroscience and artificial intelligence - [paper]
Jun 7	João Sacramento	A contrastive rule for meta-learning - [paper]
Jun 21	Anderson Rocha	Reasoning for Complex Data through Ensemble-based Self-Supervised Learning - [paper]

Winter Term 2022 - 2023 Tuesdays at 1:00 PM
Date	Presenter	Topic
Sep 13	Tiago Oliveira	Revisiting ResNets: Improved Training and Scaling Strategies - [paper]
Sep 20	João Daniel Silva	Compositional Attention: Disentangling Search and Retrieval - [paper]
Sep 27	Manuel Blum and Lenore Blum	The Conscious Turing Machine: A Framework for a Conscious AI - [paper]
Oct 4	Luís Borges	Text-to-Text Multi-view Learning for Passage Re-ranking - [paper]
Oct 11	Miguel Freire	High-Resolution Image Synthesis with Latent Diffusion Models - [paper]
Oct 18	Tiago Oliveira	ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness - [paper]
Oct 25	António Pereira	Swin Transformer V2: Scaling Up Capacity and Resolution - [paper]
Nov 8	André Duarte	Siamese Transformer Networks for Improving Address Matching (M.Sc. thesis) - [paper]
	Nichal Narotamo	Conversational Question Re-Writing (M.Sc. thesis) - [paper]
Nov 15	Gonçalo Oliveira	Towards Improving Ischemic Stroke Functional Outcome Prediction with Computed Tomography Brain Scans Using Deep Learning (M.Sc. thesis) - [paper]
	Manuel Goulão	Pretraining the Vision Transformer using self-supervised methods for vision-based deep reinforcement learning (M.Sc. thesis) - [paper]
Nov 22	José Pereira	Old photo and image restoration using deep learning techniques (M.Sc. thesis) - [paper]
	António Pereira	Comparison of semantic context and inductive biases on self-attention based models (M.Sc. thesis) - [paper]
Nov 29	Gonçalo Mendes	Estimating Emotional Valence and Arousal with Transformer-Based Language Models (M.Sc. thesis) - [paper]
	João Saraiva	Deep Residual Learning for Epileptic Seizure Prediction and Tools to Expedite Biosignal Research (M.Sc. thesis) - [paper]
Dec 6	Miguel Monteiro	Measuring axiomatic soundness of counterfactual image models - [paper]
Dec 13	João Gante	A Contrastive Framework for Neural Text Generation - [paper]
Jan 10	André Duarte	A Unified Approach to Interpreting Model Predictions - [paper]
Jan 17	Yoshua Bengio	Towards Neural Nets for Conscious Processing and Causal Reasoning - [paper]
Jan 24	Arlindo Oliveira and Alexandre Borges	Training language models to follow instructions with human feedback - [paper]
Jan 31	Pedro Henriques	Conditional Prompt Learning for Vision-Language Models - [paper]
Feb 7	João Coelho	Efficient Long-Text Understanding with Short-Text Models - [paper]
Feb 14	João Marques	Constrained transformer network for ECG signal processing and arrhythmia classification - [paper]

Summer Term 2023 Tuesdays at 1:00 PM
Date	Presenter	Topic
Feb 28	Gonçalo Oliveira	Distilling Knowledge from Reader to Retriever for Question Answering - [paper]
Mar 14	Miguel Carvalho	Grounding Language Models to Images for Multimodal Generation - [paper]
Mar 28	João Silva and Manuel Goulão	Cluster Usage Guide - [guide]
Apr 11	Manuel Goulão	Contrastive Model Inversion for Data-Free Knowledge Distillation - [paper]
May 9	João Santinha	Invariant Feature Learning for OOD Robust Image Classification Models - [paper]
May 23	José Cunha	BAM! Born-Again Multi-Task Networks for Natural Language Understanding - [paper]
Jun 27	Ruxandra Barbulescu	Controversial stimuli: Pitting neural networks against each other as models of human cognition - [paper]
Jul 4	Francisco Fernandes	Highly accurate protein structure prediction with AlphaFold - [paper]
Jul 11	Zita Marinho	Self-Consistent Models and Values [paper]

Winter Term 2023 - 2024 Tuesdays at 1:00 PM
Date	Presenter	Topic
Sep 12	João Marques	A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects - [paper]
Sep 19	Arlindo Oliveira	Connecting metrics for shape-texture knowledge in computer vision - [paper]
Sep 26	André Duarte	Lost in the Middle: How Language Models Use Long Contexts - [paper]
Oct 3	Luís Borges	Towards General Text Embeddings with Multi-stage Contrastive Learning - [paper]
Oct 10	Hon Chi Tin	Early warning system and prediction model for Covid-19 in China - [paper]
Oct 17	Isabel Coutinho	Clinical Camel: An Open Expert-Level Medical Language Model with Dialogue-Based Knowledge Encoding - [paper]
Oct 24	João Daniel Silva	MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning - [paper]
Oct 31	João Coelho	LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models - [paper]
Nov 7	Artur Guimarães	Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers - [paper]
Nov 14	Rita Ramos	Evaluation and Analysis of Hallucination in Large Vision-Language Models - [paper]
Nov 21	Isabel Coutinho	Self-Verification Improves Few-Shot Clinical Information Extraction - [paper]
Nov 28	Luís Borges	BLADE: Combining Vocabulary Pruning and Intermediate Pretraining for Scaleable Neural CLIR - [paper]
Dec 4	João Coelho	Text Embeddings by Weakly-Supervised Contrastive Pre-training - [paper]
Dec 11	João Daniel Silva	Dense and Aligned Captions (DAC) Promote Compositional Reasoning in VL Models - [paper]
Jan 9	Artur Guimarães	Chain-of-Verification Reduces Hallucination in Large Language Models - [paper]
Jan 16	Guilherme Costa	Large Language Model (LLM) as a System of Multiple Expert Agents: An Approach to solve the Abstraction and Reasoning Corpus (ARC) Challenge - [paper]
Jan 23	Joana Gonçalves de Sá	Machine Learning as a magnifying glass to study society - [paper]
Jan 30	David Calhas	Hopfield Networks is All You Need - [paper]
Feb 6	Lucas Piper	Spatial-frequency channels, shape bias, and adversarial robustness - [paper]

Summer Term 2024 Tuesdays at 1:00 PM
Date	Presenter	Topic
Feb 20	Francisco Fernandes	De novo design of protein structure and function with RFdiffusion - [paper]
Mar 5	André Duarte	DE-COP: Detecting Copyrighted Content in Language Models Training Data - [paper]
Mar 19	Miguel Almeida	Modular Visual Question Answering via Code Generation - [paper]
Apr 2	Ruxandra Barbulescu	Emergence of Shape Bias in Convolutional Neural Networks through Activation Sparsity - [paper]
Apr 16	David Calhas	Energy Transformer - [paper]
Apr 30	João Daniel Silva	Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery - [paper]
May 14	Gonçalo Gomes	A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification - [paper]
May 28	Martim Afonso	Finding Regions of Interest in Whole Slide Images Using Multiple Instance Learning - [paper]
Jun 11	Gil Rocha	Debating with More Persuasive LLMs Leads to More Truthful Answers - [paper]

Winter Term 2024 - 2025 Tuesdays at 1:00 PM
Date	Presenter	Topic
Sep 24	João Cardoso	Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet - [paper]
Oct 1	Hélder Dias	When Do We Not Need Larger Vision Models? - [paper]
Oct 8	Francisco Guedes	Brain Decodes Deep Nets - [paper]
Oct 15	Inês Duarte	Mamba: Linear-Time Sequence Modeling with Selective State Spaces - [paper]
Oct 22	Gonçalo Gomes	Cobra Effect in Reference-Free Image Captioning Metrics - [paper]
Oct 29	Luís Borges	Gecko: Versatile Text Embeddings Distilled from Large Language Models - [paper]
Nov 5	João Daniel Silva	Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Compositional Understanding - [paper]
Nov 12	Artur Guimarães	Thinking LLMs: General Instruction Following with Thought Generation - [paper]
Nov 26	David Calhas	Computing a human-like reaction time metric from stable recurrent vision models - [paper]
Dec 3	André Duarte	LumberChunker: Long-Form Narrative Document Segmentation - [paper]
Dec 10	Lucas Piper	Explicitly Modeling Pre-Cortical Vision with a Neuro-Inspired Front-End Improves CNN Robustness - [paper]
Dec 17	João Marques	Segment Anything - [paper]