Lifelong Machine Learning

✍ Scribed by Zhiyuan Chen , Bing Liu

• Publisher: Springer
• Year: 2022
• Tongue: English
• Leaves: 137
• Series: Synthesis Lectures on Artificial Intelligence and Machine Learning
• Edition: 1
• Category: Library

✦ Table of Contents

Cover
Copyright Page
Title Page
Dedication
Contents
Preface
Acknowledgments
Introduction
A Brief History of Lifelong Learning
Definition of Lifelong Learning
Lifelong Learning System Architecture
Evaluation Methodology
Role of Big Data in Lifelong Learning
Outline of the Book
Related Learning Paradigms
Transfer Learning
Structural Correspondence Learning
Naïve Bayes Transfer Classifier
Deep Learning in Transfer Learning
Difference from Lifelong Learning
Multi-Task Learning
Task Relatedness in Multi-Task Learning
GO-MTL: Multi-Task Learning using Latent Basis
Deep Learning in Multi-Task Learning
Difference from Lifelong Learning
Online Learning
Difference from Lifelong Learning
Reinforcement Learning
Difference from Lifelong Learning
Summary
Lifelong Supervised Learning
Definition and Overview
Lifelong Memory-based Learning
Two Memory-based Learning Methods
Learning a New Representation for Lifelong Learning
Lifelong Neural Networks
MTL Net
Lifelong EBNN
Cumulative Learning and Self-motivated Learning
Training a Cumulative Learning Model
Testing a Cumulative Learning Model
Open World Learning for Unseen Class Detection
ELLA: An Efficient Lifelong Learning Algorithm
Problem Setting
Objective Function
Dealing with the First Inefficiency
Dealing with the Second Inefficiency
Active Task Selection
LSC: Lifelong Sentiment Classification
Naïve Bayesian Text Classification
Basic Ideas of LSC
LSC Technique
Summary and Evaluation Datasets
Lifelong Unsupervised Learning
Lifelong Topic Modeling
LTM: A Lifelong Topic Model
LTM Model
Topic Knowledge Mining
Incorporating Past Knowledge
Conditional Distribution of Gibbs Sampler
AMC: A Lifelong Topic Model for Small Data
Overall Algorithm of AMC
Mining Must-link Knowledge
Mining Cannot-link Knowledge
Extended Pólya Urn Model
Sampling Distributions in Gibbs Sampler
Lifelong Information Extraction
Lifelong Learning through Recommendation
AER Algorithm
Knowledge Learning
Recommendation using Past Knowledge
Lifelong-RL: Lifelong Relaxation Labeling
Relaxation Labeling
Lifelong Relaxation Labeling
Summary and Evaluation Datasets
Lifelong Semi-supervised Learning for Information Extraction
NELL: A Never Ending Language Learner
NELL Architecture
Extractors and Learning in NELL
Coupling Constraints in NELL
Summary
Lifelong Reinforcement Learning
Lifelong Reinforcement Learning through Multiple Environments
Acquiring and Incorporating Bias
Hierarchical Bayesian Lifelong Reinforcement Learning
Motivation
Hierarchical Bayesian Approach
MTRL Algorithm
Updating Hierarchical Model Parameters
Sampling an MDP
PG-ELLA: Lifelong Policy Gradient Reinforcement Learning
Policy Gradient Reinforcement Learning
Policy Gradient Lifelong Learning Setting
Objective Function and Optimization
Safe Policy Search for Lifelong Learning
Cross-domain Lifelong Reinforcement Learning
Summary and Evaluation Datasets
Conclusion and Future Directions
Bibliography
Authors' Biographies