Deep Learning with R

• Publisher: Manning
• Year: 2022
• Tongue: English
• Leaves: 568
• Edition: 2
• Category: Library

✦ Synopsis

Deep learning from the ground up using R and the powerful Keras library!

In Deep Learning with R, Second Edition you will learn:

Deep learning from first principles
Image classification and image segmentation
Time series forecasting
Text classification and machine translation
Text generation, neural style transfer, and image generation

Deep Learning with R, Second Edition shows you how to put deep learning into action. It’s based on the revised new edition of François Chollet’s bestselling Deep Learning with Python . All code and examples have been expertly translated to the R language by Tomasz Kalinowski, who maintains the Keras and Tensorflow R packages at RStudio. Novices and experienced ML practitioners will love the expert insights, practical techniques, and important theory for building neural networks.

Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications.

About the technology
Deep learning has become essential knowledge for data scientists, researchers, and software developers. The R language APIs for Keras and TensorFlow put deep learning within reach for all R users, even if they have no experience with advanced machine learning or neural networks. This book shows you how to get started on core DL tasks like computer vision, natural language processing, and more using R.

About the book
Deep Learning with R, Second Edition is a hands-on guide to deep learning using the R language. As you move through this book, you’ll quickly lock in the foundational ideas of deep learning. The intuitive explanations, crisp illustrations, and clear examples guide you through core DL skills like image processing and text manipulation, and even advanced features like transformers. This revised and expanded new edition is adapted from Deep Learning with Python, Second Edition by François Chollet, the creator of the Keras library.

What's inside

Image classification and image segmentation
Time series forecasting
Text classification and machine translation
Text generation, neural style transfer, and image generation

About the reader
For readers with intermediate R skills. No previous experience with Keras, TensorFlow, or deep learning is required.

About the author
François Chollet is a software engineer at Google and creator of Keras. Tomasz Kalinowski is a software engineer at RStudio and maintainer of the Keras and Tensorflow R packages. J.J. Allaire is the founder of RStudio, and the author of the first edition of this book.

✦ Table of Contents

Deep Learning with R, Second Edition
Praise for the First Edition
contents
preface
acknowledgments
about this book
Who should read this book?
About the code
liveBook discussion forum
About the cover illustration
about the authors
Chapter 1: What is deep learning?
1.1 Artificial intelligence, machine learning, and deep learning
1.1.1 Artificial intelligence
1.1.2 Machine learning
1.1.3 Learning rules and representations from data
1.1.4 The “deep” in “deep learning”
1.1.5 Understanding how deep learning works, in three figures
1.1.6 What deep learning has achieved so far
1.1.7 Don’t believe the short-term hype
1.1.8 The promise of AI
1.2 Before deep learning: A brief history of machine learning
1.2.1 Probabilistic modeling
1.2.2 Early neural networks
1.2.3 Kernel methods
1.2.4 Decision trees, random forests, and gradient-boosting machines
1.2.5 Back to neural networks
1.2.6 What makes deep learning different?
1.2.7 The modern machine learning landscape
1.3 Why deep learning? Why now?
1.3.1 Hardware
1.3.2 Data
1.3.3 Algorithms
1.3.4 A new wave of investment
1.3.5 The democratization of deep learning
1.3.6 Will it last?
Chapter 2: The mathematical building blocks of neural networks
2.1 A first look at a neural network
2.2 Data representations for neural networks
2.2.1 Scalars (rank 0 tensors)
2.2.2 Vectors (rank 1 tensors)
2.2.3 Matrices (rank 2 tensors)
2.2.4 Rank 3 and higher-rank tensors
2.2.5 Key attributes
2.2.6 Manipulating tensors in R
2.2.7 The notion of data batches
2.2.8 Real-world examples of data tensors
2.2.9 Vector data
2.2.10 Time-series data or sequence data
2.2.11 Image data
2.2.12 Video data
2.3 The gears of neural networks: Tensor operations
2.3.1 Element-wise operations
2.3.2 Broadcasting
2.3.3 Tensor product
2.3.4 Tensor reshaping
2.3.5 Geometric interpretation of tensor operations
2.3.6 A geometric interpretation of deep learning
2.4 The engine of neural networks: Gradient-based optimization
2.4.1 What’s a derivative?
2.4.2 Derivative of a tensor operation: The gradient
2.4.3 Stochastic gradient descent
2.4.4 Chaining derivatives: The backpropagation algorithm
2.5 Looking back at our first example
2.5.1 Reimplementing our first example from scratch in TensorFlow
2.5.2 Running one training step
2.5.3 The full training loop
2.5.4 Evaluating the model
Chapter 3: Introduction to Keras and TensorFlow
3.1 What’s TensorFlow?
3.2 What’s Keras?
3.3 Keras and TensorFlow: A brief history
3.4 Python and R interfaces: A brief history
3.5 Setting up a deep learning workspace
3.5.1 Installing Keras and TensorFlow
3.6 First steps with TensorFlow
3.6.1 TensorFlow tensors
3.7 Tensor attributes
3.7.1 Tensor shape and reshaping
3.7.2 Tensor slicing
3.7.3 Tensor broadcasting
3.7.4 The tf module
3.7.5 Constant tensors and variables
3.7.6 Tensor operations: Doing math in TensorFlow
3.7.7 A second look at the GradientTape API
3.7.8 An end-to-end example: A linear classifier in pure TensorFlow
3.8 Anatomy of a neural network: Understanding core Keras APIs
3.8.1 Layers: The building blocks of deep learning
3.8.2 From layers to models
3.8.3 The “compile” step: Configuring the learning process
3.8.4 Picking a loss function
3.8.5 Understanding the fit() method
3.8.6 Monitoring loss and metrics on validation data
3.8.7 Inference: Using a model after training
Chapter 4: Getting started with neural networks: Classification and regression
4.1 Classifying movie reviews: A binary classification example
4.1.1 The IMDB dataset
4.1.2 Preparing the data
4.1.3 Building your model
4.1.4 Validating your approach
4.1.5 Using a trained model to generate predictions on new data
4.1.6 Further experiments
4.1.7 Wrapping up
4.2 Classifying newswires: A multiclass classification example
4.2.1 The Reuters dataset
4.2.2 Preparing the data
4.2.3 Building your model
4.2.4 Validating your approach
4.2.5 Generating predictions on new data
4.2.6 A different way to handle the labels and the loss
4.2.7 The importance of having sufficiently large intermediate layers
4.2.8 Further experiments
4.2.9 Wrapping up
4.3 Predicting house prices: A regression example
4.3.1 The Boston housing price dataset
4.3.2 Preparing the data
4.3.3 Building your model
4.3.4 Validating your approach using K-fold validation
4.3.5 Generating predictions on new data
4.3.6 Wrapping up
Chapter 5: Fundamentals of machine learning
5.1 Generalization: The goal of machine learning
5.1.1 Underfitting and overfitting
5.1.2 The nature of generalization in deep learning
5.2 Evaluating machine learning models
5.2.1 Training, validation, and test sets
5.2.2 Beating a common-sense baseline
5.2.3 Things to keep in mind about model evaluation
5.3 Improving model fit
5.3.1 Tuning key gradient descent parameters
5.3.2 Leveraging better architecture priors
5.3.3 Increasing model capacity
5.4 Improving generalization
5.4.1 Dataset curation
5.4.2 Feature engineering
5.4.3 Using early stopping
5.4.4 Regularizing your model
Chapter 6: The universal workflow of machine learning
6.1 Define the task
6.1.1 Frame the problem
6.1.2 Collect a dataset
6.1.3 Understand your data
6.1.4 Choose a measure of success
6.2 Develop a model
6.2.1 Prepare the data
6.2.2 Choose an evaluation protocol
6.2.3 Beat a baseline
6.2.4 Scale up: Develop a model that overfits
6.2.5 Regularize and tune your model
6.3 Deploy the model
6.3.1 Explain your work to stakeholders and set expectations
6.3.2 Ship an inference model
6.3.3 Monitor your model in the wild
6.3.4 Maintain your model
Chapter 7: Working with Keras: A deep dive
7.1 A spectrum of workflows
7.2 Different ways to build Keras models
7.2.1 The Sequential model
7.2.2 The Functional API
7.2.3 Subclassing the Model class
7.2.4 Mixing and matching different components
7.2.5 Remember: Use the right tool for the job
7.3 Using built-in training and evaluation loops
7.3.1 Writing your own metrics
7.3.2 Using callbacks
7.3.3 Writing your own callbacks
7.3.4 Monitoring and visualization with TensorBoard
7.4 Writing your own training and evaluation loops
7.4.1 Training vs. inference
7.4.2 Low-level usage of metrics
7.4.3 A complete training and evaluation loop
7.4.4 Make it fast with tf_function()
7.4.5 Leveraging fit() with a custom training loop
Chapter 8: Introduction to deep learning for computer vision
8.1 Introduction to convnets
8.1.1 The convolution operation
8.1.2 The max-pooling operation
8.2 Training a convnet from scratch on a small dataset
8.2.1 The relevance of deep learning for small data problems
8.2.2 Downloading the data
8.2.3 Building the model
8.2.4 Data preprocessing
8.2.5 Using data augmentation
8.3 Leveraging a pretrained model
8.3.1 Feature extraction with a pretrained model
8.3.2 Fine-tuning a pretrained model
Chapter 9: Advanced deep learning for computer vision
9.1 Three essential computer vision tasks
9.2 An image segmentation example
9.3 Modern convnet architecture patterns
9.3.1 Modularity, hierarchy, and reuse
9.3.2 Residual connections
9.3.3 Batch normalization
9.3.4 Depthwise separable convolutions
9.3.5 Putting it together: A mini Xception-like model
9.4 Interpreting what convnets learn
9.4.1 Visualizing intermediate activations
9.4.2 Visualizing convnet filters
9.4.3 Visualizing heatmaps of class activation
Chapter 10: Deep learning for time series
10.1 Different kinds of time-series tasks
10.2 A temperature-forecasting example
10.2.1 Preparing the data
10.2.2 A common-sense, non–machine learning baseline
10.2.3 Let’s try a basic machine learning model
10.2.4 Let’s try a 1D convolutional model
10.2.5 A first recurrent baseline
10.3 Understanding recurrent neural networks
10.3.1 A recurrent layer in Keras
10.4 Advanced use of recurrent neural networks
10.4.1 Using recurrent dropout to fight overfitting
10.4.2 Stacking recurrent layers
10.4.3 Using bidirectional RNNs
10.4.4 Going even further
Chapter 11: Deep learning for text
11.1 Natural language processing: The bird’s-eye view
11.2 Preparing text data
11.2.1 Text standardization
11.2.2 Text splitting (tokenization)
11.2.3 Vocabulary indexing
11.2.4 Using layer_text_vectorization
11.3 Two approaches for representing groups of words: Sets and sequences
11.3.1 Preparing the IMDB movie reviews data
11.3.2 Processing words as a set: The bag-of-words approach
11.3.3 Processing words as a sequence: The sequence model approach
11.4 The Transformer architecture
11.4.1 Understanding self-attention
11.4.2 Multi-head attention
11.4.3 The Transformer encoder
11.4.4 When to use sequence models over bag-of-words models
11.5 Beyond text classification: Sequence-to-sequence learning
11.5.1 A machine translation example
11.5.2 Sequence-to-sequence learning with RNNs
11.5.3 Sequence-to-sequence learning with Transformer
Chapter 12: Generative deep learning
12.1 Text generation
12.1.1 A brief history of generative deep learning for sequence generation
12.1.2 How do you generate sequence data?
12.1.3 The importance of the sampling strategy
12.1.4 Implementing text generation with Keras
12.1.5 A text-generation callback with variable-temperature sampling
12.1.6 Wrapping up
12.2 DeepDream
12.2.1 Implementing DeepDream in Keras
12.2.2 Wrapping up
12.3 Neural style transfer
12.3.1 The content loss
12.3.2 The style loss
12.3.3 Neural style transfer in Keras
12.3.4 Wrapping up
12.4 Generating images with variational autoencoders
12.4.1 Sampling from latent spaces of images
12.4.2 Concept vectors for image editing
12.4.3 Variational autoencoders
12.4.4 Implementing a VAE with Keras
12.4.5 Wrapping up
12.5 Introduction to generative adversarial networks
12.5.1 A schematic GAN implementation
12.5.2 A bag of tricks
12.5.3 Getting our hands on the CelebA dataset
12.5.4 The discriminator
12.5.5 The generator
12.5.6 The adversarial network
12.5.7 Wrapping up
Chapter 13: Best practices for the real world
13.1 Getting the most out of your models
13.1.1 Hyperparameter optimization
13.1.2 Model ensembling
13.2 Scaling-up model training
13.2.1 Speeding up training on GPU with mixed precision
13.2.2 Multi-GPU training
13.2.3 TPU training
Chapter 14: Conclusions
14.1 Key concepts in review
14.1.1 Various approaches to AI
14.1.2 What makes deep learning special within the field of machine learning
14.1.3 How to think about deep learning
14.1.4 Key enabling technologies
14.1.5 The universal machine learning workflow
14.1.6 Key network architectures
14.1.7 The space of possibilities
14.2 The limitations of deep learning
14.2.1 The risk of anthropomorphizing machine learning models
14.2.2 Automatons vs. intelligent agents
14.2.3 Local generalization vs. extreme generalization
14.2.4 The purpose of intelligence
14.2.5 Climbing the spectrum of generalization
14.3 Setting the course toward greater generality in AI
14.3.1 On the importance of setting the right objective: The shortcut rule
14.3.2 A new target
14.4 Implementing intelligence: The missing ingredients
14.4.1 Intelligence as sensitivity to abstract analogies
14.4.2 The two poles of abstraction
14.4.3 The two poles of abstraction
14.4.4 The missing half of the picture
14.5 The future of deep learning
14.5.1 Models as programs
14.5.2 Machine learning vs. program synthesis
14.5.3 Blending together deep learning and program synthesis
14.5.4 Lifelong learning and modular subroutine reuse
14.5.5 The long-term vision
14.6 Staying up-to-date in a fast-moving field
14.6.1 Practice on real-world problems using Kaggle
14.6.2 Read about the latest developments on arXiv
14.6.3 Explore the Keras ecosystem
14.7 Final words
appendix: Python primer for R users
A.1 Whitespace
A.2 Container types
A.2.1 Lists
A.2.2 Tuples
A.2.3 Dictionaries
A.2.4 Sets
A.3 Iteration with for
A.3.1 Comprehensions
A.4 Defining functions with def
A.5 Defining classes with class
A.5.1 What are all the underscores?
A.5.2 Iterators, revisited
A.6 Defining generators with yield
A.7 Iteration closing remarks
A.8 import and modules
A.8.1 Where are modules found?
A.9 Integers and floats
A.10 What about R vectors?
A.11 Decorators
A.12 with and context management
A.13 Learning more
index
Numerics
A
B
C
D
E
F
G
H
I
K
L
M
N
O
P
Q
R
S
T
U
V
W
X
Y
Z