Deep Learning with Python

504 Pages·2021·7.692 MB·English

by  François Chollet

SECOND EDITION
François Chollet
M A N N I N G
Deep Learning with Python

Deep Learning
with Python
SECOND EDITION
FRANÇOIS CHOLLET
MANNING
SHELTER ISLAND
For online information and ordering of this and other Manning books, please visit
www.manning.com. The publisher offers discounts on this book when ordered in quantity.
For more information, please contact
Special Sales Department
Manning Publications Co.
20 Baldwin Road
PO Box 761
Shelter Island, NY 11964
Email: [email protected]
©2021 by Manning Publications Co. All rights reserved.
No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in
any form or by means electronic, mechanical, photocopying, or otherwise, without prior written
permission of the publisher.
Many of the designations used by manufacturers and sellers to distinguish their products are
claimed as trademarks. Where those designations appear in the book, and Manning Publications
was aware of a trademark claim, the designations have been printed in initial caps or all caps.
Recognizing the importance of preserving what has been written, it is Manning’s policy to have
the books we publish printed on acid-free paper, and we exert our best efforts to that end.
Recognizing also our responsibility to conserve the resources of our planet, Manning books
are printed on paper that is at least 15 percent recycled and processed without the use of
elemental chlorine.
The author and publisher have made every effort to ensure that the information in this book
was correct at press time. The author and publisher do not assume and hereby disclaim any
liability to any party for any loss, damage, or disruption caused by errors or omissions, whether
such errors or omissions result from negligence, accident, or any other cause, or from any usage
of the information herein.
Development editor: Jennifer Stout
Technical development editor: Frances Buontempo
Manning Publications Co. Review editor: Aleksandar Dragosavljevic´
20 Baldwin Road Production editor: Keri Hales
PO Box 761 Copy editor: Andy Carroll
Shelter Island, NY 11964 Proofreaders: Katie Tennant and Melody Dolab
Technical proofreader: Karsten Strøbæk
Typesetter: Dennis Dalinnik
Cover designer: Marija Tudor
ISBN: 9781617296864
Printed in the United States of America
To my son Sylvain: I hope you’ll read this book someday!

brief contents
1 ■ What is deep learning? 1
2 ■ The mathematical building blocks
of neural networks 26
3 ■ Introduction to Keras and TensorFlow 68
4 ■ Getting started with neural networks: Classification
and regression 95
5 ■ Fundamentals of machine learning 121
6 ■ The universal workflow of machine learning 153
7 ■ Working with Keras: A deep dive 172
8 ■ Introduction to deep learning
for computer vision 201
9 ■ Advanced deep learning for computer vision 238
10 ■ Deep learning for timeseries 280
11 ■ Deep learning for text 309
12 ■ Generative deep learning 364
13 ■ Best practices for the real world 412
14 ■ Conclusions 431
vii

contents
preface xvii
acknowledgments xix
about this book xx
about the author xxiii
about the cover illustration xxiv
1 What is deep learning? 1
1.1 Artificial intelligence, machine learning, and deep
learning 2
Artificial intelligence 2 ■ Machine learning 3 ■ Learning
rules and representations from data 4 ■ The “deep” in “deep
learning” 7 ■ Understanding how deep learning works, in
three figures 8 ■ What deep learning has achieved so far 10
Don’t believe the short-term hype 11 ■ The promise of AI 12
1.2 Before deep learning: A brief history of machine
learning 13
Probabilistic modeling 13 ■ Early neural networks 14
Kernel methods 14 ■ Decision trees, random forests, and
gradient boosting machines 15 ■ Back to neural networks 16
What makes deep learning different 17 ■ The modern machine
learning landscape 18
ix