Deep learning for physical scientists: accelerating research with machine learning
Gespeichert in:
| Hauptverfasser: | , |
|---|---|
| Format: | Buch |
| Sprache: | English |
| Veröffentlicht: |
Chichester
Wiley
2022
|
| Schlagworte: | |
| Online-Zugang: | Buchcover Inhaltsverzeichnis |
| Beschreibung: | xii, 196 Seiten Illustrationen, Diagramme |
| ISBN: | 9781119408338 |
Internformat
MARC
| LEADER | 00000nam a22000008c 4500 | ||
|---|---|---|---|
| 001 | BV046220022 | ||
| 003 | DE-604 | ||
| 005 | 20220727 | ||
| 007 | t | ||
| 008 | 191029s2022 a||| |||| 00||| eng d | ||
| 020 | |a 9781119408338 |9 978-1-119-40833-8 | ||
| 035 | |a (OCoLC)1298744407 | ||
| 035 | |a (DE-599)KXP1679744801 | ||
| 040 | |a DE-604 |b ger |e rda | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-739 |a DE-92 | ||
| 084 | |a ST 301 |0 (DE-625)143651: |2 rvk | ||
| 100 | 1 | |a Pyzer-Knapp, Edward O. |e Verfasser |0 (DE-588)1225701597 |4 aut | |
| 245 | 1 | 0 | |a Deep learning for physical scientists |b accelerating research with machine learning |c Edward O. Pyzer-Knapp, Matthew Benatan |
| 264 | 1 | |a Chichester |b Wiley |c 2022 | |
| 300 | |a xii, 196 Seiten |b Illustrationen, Diagramme | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 650 | 0 | 7 | |a Maschinelles Lernen |0 (DE-588)4193754-5 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Deep learning |0 (DE-588)1135597375 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Künstliche Intelligenz |0 (DE-588)4033447-8 |2 gnd |9 rswk-swf |
| 689 | 0 | 0 | |a Deep learning |0 (DE-588)1135597375 |D s |
| 689 | 0 | 1 | |a Maschinelles Lernen |0 (DE-588)4193754-5 |D s |
| 689 | 0 | 2 | |a Künstliche Intelligenz |0 (DE-588)4033447-8 |D s |
| 689 | 0 | |5 DE-604 | |
| 700 | 1 | |a Benatan, Matthew |e Verfasser |0 (DE-588)1245015052 |4 aut | |
| 776 | 0 | 8 | |i Erscheint auch als |n Online-Ausgabe, PDF |z 978-1-119-40832-1 |
| 776 | 0 | 8 | |i Erscheint auch als |n Online-Ausgabe, EPUB |z 978-1-119-40835-2 |
| 856 | 4 | 2 | |m SWB Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=031598707&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Buchcover |
| 856 | 4 | 2 | |m Digitalisierung UB Passau - ADAM Catalogue Enrichment |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=031598707&sequence=000002&line_number=0002&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-031598707 | ||
Datensatz im Suchindex
| _version_ | 1804180620653363200 |
|---|---|
| adam_text | Contents About the Authors xi Acknowledgements xii 1 1.1 Prefix - Learning to Think Deep” 1 So What Do I Mean by Changing the Way You Think? 2 2 Setting Up a Python Environment for Deep Learning Projects 5 2.1 Python Overview 5 2.2 Why Use Python for Data Science? 6 2.3 Anaconda Python 7 2.3.1 Why Use Anaconda? 7 2.3.2 Downloading and Installing Anaconda Python 7 2.3.2.1 Installing TensorFlow 9 2.4 Jupyter Notebooks 10 2.4.1 Why Use a Notebook? 10 2.4.2 Starting a Jupyter Notebook Server 11 2.4.3 Adding Markdown to Notebooks 12 2.4.4 A Simple Plotting Example 14 2.4.5 Summary 16 3 3.1 3.2 3.3 3.3.1 3.3.2 3.3.2.1 Modelling Basics 17 Introduction 17 Start Where You Mean to Go On ֊ Input Definition and Creation 17 Loss Functions 18 Classification and Regression 19 Regression Loss Functions 19 Mean Absolute Error 19
vi Contents 3.3.2.2 Root Mean Squared Error 19 3.3.3 Classification Loss Functions 20 3.3.3.1 Precision 21 3.3.3.2 Recall 21 3.3.3.3 Fļ Score 22 3.3.3.4 Confusion Matrix 22 3.3.3.5 (Area Under) Receiver Operator Curve (AU-ROC) 23 3.3.3.6 Cross Entropy 25 3.4 Overfitting and Underfitting 28 3.4.1 Bias-Variance Trade-Off 29 3.5 Régularisation 31 3.5.1 Ridge Regression 31 3.5.2 LASSO Régularisation 33 3.5.3 Elastic Net 34 3.5.4 Bagging and Model Averaging 34 3.6 Evaluating a Model 35 3.6.1 Holdout Testing 35 3.6.2 Cross Validation 36 3.7 The Curse of Dimensionality 37 3.7.1 Normalising Inputs and Targets 37 3.8 Summary 39 Notes 39 4 4.1 4.2 4.2.1 4.2.2 4.2.3 4.2.3.1 4.2.3.2 4.2.4 4.2.5 4.3 4.4 4.4.1 4.4.2 4.4.2.1 4A2.2 Feedforward Networks and Multilayered Perceptrons 41 Introduction 41 The Single Perceptron 41 Training a Perceptron 41 Activation Functions 42 Back Propagation 43 Weight Initialisation 45 Learning Rate 46 Key Assumptions 46 Putting It All Together in TensorFlow 47 Moving to a Deep Network 49 Vanishing Gradients and Other “Deep” Problems 53 Gradient Clipping 54 Non-saturating Activation Functions 54 ReLU 54 Leaky ReLU 56
4.4.2.3 4.4.3 4.4.3.1 4.4.3.2 4.4.4 4.5 4.5.1 4.5.2 4.5.3 4.5.4 4.5.5 4.5.6 4.5.7 4.5.8 4.5.9 4.5.10 4.6 4.6.1 4.7 4.8 4.9 4.10 5 5.1 5.2 5.2.1 5.2.2 5.2.3 5.3 5.3.1 5.3.2 5.3.3 5.3.4 5.3.5 5.4 5.4.1 5.5 5.6 ELU 57 More Complex Initialisation Schemes 57 Xavier 58 He 58 Mini Batching 59 Improving the Optimisation 60 Bias 60 Momentum 63 Nesterov Momentum 63 (Adaptive) Learning Rates 63 AdaGrad 64 RMSProp 65 Adam 65 Régularisation 66 Early Stopping 66 Dropout 68 Parallelisation of learning 69 Hogwild! 69 High and Low-level Tensorflow APIs 70 Architecture Implementations 72 Summary 75 Papers to Read 73 Recurrent Neural Networks 77 Introduction 77 Basic Recurrent Neural Networks 77 Training a Basic RNN 78 Putting It All Together in TensorFlow 79 The Problem with Vanilla RNNs 81 Long Short-Term Memory (LSTM) Networks 82 Forget Gate 82 Input Gate 84 Output Gate 84 Peephole Connections 85 Putting It All Together in TensorFlow 86 Gated Recurrent Units 87 Putting It All Together in TensorFlow 88 Using Keras for RNNs 88 Real World Implementations 89
viii I Contents 5.7 5.8 Summary 89 Papers to Read 90 6 Convolutional Neural Networks 93 6.1 Introduction 93 6.2 Fundamental Principles of Convolutional Neural Networks 94 6.2.1 Convolution 94 6.2.2 Pooling 95 6.2.2.1 Why Use Pooling? 95 Ć.2.2.2 Types of Pooling 96 6.2.3 Stride and Padding 99 6.2.4 Sparse Connectivity 101 6.2.5 Parameter Sharing 101 6.2.6 Convolutional Neural Networks with TensorFlow 102 6.3 Graph Convolutional Networks 103 6.3.1 Graph Convolutional Networks in Practice 104 6.4 Real World Implementations 107 6.5 Summary 108 6.6 Papers to Read 108 7 7.1 7.1.1 7.2 7.2.1 7.2.2 7.3 7.4 7.5 7.6 1П 7.8 7.9 7.10 Auto-Encoders 111 Introduction 111 Auto-Encoders for Dimensionality Reduction 111 Getting a Good Start - Stacked Auto-Encoders, Restricted Boltzmann Machines, and Pretraining 115 Restricted Boltzmann Machines 115 Stacking Restricted Boltzmann Machines 118 Denoising Auto-Encoders 120 Variational Auto-Encoders 121 Sequence to Sequence Learning 125 The Attention Mechanism 126 Application in Chemistry: Building a Molecular Generator Summary 132 Real World Implementations 132 Papers to Read 132 8 8.1 8.2 8.3 Optimising Models Using Bayesian Optimisation Introduction 135 Defining Our Function 135 Grid and Random Search 136 135 127
Contents ix 8.4 8.5 8.6 8.6.1 8.7 8.8 8.8.1 8.8.2 8.8.3 8.8.3.1 8.8.3.2 8.8.4 8.8.4.1 8.8.4.2 8.8.5 8.8.6 8.8.7 8.8.8 8.8.9 8.8.10 8.8.11 8.8.11.1 8.8.11.2 8.8.11.3 8.8.11.4 8.8.11.5 8.9 8.10 Moving Towards an Intelligent Search 137 Exploration and Exploitation 137 Greedy Search 138 Key Fact One - Exploitation Heavy Search is Susceptible to Initial Data Bias 139 Diversity Search 141 Bayesian Optimisation 142 Domain Knowledge (or Prior) 142 Gaussian Processes 145 Kernels 146 Stationary Kernels 146 Noise Kernel 147 Combining Gaussian Process Prediction and Optimisation 149 Probability of Improvement 149 Expected Improvement 150 Balancing Exploration and Exploitation 151 Upper and Lower Confidence Bound Algorithm 151 Maximum Entropy Sampling 152 Optimising the Acquisition Function 153 Cost Sensitive Bayesian Optimisation 155 Constrained Bayesian Optimisation 158 Parallel Bayesian Optimisation 158 qEI 158 Constant Liar and Kriging Believer 160 Local Penalisation 162 Parallel Thompson Sampling 162 К-Means Batch Bayesian Optimisation 162 Summary 163 Papers to Read 163 Case Study 1 Solubility Prediction Case Study 167 CS 1.1 Step 1 - Import Packages 167 CS 1.2 Step 2 - Importing the Data 168 CS 1.3 Step 3 - Creating the Inputs 168 CS 1.4 Step 4 - Splitting into Training and Testing 168 CS 1.5 Step 5 - Defining Our Model 169 CS 1.6 Step 6 - Running Our Model 169 CS 1.7 Step 7 - Automatically Finding an Optimised Architecture Using Bayesian Optimisation 170
x Contents Case Study 2 Time Series Forecasting with LSTMs CS 2.1 Simple LSTM 173 CS 2.2 Sequence-to-Sequence LSTM 177 Case Study 3 Index 173 Deep Embeddings for Auto-Encoder-Based Featurisation 185 190
|
| any_adam_object | 1 |
| author | Pyzer-Knapp, Edward O. Benatan, Matthew |
| author_GND | (DE-588)1225701597 (DE-588)1245015052 |
| author_facet | Pyzer-Knapp, Edward O. Benatan, Matthew |
| author_role | aut aut |
| author_sort | Pyzer-Knapp, Edward O. |
| author_variant | e o p k eop eopk m b mb |
| building | Verbundindex |
| bvnumber | BV046220022 |
| classification_rvk | ST 301 |
| ctrlnum | (OCoLC)1298744407 (DE-599)KXP1679744801 |
| discipline | Informatik |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>02012nam a22004098c 4500</leader><controlfield tag="001">BV046220022</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20220727 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">191029s2022 a||| |||| 00||| eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9781119408338</subfield><subfield code="9">978-1-119-40833-8</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)1298744407</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)KXP1679744801</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rda</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-739</subfield><subfield code="a">DE-92</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">ST 301</subfield><subfield code="0">(DE-625)143651:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Pyzer-Knapp, Edward O.</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1225701597</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Deep learning for physical scientists</subfield><subfield code="b">accelerating research with machine learning</subfield><subfield code="c">Edward O. Pyzer-Knapp, Matthew Benatan</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Chichester</subfield><subfield code="b">Wiley</subfield><subfield code="c">2022</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">xii, 196 Seiten</subfield><subfield code="b">Illustrationen, Diagramme</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Maschinelles Lernen</subfield><subfield code="0">(DE-588)4193754-5</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Deep learning</subfield><subfield code="0">(DE-588)1135597375</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Künstliche Intelligenz</subfield><subfield code="0">(DE-588)4033447-8</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Deep learning</subfield><subfield code="0">(DE-588)1135597375</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Maschinelles Lernen</subfield><subfield code="0">(DE-588)4193754-5</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="2"><subfield code="a">Künstliche Intelligenz</subfield><subfield code="0">(DE-588)4033447-8</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Benatan, Matthew</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1245015052</subfield><subfield code="4">aut</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Erscheint auch als</subfield><subfield code="n">Online-Ausgabe, PDF</subfield><subfield code="z">978-1-119-40832-1</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Erscheint auch als</subfield><subfield code="n">Online-Ausgabe, EPUB</subfield><subfield code="z">978-1-119-40835-2</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">SWB Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=031598707&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Buchcover</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">Digitalisierung UB Passau - ADAM Catalogue Enrichment</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=031598707&sequence=000002&line_number=0002&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-031598707</subfield></datafield></record></collection> |
| id | DE-604.BV046220022 |
| illustrated | Illustrated |
| indexdate | 2024-07-10T08:38:40Z |
| institution | BVB |
| isbn | 9781119408338 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-031598707 |
| oclc_num | 1298744407 |
| open_access_boolean | |
| owner | DE-739 DE-92 |
| owner_facet | DE-739 DE-92 |
| physical | xii, 196 Seiten Illustrationen, Diagramme |
| publishDate | 2022 |
| publishDateSearch | 2022 |
| publishDateSort | 2022 |
| publisher | Wiley |
| record_format | marc |
| spelling | Pyzer-Knapp, Edward O. Verfasser (DE-588)1225701597 aut Deep learning for physical scientists accelerating research with machine learning Edward O. Pyzer-Knapp, Matthew Benatan Chichester Wiley 2022 xii, 196 Seiten Illustrationen, Diagramme txt rdacontent n rdamedia nc rdacarrier Maschinelles Lernen (DE-588)4193754-5 gnd rswk-swf Deep learning (DE-588)1135597375 gnd rswk-swf Künstliche Intelligenz (DE-588)4033447-8 gnd rswk-swf Deep learning (DE-588)1135597375 s Maschinelles Lernen (DE-588)4193754-5 s Künstliche Intelligenz (DE-588)4033447-8 s DE-604 Benatan, Matthew Verfasser (DE-588)1245015052 aut Erscheint auch als Online-Ausgabe, PDF 978-1-119-40832-1 Erscheint auch als Online-Ausgabe, EPUB 978-1-119-40835-2 SWB Datenaustausch application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=031598707&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Buchcover Digitalisierung UB Passau - ADAM Catalogue Enrichment application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=031598707&sequence=000002&line_number=0002&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Pyzer-Knapp, Edward O. Benatan, Matthew Deep learning for physical scientists accelerating research with machine learning Maschinelles Lernen (DE-588)4193754-5 gnd Deep learning (DE-588)1135597375 gnd Künstliche Intelligenz (DE-588)4033447-8 gnd |
| subject_GND | (DE-588)4193754-5 (DE-588)1135597375 (DE-588)4033447-8 |
| title | Deep learning for physical scientists accelerating research with machine learning |
| title_auth | Deep learning for physical scientists accelerating research with machine learning |
| title_exact_search | Deep learning for physical scientists accelerating research with machine learning |
| title_full | Deep learning for physical scientists accelerating research with machine learning Edward O. Pyzer-Knapp, Matthew Benatan |
| title_fullStr | Deep learning for physical scientists accelerating research with machine learning Edward O. Pyzer-Knapp, Matthew Benatan |
| title_full_unstemmed | Deep learning for physical scientists accelerating research with machine learning Edward O. Pyzer-Knapp, Matthew Benatan |
| title_short | Deep learning for physical scientists |
| title_sort | deep learning for physical scientists accelerating research with machine learning |
| title_sub | accelerating research with machine learning |
| topic | Maschinelles Lernen (DE-588)4193754-5 gnd Deep learning (DE-588)1135597375 gnd Künstliche Intelligenz (DE-588)4033447-8 gnd |
| topic_facet | Maschinelles Lernen Deep learning Künstliche Intelligenz |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=031598707&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=031598707&sequence=000002&line_number=0002&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT pyzerknappedwardo deeplearningforphysicalscientistsacceleratingresearchwithmachinelearning AT benatanmatthew deeplearningforphysicalscientistsacceleratingresearchwithmachinelearning |