Mastering Ceph:
Gespeichert in:
| 1. Verfasser: | |
|---|---|
| Format: | Elektronisch E-Book |
| Sprache: | English |
| Veröffentlicht: |
Birmingham
Packt Publishing
2017
|
| Ausgabe: | 1st ed |
| Schlagworte: | |
| Online-Zugang: | Inhaltsverzeichnis |
| Beschreibung: | Description based on publisher supplied metadata and other sources |
| Beschreibung: | 1 online resource (229 pages) |
| ISBN: | 9781785881282 |
Internformat
MARC
| LEADER | 00000nmm a2200000zc 4500 | ||
|---|---|---|---|
| 001 | BV044614991 | ||
| 003 | DE-604 | ||
| 005 | 00000000000000.0 | ||
| 007 | cr|uuu---uuuuu | ||
| 008 | 171108s2017 |||| o||u| ||||||eng d | ||
| 020 | |a 9781785881282 |9 978-1-78588-128-2 | ||
| 035 | |a (ZDB-30-PQE)EBC4868550 | ||
| 035 | |a (ZDB-89-EBL)EBL4868550 | ||
| 035 | |a (ZDB-38-EBR)ebr11391770 | ||
| 035 | |a (OCoLC)989718604 | ||
| 035 | |a (DE-599)BVBBV044614991 | ||
| 040 | |a DE-604 |b ger |e rda | ||
| 041 | 0 | |a eng | |
| 082 | 0 | |a 4.3600000000000003 | |
| 100 | 1 | |a Fisk, Nick |e Verfasser |4 aut | |
| 245 | 1 | 0 | |a Mastering Ceph |
| 250 | |a 1st ed | ||
| 264 | 1 | |a Birmingham |b Packt Publishing |c 2017 | |
| 264 | 4 | |c © 2017 | |
| 300 | |a 1 online resource (229 pages) | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b c |2 rdamedia | ||
| 338 | |b cr |2 rdacarrier | ||
| 500 | |a Description based on publisher supplied metadata and other sources | ||
| 650 | 4 | |a Big data | |
| 776 | 0 | 8 | |i Erscheint auch als |n Druck-Ausgabe |a Fisk, Nick |t Mastering Ceph |d Birmingham : Packt Publishing,c2017 |
| 856 | 4 | 2 | |m HBZ Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=030013335&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 912 | |a ZDB-30-PQE | ||
| 999 | |a oai:aleph.bib-bvb.de:BVB01-030013335 | ||
Datensatz im Suchindex
| _version_ | 1804178014525718528 |
|---|---|
| adam_text | Titel: Mastering Ceph
Autor: Fisk, Nick
Jahr: 2017
Table of Contents
Preface . i
Chapter 1: Planning for Ceph 9
What is Ceph? g
How Ceph works? 10
Ceph use cases 11
Replacing your storage array with Ceph 11
Performance 11
Reliability 12
The use of commodity hardware 12
Specific use cases 12
OpenStack- or KVM-based virtualization 13
Large bulk block storage 13
Object storage 13
Object storage with custom application 14
Distributed filesystem - web farm 14
Distributed filesystem - SMB file server replacement 14
Infrastructure design 14
SSDs 14
Consumer 15
Prosumer 15
Enterprise SSDs 16
Enterprise - read intensive 16
Enterprise - general usage 16
Enterprise - write intensive 17
Memory 17
CPU 18
Disks 20
Networking 21
10G networking requirement 21
Network design 22
OSD node sizes 24
Failure domains 24
Price 25
Power supplies 26
How to plan a successful Ceph implementation 26
Understanding your requirements and how it relates to Ceph 26
Defining goals so that you can gauge if the project is a success 27
Choosing your hardware 27
Training yourself and your team to use Ceph 28
Running PoC to determine if Ceph has met the requirements 28
Following best practices to deploy your cluster 29
Defining a change management process 29
Creating a backup and recovery plan 30
Summary 30
Chapter 2: Deploying Ceph : 31
Preparing your environment with Vagrant and VirtualBox 32
System requirements 32
Obtaining and installing VirtualBox 33
Setting up Vagrant 34
The ceph-deploy tool 38
Orchestration 38
Ansible 39
Installing Ansible 40
Creating your inventory file 41
Variables 43
Testing 44
A very simple playbook 44
Adding the Ceph Ansible modules 46
Deploying a test cluster with Ansible 48
Change and configuration management 51
Summary 51
Chapter 3: BlueStore 53
What is BlueStore? 63
Why was it needed? 54
Ceph s requirements ^
Filestore limitations
Why is BlueStore the solution? 56
How BlueStore works 57
RocksDB 67
Deferred writes 58
BlueFS 58
How to use BlueStore 58
Upgrading an OSD in your test cluster 59
Summary 61
Chapter 4: Erasure Coding for Better Storage Efficiency 63
What is erasure coding? 64
K+M 64
How does erasure coding work in Ceph? 65
Algorithms and profiles 67
Jerasure 67
ISA 67
LRC 67
SHEC 68
Where can I use erasure coding? 68
Creating an erasure-coded pool 69
Overwrites on erasure code pools with Kraken 72
Demonstration 73
Troubleshooting the 2147483647 error 75
Reproducing the problem 76
Summary 78
Chapter 5: Developing with Librados ¦ 79
What is librados? 79
How to use librados? 80
Example librados application 83
Example of the librados application with atomic operations 88
Example of the librados application that uses watchers and notifiers 91
Summary 95
Chapter 6: Distributed Computation with Ceph RADOS Classes 97
Example applications and the benefits of using RADOS classes 97
Writing a simple RADOS class in Lua 98
Writing a RADOS class that simulates distributed computing 100
Preparing the build environment 100
RADOS class 102
Client librados applications 104
Calculating MD5 on the client 104
Calculating MD5 on the OSD via RADOS class 106
Testing 108
RADOS class caveats 110
Summary 111
Chapter 7: Monitoring Ceph 113
Why it is important to monitor Ceph 113
What should be monitored 114
Ceph health 114
Operating system and hardware 114
Smart stats 115
Network 115
Performance counters 115
PG states - the good, the bad, and the ugly 116
The good iir
The active state
The clean state ^
Scrubbing and deep scrubbing 11°
The bad 116
The inconsistent state 117
The backfilling, backfilljwait, recovering, recovery_wait states 117
The degraded state 117
Remapped H7
The ugly 117
The incomplete state 117
The down state 118
The backfill_toofull state 118
Monitoring Ceph with collectd 118
Graphite 118
Grafana 121
collectd 123
Deploying collectd with Ansible 127
Sample Graphite queries for Ceph 129
Number of Up and In OSDs 130
Showing most deviant OSD usage 130
Total number of lOPs across all OSDs 130
Total MBps across all OSDs 130
Cluster capacity and usage 131
Average latency 131
Custom Ceph collectd plugins 131
Summary 133
Chapter 8: Tiering with Ceph 135
Tiering versus caching 135
How Cephs tiering functionality works 136
What is a bloom filter 137
Tiering modes 137
Writeback 137
Forward 138
Read-forward 138
Proxy 138
Read-proxy 138
Uses cases 138
Creating tiers in Ceph 139
Tuning tiering 142
Flushing and eviction 142
Promotions 145
Promotion throttling 146
Monitoring parameters 147
Tiering with erasure-coded pools 148
Alternative caching mechanisms 149
Summary 150
Chapter 9: Tuning Ceph 151^
Latency 152
Benchmarking 154
Benchmarking tools 155
Fio 155
Sysbench 155
Ping 155
iPerf 155
Network benchmarking 155
Disk benchmarking 157
RADOS benchmarking 159
RBD benchmarking 160
Recommended tunings 161
CPU 161
Filestore 164
VFS cache pressure 164
WBThrottle and/or nr_requests 165
Filestore queue throttling 166
filestore_queue_low_threshhold 166
filestore_queue_high_threshhold 166
filestore_expected_throughput_ops 166
filestore_queue_high_delay_mu!tiple 167
filestore_queue_max_delay_multiple 167
PG Splitting 167
Scrubbing 168
OP priorities 169
The Network 169
General system tuning 170
Kernel RBD 170
Queue Depth 171
ReadAhead 171
PG distributions
Summary
Chapter 10: Troubleshooting
Extremely slow performance or no IO
172
173
175
Repairing inconsistent objects
Full OSDs
Ceph logging
Slow performance
Causes
Increased client workload
Down OSDs
Recovery and backfilling
Scrubbing
Snaptrimming 182
i 1. : 182
176
179
180
181
181
181
181
182
182
Hardware or driver issues
Monitoring 183
iostat
htop
atop
Diagnostics 184
183
183
184
186
Flapping OSDs 186
Jumbo frames 186
Failing disks 186
Slow OSDs 187
Investigating PGs in a down state 187
Large monitor databases 188
Summary 189
Chapter 11: Disaster Recovery -
What is a disaster? 192
Avoiding data loss 192
What can cause an outage or data loss? 192
RBD mirroring 193
The journal 194
The rbd-mirror daemon 194
Configuring RBD mirroring 194
Performing RBD failover 199
RBD recovery 201
Lost objects and inactive PGs 204
Recovering from a complete monitor failure 208
Using the Cephs object store tool 211
Investigating asserts 215
Example assert 216
Summary 217
Index ^
[ vii ]
|
| any_adam_object | 1 |
| author | Fisk, Nick |
| author_facet | Fisk, Nick |
| author_role | aut |
| author_sort | Fisk, Nick |
| author_variant | n f nf |
| building | Verbundindex |
| bvnumber | BV044614991 |
| collection | ZDB-30-PQE |
| ctrlnum | (ZDB-30-PQE)EBC4868550 (ZDB-89-EBL)EBL4868550 (ZDB-38-EBR)ebr11391770 (OCoLC)989718604 (DE-599)BVBBV044614991 |
| dewey-full | 4.3600000000000003 |
| dewey-hundreds | 000 - Computer science, information, general works |
| dewey-ones | 004 - Computer science |
| dewey-raw | 4.3600000000000003 |
| dewey-search | 4.3600000000000003 |
| dewey-sort | 14.3600000000000003 |
| dewey-tens | 000 - Computer science, information, general works |
| edition | 1st ed |
| format | Electronic eBook |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01362nmm a2200373zc 4500</leader><controlfield tag="001">BV044614991</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">00000000000000.0</controlfield><controlfield tag="007">cr|uuu---uuuuu</controlfield><controlfield tag="008">171108s2017 |||| o||u| ||||||eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9781785881282</subfield><subfield code="9">978-1-78588-128-2</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(ZDB-30-PQE)EBC4868550</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(ZDB-89-EBL)EBL4868550</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(ZDB-38-EBR)ebr11391770</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)989718604</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV044614991</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rda</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">4.3600000000000003</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Fisk, Nick</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Mastering Ceph</subfield></datafield><datafield tag="250" ind1=" " ind2=" "><subfield code="a">1st ed</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Birmingham</subfield><subfield code="b">Packt Publishing</subfield><subfield code="c">2017</subfield></datafield><datafield tag="264" ind1=" " ind2="4"><subfield code="c">© 2017</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">1 online resource (229 pages)</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">c</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">cr</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">Description based on publisher supplied metadata and other sources</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Big data</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Erscheint auch als</subfield><subfield code="n">Druck-Ausgabe</subfield><subfield code="a">Fisk, Nick</subfield><subfield code="t">Mastering Ceph</subfield><subfield code="d">Birmingham : Packt Publishing,c2017</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">HBZ Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=030013335&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">ZDB-30-PQE</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-030013335</subfield></datafield></record></collection> |
| id | DE-604.BV044614991 |
| illustrated | Not Illustrated |
| indexdate | 2024-07-10T07:57:14Z |
| institution | BVB |
| isbn | 9781785881282 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-030013335 |
| oclc_num | 989718604 |
| open_access_boolean | |
| physical | 1 online resource (229 pages) |
| psigel | ZDB-30-PQE |
| publishDate | 2017 |
| publishDateSearch | 2017 |
| publishDateSort | 2017 |
| publisher | Packt Publishing |
| record_format | marc |
| spelling | Fisk, Nick Verfasser aut Mastering Ceph 1st ed Birmingham Packt Publishing 2017 © 2017 1 online resource (229 pages) txt rdacontent c rdamedia cr rdacarrier Description based on publisher supplied metadata and other sources Big data Erscheint auch als Druck-Ausgabe Fisk, Nick Mastering Ceph Birmingham : Packt Publishing,c2017 HBZ Datenaustausch application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=030013335&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Fisk, Nick Mastering Ceph Big data |
| title | Mastering Ceph |
| title_auth | Mastering Ceph |
| title_exact_search | Mastering Ceph |
| title_full | Mastering Ceph |
| title_fullStr | Mastering Ceph |
| title_full_unstemmed | Mastering Ceph |
| title_short | Mastering Ceph |
| title_sort | mastering ceph |
| topic | Big data |
| topic_facet | Big data |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=030013335&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT fisknick masteringceph |