meta data for this page
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
vm:proxmox:ceph:performance_monitoring [2021/01/28 20:44] – niziak | vm:proxmox:ceph:performance_monitoring [2021/04/08 11:44] (current) – niziak | ||
---|---|---|---|
Line 2: | Line 2: | ||
===== basic info ===== | ===== basic info ===== | ||
+ | |||
+ | ==== ceph ==== | ||
+ | |||
<code bash> | <code bash> | ||
ceph -s | ceph -s | ||
ceph -w | ceph -w | ||
ceph df | ceph df | ||
+ | ceph osd tree | ||
ceph osd df tree | ceph osd df tree | ||
</ | </ | ||
+ | |||
+ | ==== rados ==== | ||
< | < | ||
rados df | rados df | ||
+ | </ | ||
+ | Where: | ||
+ | * **USED COMPR**: amount of space allocated for compressed data (i.e. this includes comrpessed data plus all the allocation, replication and erasure coding overhead). | ||
+ | * **UNDER COMPR**: amount of data passed through compression (summed over all replicas) and beneficial enough to be stored in a compressed form. | ||
+ | |||
+ | ==== RBD Rados Block Device ==== | ||
+ | < | ||
+ | rbd ls | ||
+ | rbd du | ||
</ | </ | ||
==== perf ==== | ==== perf ==== | ||
Line 29: | Line 44: | ||
==== rados benchmark ==== | ==== rados benchmark ==== | ||
+ | Hints from [[https:// | ||
+ | * Don't use `rados bench`. It creates a small number of objects (1-2 for a thread) so all of them always reside in cache and improve the results far beyond they should be. | ||
+ | * You can use `rbd bench`, but fio is better. | ||
+ | |||
<code bash> | <code bash> | ||
ceph osd pool create test | ceph osd pool create test | ||
Line 35: | Line 54: | ||
rados -p test bench -t 4 10 seq | rados -p test bench -t 4 10 seq | ||
rados -p test bench 10 rand | rados -p test bench 10 rand | ||
+ | |||
+ | rados bench -p test 60 write -b 4M -t 16 --no-cleanup | ||
+ | rados bench -p test 60 seq -t 16 | ||
+ | rados bench -p test 60 rand -t 16 | ||
+ | |||
rados -p test cleanup | rados -p test cleanup | ||
</ | </ | ||
+ | |||
+ | |||
==== rbd benchmark ==== | ==== rbd benchmark ==== | ||
- | https:// | + | [[https:// |
+ | |||
+ | <code bash> | ||
+ | # Image 1G: | ||
+ | rbd create test/ | ||
+ | |||
+ | #TBD ... | ||
+ | #rbd device map test/ | ||
+ | #rbd device unmap /dev/rbdX | ||
+ | |||
+ | rbd rm test/ | ||
+ | </ | ||