meta data for this page
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| vm:proxmox:ceph:performance_monitoring [2021/01/28 21:13] – niziak | vm:proxmox:ceph:performance_monitoring [2021/04/08 11:44] (current) – niziak | ||
|---|---|---|---|
| Line 2: | Line 2: | ||
| ===== basic info ===== | ===== basic info ===== | ||
| + | |||
| + | ==== ceph ==== | ||
| + | |||
| <code bash> | <code bash> | ||
| ceph -s | ceph -s | ||
| ceph -w | ceph -w | ||
| ceph df | ceph df | ||
| + | ceph osd tree | ||
| ceph osd df tree | ceph osd df tree | ||
| </ | </ | ||
| + | |||
| + | ==== rados ==== | ||
| < | < | ||
| rados df | rados df | ||
| </ | </ | ||
| + | Where: | ||
| + | * **USED COMPR**: amount of space allocated for compressed data (i.e. this includes comrpessed data plus all the allocation, replication and erasure coding overhead). | ||
| + | * **UNDER COMPR**: amount of data passed through compression (summed over all replicas) and beneficial enough to be stored in a compressed form. | ||
| + | ==== RBD Rados Block Device ==== | ||
| < | < | ||
| rbd ls | rbd ls | ||
| Line 34: | Line 44: | ||
| ==== rados benchmark ==== | ==== rados benchmark ==== | ||
| + | Hints from [[https:// | ||
| + | * Don't use `rados bench`. It creates a small number of objects (1-2 for a thread) so all of them always reside in cache and improve the results far beyond they should be. | ||
| + | * You can use `rbd bench`, but fio is better. | ||
| + | |||
| <code bash> | <code bash> | ||
| ceph osd pool create test | ceph osd pool create test | ||
| Line 40: | Line 54: | ||
| rados -p test bench -t 4 10 seq | rados -p test bench -t 4 10 seq | ||
| rados -p test bench 10 rand | rados -p test bench 10 rand | ||
| + | |||
| + | rados bench -p test 60 write -b 4M -t 16 --no-cleanup | ||
| + | rados bench -p test 60 seq -t 16 | ||
| + | rados bench -p test 60 rand -t 16 | ||
| + | |||
| rados -p test cleanup | rados -p test cleanup | ||
| </ | </ | ||
| + | |||
| + | |||
| ==== rbd benchmark ==== | ==== rbd benchmark ==== | ||
| - | https:// | + | [[https:// |
| + | |||
| + | <code bash> | ||
| + | # Image 1G: | ||
| + | rbd create test/ | ||
| + | |||
| + | #TBD ... | ||
| + | #rbd device map test/ | ||
| + | #rbd device unmap /dev/rbdX | ||
| + | |||
| + | rbd rm test/ | ||
| + | </ | ||