meta data for this page
  •  

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
vm:proxmox:ceph:performance_monitoring [2021/01/28 20:44] niziakvm:proxmox:ceph:performance_monitoring [2021/04/08 11:44] (current) niziak
Line 2: Line 2:
  
 ===== basic info ===== ===== basic info =====
 +
 +==== ceph ====
 +
 <code bash> <code bash>
 ceph -s ceph -s
 ceph -w ceph -w
 ceph df ceph df
 +ceph osd tree
 ceph osd df tree ceph osd df tree
 </code> </code>
 +
 +==== rados ====
  
 <code> <code>
 rados df rados df
 +</code>
 +Where:
 +  * **USED COMPR**: amount of space allocated for compressed data (i.e. this includes comrpessed data plus all the allocation, replication and erasure coding overhead).
 +  * **UNDER COMPR**: amount of data passed through compression (summed over all replicas) and beneficial enough to be stored in a compressed form.
 +
 +==== RBD Rados Block Device ====
 +<code>
 +rbd ls
 +rbd du
 </code> </code>
 ==== perf ==== ==== perf ====
Line 29: Line 44:
  
 ==== rados benchmark ==== ==== rados benchmark ====
 +Hints from [[https://yourcmc.ru/wiki/Ceph_performance#Test_your_Ceph_cluster]]:
 +  * Don't use `rados bench`. It creates a small number of objects (1-2 for a thread) so all of them always reside in cache and improve the results far beyond they should be.
 +  * You can use `rbd bench`, but fio is better.
 +
 <code bash> <code bash>
 ceph osd pool create test ceph osd pool create test
Line 35: Line 54:
 rados -p test bench -t 4 10 seq rados -p test bench -t 4 10 seq
 rados -p test bench 10 rand rados -p test bench 10 rand
 +
 +rados bench -p test 60 write -b 4M -t 16 --no-cleanup
 +rados bench -p test 60 seq -t 16
 +rados bench -p test 60 rand -t 16
 +
 rados -p test cleanup rados -p test cleanup
 </code> </code>
 +
 +
  
 ==== rbd benchmark ==== ==== rbd benchmark ====
  
-https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/1.3/html/administration_guide/benchmarking_performance#block_device+[[https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/1.3/html/administration_guide/benchmarking_performance#block_device|Chapter 9. Benchmarking Performance]] 
 + 
 +<code bash> 
 +# Image 1G: 
 +rbd create test/myimage --size 1024 
 + 
 +#TBD ...  
 +#rbd device map test/myimage --cluster  
 +#rbd device unmap /dev/rbdX 
 + 
 +rbd rm test/myimage 
 +</code>