Benchmarking storage systems is a pretty interesting job and these days i am playing hard with it . Having said that object storage benchmarking is currently under my radar.
Block and file storage is there since ancient times and so as their benchmarking tools. Object storage is way too different and the traditional benchmarking tools don’t talk object. There are not very many tools out there for benchmarking object storage, the one which is getting popularity is COSBench aka Cloud Storage Benchmarking tool.
COSbench is developed and open sourced by Intel. It’s based on classic client / server model where client node aka COSBench Driver node ( COSBench client ) accepts the job from server aka COSBench controller node ( COSBench server) executes the job against storage system gathers the result and send them back to COSBench controller node. Here are some good to know things about COSBench
COSBench works on RHEL / Debian based machines ( for windows i don’t know )
Based on JAVA and OSGi framework
Yes you can run COSBench Controller and COSBench driver on a single node
Verify if COSBench Controller and driver daemons are listening
[[email protected] cos]$ netstat -plunt | grep -i java
(Not all processes could be identified, non-owned process info
will not be shown, you would have to be root to see it all.)
tcp 0 0 0.0.0.0:18088 0.0.0.0:* LISTEN 32473/java
tcp 0 0 0.0.0.0:18089 0.0.0.0:* LISTEN 32473/java
tcp 0 0 0.0.0.0:19088 0.0.0.0:* LISTEN 32627/java
tcp 0 0 0.0.0.0:19089 0.0.0.0:* LISTEN 32627/java
[[email protected] cos]$
Finally shoot a sample workload from CLI
$ sh cli.sh submit conf/workload-config.xml
For COSBench Controller UI navigate to
For COSBench Driver UI navigate to
Sample COSBench workload
The workload is injected in the form of XML files , you can either create workload file from GUI or manually create a XML file and submit your job. Here is the example of a COSBench workload file
For more details on COSBench checkout the official documentation @GitHUb
COSBench seems to be a powerful and much needed tool for Object Storage benchmarking. It’s trying to establish itself as a standard tool for this purpose.
Well Standards are usually good unless government makes them ;-P