Host:
OS: Ubuntu 16.04
Disable apparmor
$ /etc/init.d/apparmor stop $ /etc/init.d/apparmor teardown $ update-rc.d -f apparmor remove
Isolate 2 cores from the OS by modifying: /etc/default/grub
GRUB_CMDLINE_LINUX_DEFAULT="text isolcpus=10,11"
Update grub:
$ sudo update-grub
Reboot
Install barometer build-essentials:
$ git clone https://gerrit.opnfv.org/gerrit/barometer $ ./src/install_build_deps.sh
Install virtualization packages and other required packages:
$ sudo apt install qemu-kvm libvirt-bin virtinst virt-manager screen
Add the user to the libvirtd group:
sudo adduser $USER libvirtd
Create a dir to store ISOs
$ sudo mkdir /usr/local/src/images/ $ cd /usr/local/src/images/ $ sudo -E wget http://releases.ubuntu.com/16.04/ubuntu-16.04.2-server-i386.iso
Ceate a Test VM
$ sudo virt-install -n test -r 256 --disk path=/var/lib/libvirt/images/test.img,bus=virtio,size=4 -c /usr/local/src/images/ubuntu-16.04.2-server-i386.iso --network network=default,model=virtio --graphics vnc,listen=0.0.0.0 --noautoconsole -v
Connect to the console to complete the installation process.
Clone the latest libvirt code, build and install collectd:
$ git clone https://github.com/maryamtahhan/collectd.git mt_collectd $ cd mt_collectd $ ./build.sh $ ./configure
Check that the virt plugin is configured:
virt . . . . . . . . yes
Install collectd:
$ sudo make -j install
Install collectd as a service:
sudo mv systemd.collectd.service collectd.service sudo chmod +x collectd.service vi collectd.service
Edit the collectd.service script
[Service]#ExecStart=/usr/sbin/collectd ExecStart=/opt/collectd/sbin/collectd -C /opt/collectd/etc/collectd.conf #EnvironmentFile=-/etc/sysconfig/collectd #EnvironmentFile=-/etc/default/collectd ProtectSystem=full ProtectHome=true
Modify the /opt/collectd/etc/collectd.conf file
<LoadPlugin cpu>
Interval 1
</LoadPlugin>
<LoadPlugin virt>
Interval 1
</LoadPlugin>
LoadPlugin csv
LoadPlugin network
<Plugin cpu>
ReportByCpu true
ReportByState false
ValuesPercentage true
</Plugin>
<Plugin csv>
DataDir "/tmp/collectd/csv"
# StoreRates false
</Plugin>
<Plugin network>
# server setup:
Listen "<host ip address>" "28597"
<Listen "<host ip address>" "28597">
</Listen>
</Plugin>
<Plugin virt>
Connection "qemu:///system"
# RefreshInterval 60
# Domain "name"
# BlockDevice "name:device"
# BlockDeviceFormat target
# BlockDeviceFormatBasename false
# InterfaceDevice "name:device"
# IgnoreSelected false
HostnameFormat uuid
# InterfaceFormat name
# PluginInstanceFormat name
Instances 1
ExtraStats "disk pcpu"
</Plugin>
Core 10 and 11 were isolated from the OS using the isolcpus argument to grub command line and using virsh to Pin the vCPUs to those cores (Requires KVM acceleration):
$ virsh vcpupin test 0 10 $ virsh vcpupin test 1 11
To check for KVM acceleration see that the response to the command below is > 0:
$ cat /proc/cpuinfo | egrep -c '(vmx|svm)'
without KVM acceleration you will need to taskset the qemu threads to the isolated cores:
$ grep pid /var/run/libvirt/qemu/test.xml <domstatus state='running' pid='4907'> $ grep Cpus_allowed_list /proc/4907/task/*/status /proc/4907/task/4916/status:Cpus_allowed_list: 4 /proc/4907/task/4917/status:Cpus_allowed_list: 5 /proc/4907/task/4918/status:Cpus_allowed_list: 6 /proc/4907/task/4919/status:Cpus_allowed_list: 7 </section>
To taskset the process + tasks repeat the following for the PID and the subtasks:
$ taskset -pc 4 4907...
Guest
OS: Ubuntu 16.04.2 LTS
Install collectd and stress
$ sudo apt install collectd stress stress-ng
configure /etc/collectd/collectd.conf
Hostname "ubuntu_vm"
<LoadPlugin cpu>
Interval 1
</LoadPlugin>
LoadPlugin network
<Plugin cpu>
ReportByCpu true
ReportByState false
ValuesPercentage false
</Plugin>
<Plugin network>
# # client setup:
Server "<HOST IP>" "28597"
<Server "<HOST IP>" "28597">
</Server>
</Plugin>
Start collectd on the host and the guest
$ service collectd start
Run Stress in the VM on a single core
$ taskset 1 stress -c 2 -t 10 stress: info: [1422] dispatching hogs: 2 cpu, 0 io, 0 vm, 0 hdd stress: info: [1422] successful run completed in 10s
1 Comment
Al Morton
Thanks for adding this background page on configuration!