1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
|
===========================================
Getting started with Openstack and OVS-DPDK
===========================================
This getting started guide describes the setup of Openstack with OVS-DPDK
in a dual node configuration.
Some command line examples are provided to match the described topology,
tailor these to suit your environment.
Requirements
------------
This getting started is executed with the following hardware and software.
Hardware
========
- 2 * Intel grizzly pass server boards
- CPU: 2 * Intel Xeon CPU E5-2680 v2 @ 2.80GHz
- RAM: Minimum 16GB, recommened 64GB
- 2 * physical networks
Software
========
- Fedora 21 server
- Kernel version 3.19.7-200.fc21.x86_64
Pre-requisites
==============
- Fedora 21 server fresh installation
- A non root user
- VT-d enabled in BIOS
- VT-x enabled in BIOS
- Access to the internet
- NTP is running and synchronised on both nodes
- Topology as detailed below
Topology
========
::
Controller Compute
+---------------+ +---------------+
| |-+ API network +-| +----+ |
| | |---------------| | | VM | |
| |-+ +-| +----+ |
| | | | |
| +----------+ | | +-----------+ |
| | OVS DPDK | | | | OVS DPDK | |
| +----------+ | | +-----------+ |
+-----+---+-----+ +-----+---+-----+
+---+ +---+
| |
+-----------------------------------+
Data network
Linux configuration
-------------------
Add user to sudoers file
========================
To elevate user privileges, add them to the suoders file, you will need admin
privileges for this.
| sudo cat /etc/sudoers
| <USER> ALL=(ALL) NOPASSWD: ALL
Relax SELINUX control
=====================
| sudo cat /etc/selinux/config
| SELINUX=permissive
Downgrade kernel
================
DPDK currently supports kernel versions up to 3.19. This guide details
downgrading the kernel to version version 3.19.7-200.fc21.x86_64.
Download and install required kernel packages
| sudo yum install -y https://kojipkgs.fedoraproject.org//packages/kernel/3.19.7/200.fc21/x86_64/kernel-core-3.19.7-200.fc21.x86_64.rpm
| sudo yum install -y https://kojipkgs.fedoraproject.org//packages/kernel/3.19.7/200.fc21/x86_64/kernel-modules-3.19.7-200.fc21.x86_64.rpm
| sudo yum install -y https://kojipkgs.fedoraproject.org//packages/kernel/3.19.7/200.fc21/x86_64/kernel-3.19.7-200.fc21.x86_64.rpm
| sudo yum install -y https://kojipkgs.fedoraproject.org//packages/kernel/3.19.7/200.fc21/x86_64/kernel-modules-extra-3.19.7-200.fc21.x86_64.rpm
| sudo yum install -y https://kojipkgs.fedoraproject.org//packages/kernel/3.19.7/200.fc21/x86_64/kernel-headers-3.19.7-200.fc21.x86_64.rpm
| sudo yum install -y https://kojipkgs.fedoraproject.org//packages/kernel/3.19.7/200.fc21/x86_64/kernel-devel-3.19.7-200.fc21.x86_64.rpm
Modify grub to boot into the required kernel version and reboot.
Internal proxy config
=====================
If you are working behind a proxy, you will need complete the following steps
to provide git and yum with access to the outside world.
Configure yum proxy:
| cat /etc/yum.conf
| proxy=http://<PROXY>:<PROXY PORT NUMBER>
Here is a sample script to provide git access through a proxy.
| sudo cat ~/git-proxy-wrapper
| #!/bin/sh
| _proxy=<PROXY>
| _proxyport=<PROXY PORT NUMBER>
| exec socat STDIO SOCKS4:$_proxy:$1:$2,socksport=$_proxyport
| sudo chown <USER>:<USER> /home/<USER>/git-proxy-wrapper
| sudo chmod +x /home/<USER>/git-proxy-wrapper
Add proxy variables and export to shell:
| cat ~/.bashrc
| export GIT_PROXY_COMMAND=~/git-proxy-wrapper
| export http_proxy=http://<PROXY>:<PROXY PORT NUMBER>
| export HTTP_PROXY=http://<PROXY>:<PROXY PORT NUMBER>
| export https_proxy=https://<PROXY>:<PROXY PORT NUMBER>
| export HTTPS_PROXY=https://<PROXY>:<PROXY PORT NUMBER>
| export NO_PROXY=localhost,127.0.0.1,127.0.1.1,<IP OF CONTROLLER NODE>,<IP OF COMPUTE NODE>
| export no_proxy=localhost,127.0.0.1,127.0.1.1,<IP OF CONTROLLER NODE>,<IP OF COMPUTE NODE>
Export these variables
| source ~/.bashrc
Install required packages
-------------------------
Devstack will pull down the required packages, but for the initial clone we need
git and socat.
| sudo yum install -y git socat
Libvirt configuration
---------------------
Some libvirt configurations are required for DPDK support, but first we need
to install libvirt.
| sudo yum install -y libvirt
Modify your libvirt config file to include the following:
| sudo cat /etc/libvirt/qemu.conf
| cgroup_controllers = [ "cpu", "devices", "memory", "blkio", "cpuset", "cpuacct" ]
| cgroup_device_acl = [
| "/dev/null", "/dev/full", "/dev/zero",
| "/dev/random", "/dev/urandom",
| "/dev/ptmx", "/dev/kvm", "/dev/kqemu",
| "/dev/rtc", "/dev/hpet","/dev/net/tun",
| "/mnt/huge", "/dev/vhost-net","/dev/vfio/vfio"
| ]
| hugetlbfs_mount = "/mnt/huge"
Restart libvirtd
| sudo service libvirtd restart
Devstack configuration
----------------------
Clone the devstack repo.
| cd ~
| git clone https://github.com/openstack-dev/devstack.git
When you have cloned devstack, the next step is to configure you controller
and compute nodes.
Here are some local.conf examples based on the topology described above.
Controller node config example
.. include:: _downloads/local.conf.controller_node
:literal:
Compute node config example
.. include:: _downloads/local.conf.compute_node
:literal:
Add the local.conf file to /home/<USER>/devstack directory and stack.
| cd ~/devstack
| ./stack.sh
Boot a VM with OVS-DPDK
-----------------------
OVS-DPDK uses hugepages to communicate with guests, before you boot a VM with
OVS-DPDK you will need to create a flavor that requests hugepages.
| cd /home/<USER>/devstack
| source openrc admin demo
| nova flavor-key <FLAVOR> set hw:mem_page_size=large
|
