Feature Classification¶
This document presents a matrix that describes which features are ready to be used and which features are works in progress. It includes links to relevant documentation and functional tests.
Warning
Please note: this is a work in progress!
Aims¶
Users want reliable, long-term solutions for their use cases. The feature classification matrix identifies which features are complete and ready to use, and which should be used with caution.
The matrix also benefits developers by providing a list of features that require further work to be considered complete.
Below is a matrix for a selection of important verticals:
For more details on the concepts in each matrix, please see Notes on Concepts.
General Purpose Cloud Features¶
This is a summary of the key features dev/test clouds, and other similar general purpose clouds need, and it describes their current state.
Below there are sections on NFV and HPC specific features. These look at specific features and scenarios that are important to those more specific sets of use cases.
Summary
Feature | Maturity | Hyper-V CI | Ironic CI | libvirt+kvm (x86 & ppc64) | libvirt+kvm (s390x) | libvirt+virtuozzo CT | libvirt+virtuozzo VM | libvirt+xen | VMware CI | XenServer CI |
---|---|---|---|---|---|---|---|---|---|---|
Create Server and Delete Server | complete | ✔ |
? |
✔ |
? |
✔ |
✔ |
✔ |
✔ |
✔ |
Snapshot Server | complete | ? |
? |
✔ |
? |
✔ |
✔ |
✔ |
? |
✔ |
Server power ops | complete | ✔ |
? |
✔ |
? |
✔ |
✔ |
✔ |
✔ |
✔ |
Rebuild Server | complete | ✔ |
? |
✔ |
? |
✔ |
✔ |
✔ |
✔ |
✔ |
Resize Server | complete | ✔ |
? |
✔ |
? |
✔ |
✔ |
✔ |
✔ |
✔ |
Volume Operations | complete | ✔ |
✖ |
✔ |
? |
✔ |
✔ |
✔ |
✔ |
✔ |
Custom disk configurations on boot | complete | ✔ n |
✖ |
✔ |
? |
✖ |
✔ |
✔ |
✔ |
✔ |
Custom neutron configurations on boot | complete | ✔ |
✖ |
✔ |
? |
? |
? |
✔ |
✔ |
✔ |
Pause a Server | complete | ✔ |
✖ |
✔ |
? |
✖ |
✔ |
✔ |
✔ |
✔ |
Suspend a Server | complete | ✔ |
✖ |
✔ |
? |
✔ |
✔ |
✔ |
✔ |
✔ |
Server console output | complete | ✔ |
✖ |
✔ |
? |
? |
? |
✔ |
✔ |
✔ |
Server Rescue | complete | ✔ |
✖ |
✔ |
? |
✔ |
✔ |
✔ |
✔ |
✔ |
Server Config Drive | complete | ✔ |
✔ |
✔ |
? |
✖ |
✔ |
✔ |
✔ |
✔ |
Server Change Password | experimental | ✔ |
✖ |
✔ |
? |
✖ |
✖ |
✖ |
✖ |
✔ |
Server Shelve and Unshelve | complete | ✔ |
✖ |
✔ |
? |
✖ |
✔ |
✔ |
✖ |
✔ |
Details
- Create Server and Delete Server
This includes creating a server, and deleting a server. Specifically this is about booting a server from a glance image using the default disk and network configuration.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/#servers-servers
- Admin Docs: http://docs.openstack.org/admin-guide/compute-images-instances.html
- Tempest tests: 9a438d88-10c6-4bcd-8b5b-5b6e25e1346f, 585e934c-448e-43c4-acbf-d06a9b899997
drivers:
- Ironic CI:
unknown
- XenServer CI:
complete
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
partial
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
complete
- libvirt+virtuozzo CT:
partial
- VMware CI:
complete
- Maturity:
- Snapshot Server
This is creating a glance image from the currently running server.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/?expanded=#servers-run-an-action-servers-action
- Admin Docs: http://docs.openstack.org/admin-guide/compute-images-instances.html
- Tempest tests: aaacd1d0-55a2-4ce8-818a-b5439df8adc9
drivers:
- Ironic CI:
unknown
- XenServer CI:
complete
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
partial
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
unknown
- libvirt+virtuozzo CT:
partial
- VMware CI:
unknown
- Maturity:
- Server power ops
This includes reboot, shutdown and start.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/?expanded=#servers-run-an-action-servers-action
- Admin Docs:
- Tempest tests: 2cb1baf6-ac8d-4429-bf0d-ba8a0ba53e32, af8eafd4-38a7-4a4b-bdbc-75145a580560
drivers:
- Ironic CI:
unknown
- XenServer CI:
complete
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
partial
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
complete
- libvirt+virtuozzo CT:
partial
- VMware CI:
complete
- Maturity:
- Rebuild Server
You can rebuild a server, optionally specifying the glance image to use.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/?expanded=#servers-run-an-action-servers-action
- Admin Docs:
- Tempest tests: aaa6cdf3-55a7-461a-add9-1c8596b9a07c
drivers:
- Ironic CI:
unknown
- XenServer CI:
complete
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
partial
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
complete
- libvirt+virtuozzo CT:
partial
- VMware CI:
complete
- Maturity:
- Resize Server
You resize a server to a new flavor, then confirm or revert that operation.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/?expanded=#servers-run-an-action-servers-action
- Admin Docs:
- Tempest tests: 1499262a-9328-4eda-9068-db1ac57498d2
drivers:
- Ironic CI:
unknown
- XenServer CI:
complete
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
partial
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
complete
- libvirt+virtuozzo CT:
complete
- VMware CI:
complete
- Maturity:
- Volume Operations
This is about attaching volumes, detaching volumes.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/#servers-with-volume-attachments-servers-os-volume-attachments
- Admin Docs: http://docs.openstack.org/admin-guide/blockstorage-manage-volumes.html
- Tempest tests: fff42874-7db5-4487-a8e1-ddda5fb5288d
drivers:
- Ironic CI:
missing
- XenServer CI:
complete
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
complete
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
complete
- libvirt+virtuozzo CT:
complete
- VMware CI:
complete
- Maturity:
- Custom disk configurations on boot
This is about supporting all the features of BDMv2. This includes booting from a volume, in various ways, and specifying a custom set of ephemeral disks. Note some drivers only supports part of what the API allows.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/?expanded=create-image-createimage-action-detail#create-server
- Admin Docs: http://docs.openstack.org/admin-guide/compute-manage-volumes.html
- Tempest tests: 557cd2c2-4eb8-4dce-98be-f86765ff311b, 36c34c67-7b54-4b59-b188-02a2f458a63b
drivers:
- Ironic CI:
missing
- XenServer CI:
partial
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
complete
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
complete
(updated in “N” release) - libvirt+virtuozzo CT:
missing
- VMware CI:
partial
- Maturity:
- Custom neutron configurations on boot
This is about supporting booting from one or more neutron ports, or all the related short cuts such as booting a specified network. This does not include SR-IOV or similar, just simple neutron ports.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/?&expanded=create-server-detail
- Admin Docs: http://docs.openstack.org/admin-guide/compute-manage-volumes.html
- Tempest tests: 2f3a0127-95c7-4977-92d2-bc5aec602fb4
drivers:
- Ironic CI:
missing
- XenServer CI:
partial
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
partial
- libvirt+virtuozzo VM:
unknown
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
partial
- libvirt+virtuozzo CT:
unknown
- VMware CI:
partial
- Maturity:
- Pause a Server
This is pause and unpause a server, where the state is held in memory.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/?#pause-server-pause-action
- Admin Docs: http://docs.openstack.org/admin-guide/compute-images-instances.html
- Tempest tests: bd61a9fd-062f-4670-972b-2d6c3e3b9e73
drivers:
- Ironic CI:
missing
- XenServer CI:
complete
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
partial
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
complete
- libvirt+virtuozzo CT:
missing
- VMware CI:
partial
- Maturity:
- Suspend a Server
This suspend and resume a server, where the state is held on disk.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/?expanded=suspend-server-suspend-action-detail
- Admin Docs: http://docs.openstack.org/admin-guide/compute-images-instances.html
- Tempest tests: 0d8ee21e-b749-462d-83da-b85b41c86c7f
drivers:
- Ironic CI:
missing
- XenServer CI:
complete
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
partial
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
complete
- libvirt+virtuozzo CT:
partial
- VMware CI:
complete
- Maturity:
- Server console output
This gets the current server console output.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/#show-console-output-os-getconsoleoutput-action
- Admin Docs: http://docs.openstack.org/user-guide/cli_access_instance_through_a_console.html
- Tempest tests: 4b8867e6-fffa-4d54-b1d1-6fdda57be2f3
drivers:
- Ironic CI:
missing
- XenServer CI:
complete
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
unknown
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
partial
- libvirt+virtuozzo CT:
unknown
- VMware CI:
partial
- Maturity:
- Server Rescue
This boots a server with a new root disk from the specified glance image to allow a user to fix a boot partition configuration, or similar.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/#rescue-server-rescue-action
- Admin Docs: http://docs.openstack.org/user-guide/cli_reboot_an_instance.html
- Tempest tests: fd032140-714c-42e4-a8fd-adcd8df06be6, 70cdb8a1-89f8-437d-9448-8844fd82bf46
drivers:
- Ironic CI:
missing
- XenServer CI:
complete
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
complete
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
partial
- libvirt+virtuozzo CT:
partial
- VMware CI:
complete
- Maturity:
- Server Config Drive
This ensures the user data provided by the user when booting a server is available in one of the expected config drive locations.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/#create-server
- Admin Docs: http://docs.openstack.org/user-guide/cli_config_drive.html
- Tempest tests: 7fff3fb3-91d8-4fd0-bd7d-0204f1f180ba
drivers:
- Ironic CI:
partial
- XenServer CI:
complete
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
partial
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
complete
- libvirt+virtuozzo CT:
missing
- VMware CI:
complete
- Maturity:
- Server Change Password
The ability to reset the password of a user within the server.
info:
- Maturity:
experimental
- API Docs: http://developer.openstack.org/api-ref/compute/#change-administrative-password-changepassword-action
- Admin Docs: http://docs.openstack.org/cli-reference/nova.html#nova-set-password
- Tempest tests: 6158df09-4b82-4ab3-af6d-29cf36af858d
drivers:
- Ironic CI:
missing
- XenServer CI:
partial
- libvirt+kvm (x86 & ppc64):
partial
- libvirt+xen:
missing
- libvirt+virtuozzo VM:
missing
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
partial
- libvirt+virtuozzo CT:
missing
- VMware CI:
missing
- Maturity:
- Server Shelve and Unshelve
The ability to keep a server logically alive, but not using any cloud resources. For local disk based instances, this involves taking a snapshot, called offloading.
info:
- Maturity:
complete
- API Docs: http://developer.openstack.org/api-ref/compute/#shelve-server-shelve-action
- Admin Docs: http://docs.openstack.org/user-guide/cli_stop_and_start_an_instance.html#shelve-and-unshelve-an-instance
- Tempest tests: 1164e700-0af0-4a4c-8792-35909a88743c,c1b6318c-b9da-490b-9c67-9339b627271f
drivers:
- Ironic CI:
missing
- XenServer CI:
complete
- libvirt+kvm (x86 & ppc64):
complete
- libvirt+xen:
complete
- libvirt+virtuozzo VM:
complete
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
complete
- libvirt+virtuozzo CT:
missing
- VMware CI:
missing
- Maturity:
NFV Cloud Features¶
Network Function Virtualization (NFV) is about virtualizing network node functions into building blocks that may connect, or chain together to create a particular service. It is common for this workloads needing bare metal like performance, i.e. low latency and close to line speed performance.
Summary
Feature | Maturity | libvirt+kvm (x86 & ppc64) | libvirt+kvm (s390x) | libvirt+xen |
---|---|---|---|---|
NUMA Placement | experimental | ✔ m |
? |
✖ |
Details
- NUMA Placement
TODO add notes for feature
info:
- Maturity:
experimental
- API Docs: http://developer.openstack.org/api-ref-compute-v2.1.html#createServer
- Admin Docs: http://docs.openstack.org/admin-guide-cloud/compute-images-instances.html#instance-building-blocks
- Tempest tests: 9a438d88-10c6-4bcd-8b5b-5b6e25e1346f, 585e934c-448e-43c4-acbf-d06a9b899997
drivers:
- libvirt+kvm (x86 & ppc64):
partial
(updated in “M” release) - libvirt+kvm (s390x):
unknown
- libvirt+xen:
missing
- Maturity:
HPC Cloud Features¶
High Performance Compute (HPC) cloud have some specific needs that are covered in this set of features.
Summary
Feature | Maturity | Hyper-V CI | libvirt+kvm (x86 & ppc64) | libvirt+kvm (s390x) | libvirt+virtuozzo CT | libvirt+virtuozzo VM | libvirt+xen | VMware CI | XenServer CI |
---|---|---|---|---|---|---|---|---|---|
GPU Passthrough | experimental | ✖ |
✔ l |
? |
✔ |
✔ |
✖ |
✖ |
✔ k |
Details
- GPU Passthrough
TODO add notes for feature
info:
- Maturity:
experimental
- API Docs: http://developer.openstack.org/api-ref-compute-v2.1.html#createServer
- Admin Docs: http://docs.openstack.org/admin-guide-cloud/compute-images-instances.html#instance-building-blocks
- Tempest tests: 9a438d88-10c6-4bcd-8b5b-5b6e25e1346f, 585e934c-448e-43c4-acbf-d06a9b899997
drivers:
- XenServer CI:
partial
(updated in “K” release) - libvirt+kvm (x86 & ppc64):
complete
(updated in “L” release) - libvirt+xen:
missing
- libvirt+virtuozzo VM:
partial
- libvirt+kvm (s390x):
unknown
- Hyper-V CI:
missing
- libvirt+virtuozzo CT:
partial
- VMware CI:
missing
- Maturity:
Notes on Concepts¶
This document uses the following terminology.
Users¶
These are the users we talk about in this document:
- application deployer
- creates and deletes servers, directly or indirectly using an API
- application developer
- creates images and apps that run on the cloud
- cloud operator
- administers the cloud
- self service administrator
- runs and uses the cloud
Note
This is not an exhaustive list of personas, but rather an indicative set of users.
Feature Group¶
To reduce the size of the matrix, we organize the features into groups. Each group maps to a set of user stories that can be validated by a set of scenarios and tests. Typically, this means a set of tempest tests.
This list focuses on API concepts like attach and detach volumes, rather than deployment specific concepts like attach an iSCSI volume to a KVM based VM.
Deployment¶
A deployment maps to a specific test environment. We provide a full description of the environment, so it is possible to reproduce the reported test results for each of the Feature Groups.
This description includes all aspects of the deployment, for example the hypervisor, number of nova-compute services, storage, network driver, and types of images being tested.
Feature Group Maturity¶
The Feature Group Maturity rating is specific to the API concepts, rather than specific to a particular deployment. That detail is covered in the deployment rating for each feature group.
Note
Although having some similarities, this list is not directly related to the DefCore effort.
Feature Group ratings:
- Incomplete
- Incomplete features are those that do not have enough functionality to satisfy real world use cases.
- Experimental
- Experimental features should be used with extreme caution. They are likely to have little or no upstream testing, and are therefore likely to contain bugs.
- Complete
For a feature to be considered complete, it must have:
- complete API docs (concept and REST call definition)
- complete Administrator docs
- tempest tests that define if the feature works correctly
- sufficient functionality and reliability to be useful in real world scenarios
- a reasonable expectation that the feature will be supported long-term
- Complete and Required
There are various reasons why a complete feature may be required, but generally it is when all drivers support that feature. New drivers need to prove they support all required features before they are allowed in upstream Nova.
Required features are those that any new technology must support before being allowed into tree. The larger the list, the more features are available on all Nova based clouds.
- Deprecated
Deprecated features are those that are scheduled to be removed in a future major release of Nova. If a feature is marked as complete, it should never be deprecated.
If a feature is incomplete or experimental for several releases, it runs the risk of being deprecated and later removed from the code base.
Deployment Rating for a Feature Group¶
The deployment rating refers to the state of the tests for each Feature Group on a particular deployment.
Deployment ratings:
- Unknown
- No data is available.
- Not Implemented
- No tests exist.
- Implemented
- Self declared that the tempest tests pass.
- Regularly Tested
- Tested by third party CI.
- Checked
- Tested as part of the check or gate queue.
The eventual goal is to automate this list from a third party CI reporting system, but currently we document manual inspections in an ini file. Ideally, we will review the list at every milestone.