L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group Test Log

Total Statistics	Total	Pass	Fail	Elapsed	Pass / Fail
Critical Tests	0	0	0	00:00:00
All Tests	254	185	69	03:52:56

Statistics by Tag	Total	Pass	Fail	Elapsed
critical (critical)	0	0	0	00:00:00
NON_GATE	26	26	0	00:20:04
Regression	4	0	4	00:00:00
skip_if_conntrack	25	25	0	00:20:44

Statistics by Suite	Total	Pass	Fail	Elapsed
L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group	254	185	69	05:52:01
L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group . L2	14	14	0	00:24:10
L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group . L3	27	26	1	00:45:31
L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group . External Network	25	25	0	00:42:47
L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group . Vpn Basic	24	22	2	01:02:47
L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group . Vpn Basic Ipv6	15	0	15	00:25:18
L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group . Ha L2	47	33	14	00:43:21
L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group . Ha L3	50	35	15	00:54:59
L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group . Ha L3 Block Port	48	30	18	00:47:41
L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group . Neutron Security Group	4	0	4	00:05:27

05:52:00.690 SUITE L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group
Start / End / Elapsed:	20181018 21:58:20.979 / 20181019 03:50:21.669 / 05:52:00.690
Status:	0 critical test, 0 passed, 0 failed 254 test total, 185 passed, 69 failed

00:24:10.319 SUITE L2

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.L2
Documentation:	Test suite to verify packet flows between vm instances.
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l2.robot
Start / End / Elapsed:	20181018 21:58:21.015 / 20181018 22:22:31.334 / 00:24:10.319
Status:	0 critical test, 0 passed, 0 failed 14 test total, 14 passed, 0 failed

00:45:31.016 SUITE L3

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.L3
Documentation:	Test suite to check connectivity in L3 using routers.
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l3.robot
Start / End / Elapsed:	20181018 22:22:31.349 / 20181018 23:08:02.365 / 00:45:31.016
Status:	0 critical test, 0 passed, 0 failed 27 test total, 26 passed, 1 failed

00:42:46.909 SUITE External Network

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.External Network
Documentation:	Test suite to check North-South connectivity in L3 using a router and an external network
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/external_network.robot
Start / End / Elapsed:	20181018 23:08:02.386 / 20181018 23:50:49.295 / 00:42:46.909
Status:	0 critical test, 0 passed, 0 failed 25 test total, 25 passed, 0 failed

01:02:47.403 SUITE Vpn Basic

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic
Documentation:	Test suite to validate vpnservice functionality in an openstack integrated environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels.
Source:	/home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/vpn_basic.robot
Start / End / Elapsed:	20181018 23:50:49.322 / 20181019 00:53:36.725 / 01:02:47.403
Status:	0 critical test, 0 passed, 0 failed 24 test total, 22 passed, 2 failed

00:25:17.500 SUITE Vpn Basic Ipv6

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6
Documentation:	Test suite to validate IPv6 vpnservice functionality in an Openstack integrated environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels.
Source:	/home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/vpn_basic_ipv6.robot
Start / End / Elapsed:	20181019 00:53:36.743 / 20181019 01:18:54.243 / 00:25:17.500
Status:	0 critical test, 0 passed, 0 failed 15 test total, 0 passed, 15 failed
Message:	Suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:18:57.638 SETUP Suite Setup

Start / End / Elapsed:	20181019 00:53:36.926 / 20181019 01:12:34.564 / 00:18:57.638

00:06:19.657 TEARDOWN Suite Teardown

Documentation:	Delete the setup
Start / End / Elapsed:	20181019 01:12:34.586 / 20181019 01:18:54.243 / 00:06:19.657

00:00:00.001 TEST Check ELAN Datapath Traffic Within The Networks (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Check ELAN Datapath Traffic Within The Networks
Start / End / Elapsed:	20181019 01:12:34.565 / 20181019 01:12:34.566 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Check L3_Datapath Traffic Across Networks With Router (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Check L3_Datapath Traffic Across Networks With Router
Start / End / Elapsed:	20181019 01:12:34.567 / 20181019 01:12:34.568 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Add Multiple Extra Routes And Check Datapath Before L3VPN Creation (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Add Multiple Extra Routes And Check Datapath Before L3VPN Creation
Start / End / Elapsed:	20181019 01:12:34.568 / 20181019 01:12:34.569 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Delete Extra Route (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Delete Extra Route
Start / End / Elapsed:	20181019 01:12:34.569 / 20181019 01:12:34.570 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Delete And Recreate Extra Route (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Delete And Recreate Extra Route
Documentation:	Recreate multiple extra route and check data path before L3VPN creation
Start / End / Elapsed:	20181019 01:12:34.571 / 20181019 01:12:34.572 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.000 TEST Create L3VPN (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Create L3VPN
Start / End / Elapsed:	20181019 01:12:34.573 / 20181019 01:12:34.573 / 00:00:00.000
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Associate L3VPN To Routers (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Associate L3VPN To Routers
Start / End / Elapsed:	20181019 01:12:34.574 / 20181019 01:12:34.575 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Verify L3VPN Datapath With Router Association (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Verify L3VPN Datapath With Router Association
Start / End / Elapsed:	20181019 01:12:34.575 / 20181019 01:12:34.576 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Dissociate L3VPN From Routers (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Dissociate L3VPN From Routers
Start / End / Elapsed:	20181019 01:12:34.576 / 20181019 01:12:34.577 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Delete Router And Router Interfaces With L3VPN (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Delete Router And Router Interfaces With L3VPN
Start / End / Elapsed:	20181019 01:12:34.577 / 20181019 01:12:34.578 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Delete Router With NonExistentRouter Name (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Delete Router With NonExistentRouter Name
Start / End / Elapsed:	20181019 01:12:34.579 / 20181019 01:12:34.580 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Associate L3VPN To Networks (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Associate L3VPN To Networks
Start / End / Elapsed:	20181019 01:12:34.580 / 20181019 01:12:34.581 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Dissociate L3VPN From Networks (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Dissociate L3VPN From Networks
Start / End / Elapsed:	20181019 01:12:34.582 / 20181019 01:12:34.583 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Delete L3VPN (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Delete L3VPN
Start / End / Elapsed:	20181019 01:12:34.583 / 20181019 01:12:34.584 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:00:00.001 TEST Create Multiple L3VPN (non-critical)

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Vpn Basic Ipv6.Create Multiple L3VPN
Start / End / Elapsed:	20181019 01:12:34.584 / 20181019 01:12:34.585 / 00:00:00.001
Status:	FAIL (non-critical)
Message:	Parent suite setup failed: Keyword 'OpenStackOperations.Verify VM Is ACTIVE' failed after retrying for 10 minutes. The last error was: '\| OS-EXT-STS:vm_state \| error \|' does not contain 'active'

00:43:21.034 SUITE Ha L2

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Ha L2
Documentation:	Test suite to verify packet flows between vm instances.
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/clustering/ha_l2.robot
Start / End / Elapsed:	20181019 01:18:54.253 / 20181019 02:02:15.287 / 00:43:21.034
Status:	0 critical test, 0 passed, 0 failed 47 test total, 33 passed, 14 failed

00:54:58.774 SUITE Ha L3

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Ha L3
Documentation:	Test suite to check connectivity in L3 using routers.
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/clustering/ha_l3.robot
Start / End / Elapsed:	20181019 02:02:15.317 / 20181019 02:57:14.091 / 00:54:58.774
Status:	0 critical test, 0 passed, 0 failed 50 test total, 35 passed, 15 failed

00:47:40.608 SUITE Ha L3 Block Port

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Ha L3 Block Port
Documentation:	Test suite to check connectivity while disrupting connection between cluster nodes
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/clustering/ha_l3_block_port.robot
Start / End / Elapsed:	20181019 02:57:14.122 / 20181019 03:44:54.730 / 00:47:40.608
Status:	0 critical test, 0 passed, 0 failed 48 test total, 30 passed, 18 failed

00:05:26.855 SUITE Neutron Security Group

Full Name:	L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group.Neutron Security Group
Documentation:	Test Suite for Neutron Security Group
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/neutron_security_group.robot
Start / End / Elapsed:	20181019 03:44:54.766 / 20181019 03:50:21.621 / 00:05:26.855
Status:	0 critical test, 0 passed, 0 failed 4 test total, 0 passed, 4 failed
Message:	Suite setup failed: Keyword 'ClusterManagement.Check Status Of Services Is OPERATIONAL' failed after retrying for 1 minute. The last error was: '[?1l>[?2004lTimestamp: Fri Oct 19 02:48:20 UTC 2018 Node IP Address: 172.17.1.13 System is operational: false System ready state: ACTIVE IFM : OPERATIONAL OPENFLOW : OPERATIONAL ITM : OPERATIONAL ELAN : OPERATIONAL OVSDB : OPERATIONAL DATASTORE : ERROR [?1h=[?2004hopendaylight-user@root>' does not match 'DATASTORE +: OPERATIONAL'

Opening Robot Framework log failed

L2 & L3 & External Network & Vpn Basic & Vpn Basic Ipv6 & Ha L2 & Ha L3 & Ha L3 Block Port & Neutron Security Group Test Log

Test Statistics

Test Execution Log