Monday, October 03, 2016

Set up sshuttle connection to TripleO Overcloud been deployed via instack-virt-setup on remote VIRTHOST

Sshuttle may be installed on Fedora 24 via straight forward `dnf -y install sshuttle` [Fedora 24 Update: sshuttle-0.78.0-2.fc24].  Set up F24 as WKS for "TripleO instack-virt-setup overcloud/undercloud deployment to VIRTHOST"  via
ssh (trusted) connection . This setup works much more stable then configuring
FoxyProxy on VIRTHOST running "instack" ( actually undercloud VM) hosting
heat stack "overcloud" and several overcloud Controllers and Compute VMs

Instack-virt-setup deployments don't provide ( vs QuickStart ) ksmd daemon
sharing pages between overcloud VMs ( and supporting copy-on-write feature)
what results significantly more memory utilization on VIRTHOST and require
better CPUs and 48 GB RAM for testing HA overcloud deployments.
Regarding KSM see https://en.wikipedia.org/wiki/Kernel_same-page_merging

The last was verified on RDO Mitaka. Newton seems to have issues with HA overcloud deployments at least at the time of writing. See https://bugs.launchpad.net/tripleo #1585275, #1629366.   

What is sshuttle? It’s a Python app that uses SSH to create a quick and dirty VPN between your Linux, BSD, or Mac OS X machine and a remote system that has SSH access and Python. Been licensed under the GPLv2, sshuttle is a transparent proxy server that lets users fake a VPN with minimal hassle.

***************************************************************************
First install  sshutle on Fedora 24 :-
$ dnf -y install sshuttle
Then switch to VIRTHOST an set up standard Linux Bridge
***************************************************************************

# cat ifcfg-br0
DEVICE=br0
TYPE=Bridge
BOOTPROTO=static
DNS1=192.168.1.1
DNS2=83.221.202.254
GATEWAY=192.168.1.1
IPADDR=192.168.1.57
NETMASK=255.255.255.0
ONBOOT=yes

# cat ifcfg-enp3s0
DEVICE=enp3s0
HWADDR=78:24:af:43:1b:53
ONBOOT=yes
TYPE=Ethernet
IPV6INIT=no
USERCTL=no
BRIDGE=br0

***************************
Then run script
***************************
#!/bin/bash -x
chkconfig network on
systemctl stop NetworkManager
systemctl disable NetworkManager
service network restart

Switch to  VIRTHOST and follow http://lxer.com/module/newswire/view/234346/index.html    until instack VM will be up and running , then shutdown "instack VM" and add third VNIC to this VM and second VNIC to each one baremetal_(X) VMs created by instack-virt-setup  run :-


 

On instack VM create /etc/sysconfig/network-interfaces/ifcfg-eth2 file configured
BOOTPROTO=dhcp && sudo ifup eth2  .

[stack@instack ~]$ sudo su -

Last login: Mon Oct  3 12:32:04 UTC 2016 from 192.168.1.4 on pts/2
[root@instack ~]# cat /etc/sysconfig/network-scripts/ifcfg-eth2
TYPE=Ethernet
BOOTPROTO=dhcp
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
NAME=eth2
DEVICE=eth2
ONBOOT=yes
PREFIX=24
GATEWAY=192.168.1.1
DNS1=83.221.202.254
IPV6_PEERDNS=yes
IPV6_PEERROUTES=yes
IPV6_PRIVACY=no

**********************************************************************************
 Issue `ifconfig` and make sure eth2 obtained IP via your office router usually
 192.168.1.1. Thus "instack VM" appears to belong mentioned network and   would serve as ssh tunnel for sshuttle supposed to provide access to external
network 10.0.0.0/24 which would be created in TripleO Master Branch overcloud
after completion of deployment procedure.
**********************************************************************************
[root@instack ~]# ifconfig
br-ctlplane: flags=4163  mtu 1500
        inet 192.0.2.1  netmask 255.255.255.0  broadcast 192.0.2.255
        inet6 fe80::222:cdff:fe52:11cf  prefixlen 64  scopeid 0x20
        ether 00:22:cd:52:11:cf  txqueuelen 0  (Ethernet)
        RX packets 3203772  bytes 242696157 (231.4 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 4663339  bytes 20369572127 (18.9 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

eth0: flags=4163  mtu 1500
        inet 192.168.122.23  netmask 255.255.255.0  broadcast 192.168.122.255
        inet6 fe80::5054:ff:fec7:6356  prefixlen 64  scopeid 0x20
        ether 52:54:00:c7:63:56  txqueuelen 1000  (Ethernet)
        RX packets 50868  bytes 5455013 (5.2 MiB)
        RX errors 0  dropped 2  overruns 0  frame 0
        TX packets 44668  bytes 10199981 (9.7 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

eth1: flags=4163  mtu 1500
        inet6 fe80::222:cdff:fe52:11cf  prefixlen 64  scopeid 0x20
        ether 00:22:cd:52:11:cf  txqueuelen 1000  (Ethernet)
        RX packets 3218015  bytes 439876673 (419.4 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 4672723  bytes 20370569657 (18.9 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

eth2: flags=4163  mtu 1500
        inet 192.168.1.14  netmask 255.255.255.0  broadcast 192.168.1.255

        inet6 fe80::5054:ff:fe90:4024  prefixlen 64  scopeid 0x20
        ether 52:54:00:90:40:24  txqueuelen 1000  (Ethernet)
        RX packets 1696493  bytes 2312670704 (2.1 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 927189  bytes 266047551 (253.7 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10
        loop  txqueuelen 0  (Local Loopback)
        RX packets 2468459  bytes 13170730356 (12.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 2468459  bytes 13170730356 (12.2 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

vlan10: flags=4163  mtu 1500
        inet 10.0.0.1  netmask 255.255.255.0  broadcast 10.0.0.255

        inet6 fe80::48c5:c0ff:feff:3d00  prefixlen 64  scopeid 0x20
        ether 4a:c5:c0:ff:3d:00  txqueuelen 0  (Ethernet)
        RX packets 14440  bytes 196996148 (187.8 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 9337  bytes 947132 (924.9 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0



Thus eth2 on "instack VM" obtained IP address belongs to office network ( 192.168.1.0/24 ) say 192.168.1.14. Switch back F24 remote WKS and issue as user "john"

[john@fedora24wks]$ export VIRTHOST=192.168.1.14
[john@fedora24wks]$ ssh-copy-id root@$VIRTHOST
[john@fedora24wks]$ ssh root@$VIRTHOST uname -a <== no prompt

Login to instack VM from WKS as root && su - stack && source stackrc

Switch back to instructions from http://lxer.com/module/newswire/view/234346
and proceed with build Tripleo Master Branch undercloud/overcloud.
When done open another  terminal session on WKS and issue in this session

[jon@fedora24wks ~]$ export VIRTHOST=192.168.1.14
[jon@fedora24wks ~]$ sshuttle -r root@$VIRTHOST -v 10.0.0.0/24

Due to instack VM is trusting via ssh F24 WKS you won't be prompted to
connection to VIRTHOST and following output will appear in terminal session

Starting sshuttle proxy.
firewall manager: Starting firewall with Python version 3.5.1
firewall manager: ready method name nat.
IPv6 enabled: False
UDP enabled: False
DNS enabled: False
TCP redirector listening on ('127.0.0.1', 12300).
Starting client with Python version 3.5.1
c : connecting to server...
Starting server with Python version 2.7.5
 s: latency control setting = True
 s: available routes:
 s:   2/10.0.0.0/24
 s:   2/192.0.2.0/24
 s:   2/192.168.1.0/24
 s:   2/192.168.122.0/24
c : Connected.
firewall manager: setting up.
>> iptables -t nat -N sshuttle-12300
>> iptables -t nat -F sshuttle-12300
>> iptables -t nat -I OUTPUT 1 -j sshuttle-12300
>> iptables -t nat -I PREROUTING 1 -j sshuttle-12300
>> iptables -t nat -A sshuttle-12300 -j RETURN --dest 127.0.0.1/32 -p tcp
>> iptables -t nat -A sshuttle-12300 -j REDIRECT --dest 10.0.0.0/24 -p tcp --to-ports 12300 -m ttl ! --ttl 42
c : Accept TCP: 192.168.1.4:36580 -> 10.0.0.8:80.
c : Accept TCP: 192.168.1.4:36582 -> 10.0.0.8:80.
c : Accept TCP: 192.168.1.4:36584 -> 10.0.0.8:80.
c : Accept TCP: 192.168.1.4:36586 -> 10.0.0.8:80.
c : Accept TCP: 192.168.1.4:36588 -> 10.0.0.8:80.
c : Accept TCP: 192.168.1.4:36590 -> 10.0.0.8:80.

Open SSH window to instak VM
# su - stack
# source stackrc


  Reports above instructs you to launch browser ( on F24 WKS ) to
  http://10.0.0.8/dashboard/  . Login password for "admin" is in "overcloudrc" file
  generated under ~stack/ folder on "instack VM"

  Login to overcloud controller and up on restarting  keepalived daemon you are going  to get :-
 

   Create VM via nova/neutron CLI sourcing overcloudrc  on Controller and make
   sure that remote sshuttle connection to "instack VM" via http://10.0.0.8/dashboard will provide you option to manage vms running on overcloud compute
 nodes  . Also  ctlplane (192.0.2.0/24)  defined  as public network might  serve
 for  outbound Internet connectivity for those vms
  

 




Saturday, September 24, 2016

TripleO Master Branch Overcloud deployment via QuickStart

Following bellow is set of instructions required to perform TripleoO QuickStart
deployment  for release "master"  It differs a bit from testing default release
"mitaka" . First on  F24(23)  workstation.

Git clone repo bellow :-
[jon@fedora24wks release]$   git clone https://github.com/openstack/tripleo-quickstart
[jon@fedora24wks release]$  cd tripleo* ; cd ./config/release

**********************************************
Now verify that master.yml is here.
**********************************************
[jon@fedora24wks release]$ cat master.yml
release: master
undercloud_image_url: http://buildlogs.centos.org/centos/7/cloud/x86_64/tripleo_images/master/delorean/undercloud.qcow2
overcloud_image_url: http://buildlogs.centos.org/centos/7/cloud/x86_64/tripleo_images/master/delorean/overcloud-full.tar
ipa_image_url: http://buildlogs.centos.org/centos/7/cloud/x86_64/tripleo_images/master/delorean/ironic-python-agent.tar

Launch browser to mentioned above location


Now proceed as follows :-

# put your own IP here
[jon@fedora24wks tripleo-quickstart]$ export VIRTHOST=192.168.1.74 
[jon@fedora24wks tripleo-quickstart]$ ssh-copy-id root@$VIRTHOST
[jon@fedora24wks tripleo-quickstart]$ ssh root@$VIRTHOST uname -a
[jon@fedora24wks tripleo-quickstart]$ bash quickstart.sh \
   -R master $VIRTHOST
[jon@fedora24wks tripleo-quickstart]$ ssh -F \
     /home/jon/.quickstart/ssh.config.ansible \
     undercloud

******************************************************************************** 
Now you are logged into undecloud VM running on VIRTHOST as stack
Building overcloud images is skipped due to QuickStart CI. There is no harm in attempt of building them. It will take a second, they are already there.
********************************************************************************
# Upload per-built overcloud images 
[stack@undercloud ~]$ source stackrc 
[stack@undercloud ~]$ openstack overcloud image upload
[stack@undercloud ~]$ openstack baremetal import instackenv.json
[stack@undercloud ~]$ openstack baremetal configure boot
[stack@undercloud ~]$ openstack baremetal introspection bulk start
[stack@undercloud ~]$ ironic node-list
[stack@undercloud ~]$ neutron subnet-list 
[stack@undercloud ~]$ neutron subnet-update 1b7d82e5-0bf1-4ba5-8008-4aa402598065 \
                         --dns-nameserver 8.8.8.8
 *************************************
 Create external interface vlan10
 *************************************

 [stack@undercloud ~]$  sudo vi /etc/sysconfig/network-scripts/ifcfg-vlan10
  DEVICE=vlan10
  ONBOOT=yes
  DEVICETYPE=ovs
  TYPE=OVSIntPort
  BOOTPROTO=static
   IPADDR=10.0.0.1
   NETMASK=255.255.255.0
   OVS_BRIDGE=br-ctlplane
   OVS_OPTIONS="tag=10"

 [stack@undercloud ~]$ sudo ifup vlan10

 [stack@undercloud ~]$ sudo ovs-vsctl show
 7011423b-55c8-4943-9d7d-94f052a4b6f1
    Manager "ptcp:6640:127.0.0.1"
        is_connected: true
    Bridge br-int
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port "tapb54de3dd-24"
            tag: 1
            Interface "tapb54de3dd-24"
                type: internal
        Port int-br-ctlplane
            Interface int-br-ctlplane
                type: patch
                options: {peer=phy-br-ctlplane}
        Port br-int
            Interface br-int
                type: internal
    Bridge br-ctlplane
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port br-ctlplane
            Interface br-ctlplane
                type: internal
        Port "vlan10"
            tag: 10
            Interface "vlan10"
                type: internal
        Port phy-br-ctlplane
            Interface phy-br-ctlplane
                type: patch
                options: {peer=int-br-ctlplane}
        Port "eth1"
            Interface "eth1"
    ovs_version: "2.5.0"

********************************************* 
Create manually network_env.yaml
*********************************************
    [stack@instack ~]$vi network_env.yaml
   {
    "parameter_defaults": {
        "ControlPlaneDefaultRoute": "192.0.2.1",
        "ControlPlaneSubnetCidr": "24",
        "DnsServers": [
            "192.168.122.1"
        ],
        "EC2MetadataIp": "192.0.2.1",
        "ExternalAllocationPools": [
            {
                "end": "10.0.0.250",
                "start": "10.0.0.4"
            }
        ],
        "ExternalNetCidr": "10.0.0.1/24",
        "NeutronExternalNetworkBridge": ""
    }
   }

$ sudo iptables -A BOOTSTACK_MASQ -s 10.0.0.0/24 ! -d 10.0.0.0/24 -j MASQUERADE -t nat

[stack@undercloud ~]$ sudo touch -f \
     /usr/share/openstack-tripleo-heat-templates/puppet/post.yaml
[stack@undercloud ~]$ cat overcloud-deploy.sh
#!/bin/bash -x
source /home/stack/stackrc
openstack overcloud deploy \
 --libvirt-type qemu \
 --ntp-server pool.ntp.org \
 --templates /usr/share/openstack-tripleo-heat-templates \
 -e  /usr/share/openstack-tripleo-heat-templates/overcloud-resource-registry-puppet.yaml \
 -e  /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml \
 -e /usr/share/openstack-tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml \
 -e  $HOME/network_env.yaml \
 --control-scale 1 --compute-scale 1 
[stack@undercloud ~]$ ./overcloud-deploy.sh
[stack@undercloud ~]$ sudo route add -net 192.0.2.0/24 gw 192.0.2.1
[stack@undercloud ~]$ sudo ip route
 default via 192.168.23.1 dev eth0 
 10.0.0.0/24 dev vlan10  proto kernel  scope link  src 10.0.0.1 
 192.0.2.0/24 via 192.0.2.1 dev br-ctlplane  scope link 
 192.0.2.0/24 dev br-ctlplane  proto kernel  scope link  src 192.0.2.1 
 192.168.23.0/24 dev eth0  proto kernel  scope link  src 192.168.23.28 
 192.168.122.0/24 dev virbr0  proto kernel  scope link  src 192.168.122.1 
   
[stack@undercloud ~]$ source stackrc
[stack@undercloud ~]$ nova list
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| ID                                   | Name                    | Status | Task State | Power State | Networks            |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| 607034d9-22c5-4f8f-a192-487b732f80aa | overcloud-controller-0  | ACTIVE | -          | Running     | ctlplane=192.0.2.16 |
| 15ddf8be-e9c0-4ea8-9a2f-52eb98663669 | overcloud-novacompute-0 | ACTIVE | -          | Running     | ctlplane=192.0.2.11 |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
[stack@undercloud ~]$ openstack stack list
WARNING: openstackclient.common.utils is deprecated and will be removed after Jun 2017. Please use osc_lib.utils
+------------------------+------------+-----------------+----------------------+--------------+
| ID                     | Stack Name | Stack Status    | Creation Time        | Updated Time |
+------------------------+------------+-----------------+----------------------+--------------+
| a2193f65-bac7-458f-    | overcloud  | CREATE_COMPLETE | 2016-09-24T10:49:16Z | None         |
| 8eef-8daf909fa41f      |            |                 |                      |              |
+------------------------+------------+-----------------+----------------------+--------------+ 

Now connect to overcloud via sshuttle running on F24 WKS , starting in separate
terminal on WKS :-
$ sshuttle -e "ssh -F $HOME/.quickstart/ssh.config.ansible" -r undercloud  -v 10.0.0.0/24

Sunday, September 18, 2016

Switch to Overcloud with Network isolation been setup via TripleO Master branch

This post follows up TripleO deployment of 'master' branch via instack-virt-setup
Launchpad bug "Updating plans breaks deployment" https://bugs.launchpad.net/tripleo/+bug/1622683  still has status "In Progress" so to be able redeploy overcloud the workaround from https://bugs.launchpad.net/tripleo/+bug/1622720/comments/1  would be applied.
 If "overcloud deployment" starts reporting "Uploading new plan files" and crashes by some reasons later you still have to issue 2 commands bellow to be able restart "overcloud deployment" until tripleo-common package would be fixed ( track bug mentioned above )

**************************
Redeployment
**************************

[stack@instack ~]$ openstack stack delete overcloud
[stack@instack ~]$ . stackrc
[stack@instack ~]$ mistral environment-delete overcloud
   Request to delete environment overcloud has been accepted.
[stack@instack ~]$ swift delete --all

Add NAT Default VNIC to each of bare metal nodes (VMs)
To enable Internet connectivity from Controller after
overcloud deployment at the moment when "overcloud" stack got
gracefully deleted and status of bare metal nodes (VMs)  is down


****************************************
Make following updates on instack
****************************************

   $  sudo ovs-vsctl show
   $  sudo vi /etc/sysconfig/network-scripts/ifcfg-vlan10
       DEVICE=vlan10
       ONBOOT=yes
       DEVICETYPE=ovs
       TYPE=OVSIntPort
       BOOTPROTO=static
       IPADDR=10.0.0.1
       NETMASK=255.255.255.0
       OVS_BRIDGE=br-ctlplane
       OVS_OPTIONS="tag=10"

   $  sudo ifup vlan10

**********************************************************************
Make sure ovs-vsctl on undercloud has been updated
**********************************************************************
[stack@instack ~]$ sudo ovs-vsctl show
3dfb403a-c31d-4bb3-9851-08f2e7b7778f
    Manager "ptcp:6640:127.0.0.1"
        is_connected: true
    Bridge br-int
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port int-br-ctlplane
            Interface int-br-ctlplane
                type: patch
                options: {peer=phy-br-ctlplane}
        Port "tapb104ab9a-36"
            tag: 1
            Interface "tapb104ab9a-36"
                type: internal
        Port br-int
            Interface br-int
                type: internal
    Bridge br-ctlplane
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port "eth1"
            Interface "eth1"
        Port phy-br-ctlplane
            Interface phy-br-ctlplane
                type: patch
                options: {peer=int-br-ctlplane}
        Port "vlan10"
            tag: 10
            Interface "vlan10"

                type: internal
        Port br-ctlplane
            Interface br-ctlplane
                type: internal
    ovs_version: "2.5.0"
***************************************************
Create network_env.yaml under ~stack/
***************************************************

   [stack@instack ~]$ cat network_env.yaml
    {
    "parameter_defaults": {
        "ControlPlaneDefaultRoute": "192.0.2.1",
        "ControlPlaneSubnetCidr": "24",
        "DnsServers": [
            "192.168.122.5"
        ],
        "EC2MetadataIp": "192.0.2.1",
        "ExternalAllocationPools": [
            {
                "end": "10.0.0.250",
                "start": "10.0.0.4"
            }
        ],
        "ExternalNetCidr": "10.0.0.1/24",
        "NeutronExternalNetworkBridge": ""
    }
   }

Where 192.168.122.5 is instack VM Ip.

*************************
Deploy overcloud
*************************

#!/bin/bash -x
source /home/stack/stackrc
openstack overcloud deploy  \
--libvirt-type qemu  \
--ntp-server pool.ntp.org  \
--templates /home/stack/tripleo-heat-templates  \
-e /home/stack/tripleo-heat-templates/overcloud-resource-registry-puppet.yaml  \
-e  /home/stack/tripleo-heat-templates/environments/network-isolation.yaml  \
-e  /home/stack/tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml  \
-e  $HOME/network_env.yaml  \
--control-scale 1 --compute-scale 2

********************************************************************************
Up on completion proceed on undercloud (instack VM)  as follows
********************************************************************************


Add route to ctlplane network
 
[stack@instack ~]$ sudo route add -net 192.0.2.0/24 gw 192.0.2.1

[stack@instack ~]$ sudo ip route
default via 192.168.122.1 dev eth0
10.0.0.0/24 dev vlan10  proto kernel  scope link  src 10.0.0.1
192.0.2.0/24 via 192.0.2.1 dev br-ctlplane  scope link
192.0.2.0/24 dev br-ctlplane  proto kernel  scope link  src 192.0.2.1
192.168.122.0/24 dev eth0  proto kernel  scope link  src 192.168.122.5


[stack@instack ~]$ . stackrc
[stack@instack ~]$ nova list

+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| ID                                   | Name                    | Status | Task State | Power State | Networks            |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| 0212a5cc-c73e-43c3-bddb-51cac22f0060 | overcloud-controller-0  | ACTIVE | -          | Running     | ctlplane=192.0.2.9  |
| a421c80b-54a5-4cc8-9414-45d45a27845b | overcloud-novacompute-0 | ACTIVE | -          | Running     | ctlplane=192.0.2.18 |
| 3641a8da-c5fa-4975-9e43-c926522ecc2b | overcloud-novacompute-1 | ACTIVE | -          | Running     | ctlplane=192.0.2.13 |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+

[stack@instack ~]$ neutron net-list
+--------------------------------------+--------------+----------------------------------------+
| id                                   | name         | subnets                                |
+--------------------------------------+--------------+----------------------------------------+
| 5309b1a3-f6c6-4bdd-a0bc-93f418853080 | external     | 56fe052f-ba26-437b-94ab-b03688e06ad9   |
|                                      |              | 10.0.0.0/24                            |
| 77440f54-0ce4-444c-8983-2ef2ae1408b4 | ctlplane     | 76055a99-45e4-4b5a-b1fc-846c91137427   |
|                                      |              | 192.0.2.0/24                           |
| 7b3e788a-ebdd-4e7c-b076-517ca62befb3 | tenant       | 0a028e34-8a0a-48ce-88d8-5523b19eac0f   |
|                                      |              | 172.16.0.0/24                          |
| 813d17c3-bd58-490f-94a4-aefeb2057d22 | storage_mgmt | e3cdcf74-64fa-4837-b480-304a1329d109   |
|                                      |              | 172.16.3.0/24                          |
| bcba764c-0b27-4785-b875-8b20bd28cd96 | internal_api | 1de0ff85-7525-4e1f-94ea-1bc6e060a096   |
|                                      |              | 172.16.2.0/24                          |
| d4c8e9d8-bffc-4803-8ee4-bbff63eef9e1 | storage      | f76d3eeb-c7d8-47e9-a2e3-95765975c292   |
|                                      |              | 172.16.1.0/24                          |
+--------------------------------------+--------------+----------------------------------------+


  

[root@overcloud-controller-0 ~]# nova service-list
+----+------------------+-------------------------------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary           | Host                                | Zone     | Status  | State | Updated_at                 | Disabled Reason |
+----+------------------+-------------------------------------+----------+---------+-------+----------------------------+-----------------+
| 3  | nova-consoleauth | overcloud-controller-0.localdomain  | internal | enabled | up    | 2016-09-19T10:02:37.000000 | -               |
| 4  | nova-scheduler   | overcloud-controller-0.localdomain  | internal | enabled | up    | 2016-09-19T10:02:31.000000 | -               |
| 5  | nova-conductor   | overcloud-controller-0.localdomain  | internal | enabled | up    | 2016-09-19T10:02:30.000000 | -               |
| 6  | nova-compute     | overcloud-novacompute-1.localdomain | nova     | enabled | up    | 2016-09-19T10:02:29.000000 | -               |
| 7  | nova-compute     | overcloud-novacompute-0.localdomain | nova     | enabled | up    | 2016-09-19T10:02:35.000000 | -               |
+----+------------------+-------------------------------------+----------+---------+-------+----------------------------+-----------------+

FoxyProxy tuned for external network


  

   List of instances launched and running via Nova CLI

   
*****************************************************
Controller's ovs-vsctl show report
*****************************************************
[root@overcloud-controller-0 ~]# ovs-vsctl show
d818c01e-d0ce-425d-a9c8-07e0ff541ea9
    Manager "ptcp:6640:127.0.0.1"
        is_connected: true
    Bridge br-int
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port "tap19ce4553-8f"
            tag: 2
            Interface "tap19ce4553-8f"
                type: internal
        Port br-int
            Interface br-int
                type: internal
        Port "qr-4a00fb57-90"
            tag: 2
            Interface "qr-4a00fb57-90"
                type: internal
        Port "qg-5b1fb5eb-d5"
            tag: 4
            Interface "qg-5b1fb5eb-d5"
                type: internal
        Port int-br-ex
            Interface int-br-ex
                type: patch
                options: {peer=phy-br-ex}
    Bridge br-ex
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port phy-br-ex
            Interface phy-br-ex
                type: patch
                options: {peer=int-br-ex}
        Port "vlan40"
            tag: 40
            Interface "vlan40"
                type: internal
        Port "eth0"
            Interface "eth0"
        Port "vlan20"
            tag: 20
            Interface "vlan20"
                type: internal
        Port br-ex
            Interface br-ex
                type: internal
        Port "vlan30"
            tag: 30
            Interface "vlan30"
                type: internal
        Port "vlan50"
            tag: 50
            Interface "vlan50"
                type: internal
        Port "vlan10"
            tag: 10
            Interface "vlan10"
                type: internal
    Bridge br-tun
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "vxlan-ac100009"
            Interface "vxlan-ac100009"
                type: vxlan
                options: {df_default="true", in_key=flow, local_ip="172.16.0.12", out_key=flow, remote_ip="172.16.0.9"}
        Port "vxlan-ac10000d"
            Interface "vxlan-ac10000d"
                type: vxlan
                options: {df_default="true", in_key=flow, local_ip="172.16.0.12", out_key=flow, remote_ip="172.16.0.13"}
    ovs_version: "2.5.0"

**********************************************************************
 Hypervisor status on Compute nodes (Newton RC1)
 Qemu-kvm-ev-2.31 gets installed by default
**********************************************************************
[root@overcloud-novacompute-0 ~]# virsh --connect qemu:///system
Welcome to virsh, the virtualization interactive terminal.

Type:  'help' for help with commands
       'quit' to quit

virsh # version
Compiled against library: libvirt 1.2.17
Using library: libvirt 1.2.17
Using API: QEMU 1.2.17
Running hypervisor: QEMU 2.3.0

virsh # list --all
 Id    Name                           State
----------------------------------------------------
 6     instance-00000004              running


[root@overcloud-novacompute-1 ~]# virsh --connect qemu:///system
Welcome to virsh, the virtualization interactive terminal.

Type:  'help' for help with commands
       'quit' to quit

virsh # version
Compiled against library: libvirt 1.2.17
Using library: libvirt 1.2.17
Using API: QEMU 1.2.17
Running hypervisor: QEMU 2.3.0

virsh # list --all
 Id    Name                           State
----------------------------------------------------
 5     instance-00000005              running

*************************************
VIRTHOST Configuration
*************************************
[root@ServerVIRT1608 ~]# brctl show
bridge name    bridge id        STP enabled    interfaces
brext        8000.525400b017dc    no        brext-nic
brovc        8000.525400948dc8    no        brovc-nic
virbr0        8000.525400f83b3b    yes        virbr0-nic
                            vnet0
                            vnet3
                            vnet5
                            vnet7

[root@ServerVIRT1608 ~]# ovs-vsctl show
96876d44-cca3-4e93-b89c-8238b4745c3c
    Bridge brbm
        Port "vnet6"
            Interface "vnet6"
        Port "vnet4"
            Interface "vnet4"
        Port "vnet1"
            Interface "vnet1"
        Port "vnet2"
            Interface "vnet2"
        Port brbm
            Interface brbm
                type: internal
    ovs_version: "2.5.0"


Thursday, September 15, 2016

TripleO deployment of 'master' branch via instack-virt-setup

 UPDATE 09/30/2016


 $ sudo route add -net 192.0.2.0/24 gw 192.0.2.1 ( on instack VM )
 no longer needed , moreover affects ssh connect to overcloud nodes

***************************
Overcloud-deploy.sh
***************************
#!/bin/bash -x
source /home/stack/stackrc
openstack overcloud deploy \
  --libvirt-type qemu \
  --ntp-server pool.ntp.org \
  --templates /home/stack/tripleo-heat-templates \
  -e  /home/stack/tripleo-heat-templates/environments/network-isolation.yaml \
  -e  /home/stack/tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml \
  -e  $HOME/network_env.yaml \
  --control-scale 1 --compute-scale 2 
END UPDATE

UPDATE 09/23/2016


Fix released for (1622683, 1622720 ) in :-
https://bugs.launchpad.net/tripleo/+bug/1622683 

****************************************************
Deploy completed OK the first time
****************************************************
2016-09-23 09:08:28Z [overcloud-AllNodesDeploySteps-yrsd7pkitjij]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-09-23 09:08:28Z [AllNodesDeploySteps]: CREATE_COMPLETE  state changed
2016-09-23 09:08:28Z [overcloud]: CREATE_COMPLETE  Stack CREATE completed successfully

 Stack overcloud CREATE_COMPLETE

Overcloud Endpoint: http://10.0.0.6:5000/v2.0
Overcloud Deployed
[stack@instack ~]$ nova list
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| ID                                   | Name                    | Status | Task State | Power State | Networks            |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| b3d97bcf-9318-48ef-91c7-09c8386a75aa | overcloud-controller-0  | ACTIVE | -          | Running     | ctlplane=192.0.2.13 |
| 148aa223-513d-44d5-b865-2cb2c3dcbc6f | overcloud-novacompute-0 | ACTIVE | -          | Running     | ctlplane=192.0.2.9  |
| e3ee61fb-c243-4454-949d-84c22e66b147 | overcloud-novacompute-1 | ACTIVE | -          | Running     | ctlplane=192.0.2.10 |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+

[stack@instack ~]$ mistral environment-list
+-----------+-------------+---------+---------------------+---------------------+
| Name      | Description | Scope   | Created at          | Updated at          |
+-----------+-------------+---------+---------------------+---------------------+
| overcloud | None        | private | 2016-09-23 07:33:40 | 2016-09-23 08:41:29 |
+-----------+-------------+---------+---------------------+---------------------+

[stack@instack ~]$ swift list
ov-jjf6fn4qyjt-0-gfpul73m4fdl-Controller-dekw3w5stcqd
ov-pb3uu5djue-0-lmazr26t3z4u-NovaCompute-sqfaz5lstqov
ov-pb3uu5djue-1-7prlyxolsdhd-NovaCompute-ltmkwmq74iyq
overcloud

[stack@instack ~]$ openstack stack delete overcloud
WARNING: openstackclient.common.utils is deprecated and will be removed after Jun 2017. Please use osc_lib.utils
Are you sure you want to delete this stack(s) [y/N]? y

[stack@instack ~]$ openstack stack list
WARNING: openstackclient.common.utils is deprecated and will be removed after Jun 2017. Please use osc_lib.utils
+---------------------+------------+--------------------+----------------------+--------------+
| ID                  | Stack Name | Stack Status       | Creation Time        | Updated Time |
+---------------------+------------+--------------------+----------------------+--------------+
| 6e3ae2b6-5ce1-45db- | overcloud  | DELETE_IN_PROGRESS | 2016-09-23T08:41:38Z | None         |
| bde5-06d2ce2e571b   |            |                    |                      |              |
+---------------------+------------+--------------------+----------------------+--------------+

[stack@instack ~]$ openstack stack list
WARNING: openstackclient.common.utils is deprecated and will be removed after Jun 2017. Please use osc_lib.utils

***************************************************************************
Empty output - overcloud stack has been deleted
****************************************************************************

[stack@instack ~]$ mistral environment-list
+-----------+-------------+---------+---------------------+---------------------+
| Name      | Description | Scope   | Created at          | Updated at          |
+-----------+-------------+---------+---------------------+---------------------+
| overcloud | None        | private | 2016-09-23 07:33:40 | 2016-09-23 08:41:29 |
+-----------+-------------+---------+---------------------+---------------------+

[stack@instack ~]$ swift list
overcloud

******************************************************************************
Now attempt to redeploy the second time .  Success on 09/23/2016
******************************************************************************
[stack@instack ~]$ touch -f  /home/stack/tripleo-heat-templates/puppet/post.yaml

[stack@instack ~]$ ./overcloud-deploy.sh
+ source /home/stack/stackrc
++ export NOVA_VERSION=1.1
++ NOVA_VERSION=1.1
+++ sudo hiera admin_password
++ export OS_PASSWORD=68a350a2972f7ff9e88d0e9ea79056b3e0bb90ec
++ OS_PASSWORD=68a350a2972f7ff9e88d0e9ea79056b3e0bb90ec
++ export OS_AUTH_URL=http://192.0.2.1:5000/v2.0
++ OS_AUTH_URL=http://192.0.2.1:5000/v2.0
++ export OS_USERNAME=admin
++ OS_USERNAME=admin
++ export OS_TENANT_NAME=admin
++ OS_TENANT_NAME=admin
++ export COMPUTE_API_VERSION=1.1
++ COMPUTE_API_VERSION=1.1
++ export OS_BAREMETAL_API_VERSION=1.15
++ OS_BAREMETAL_API_VERSION=1.15
++ export OS_NO_CACHE=True
++ OS_NO_CACHE=True
++ export OS_CLOUDNAME=undercloud
++ OS_CLOUDNAME=undercloud
++ export OS_IMAGE_API_VERSION=1
++ OS_IMAGE_API_VERSION=1
+ openstack overcloud deploy --libvirt-type qemu --ntp-server pool.ntp.org --templates /home/stack/tripleo-heat-templates -e /home/stack/tripleo-heat-templates/overcloud-resource-registry-puppet.yaml -e /home/stack/tripleo-heat-templates/environments/network-isolation.yaml -e /home/stack/tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml -e /home/stack/network_env.yaml --control-scale 1 --compute-scale 2
WARNING: openstackclient.common.utils is deprecated and will be removed after Jun 2017. Please use osc_lib.utils
Removing the current plan files
Uploading new plan files
Started Mistral Workflow. Execution ID: 4d744a89-a2e7-43a5-82af-26bab11e6342
Plan updated
Deploying templates in the directory /home/stack/tripleo-heat-templates
Object GET failed: http://192.0.2.1:8080/v1/AUTH_7ea6220c67c84c828f4249b95886259f/overcloud/overcloud-without-mergepy.yaml 404 Not Found  [first 60 chars of response]
Started Mistral Workflow. Execution ID: 807a7047-a1c3-4686-9be7-11d73e72dfb8
2016-09-23 09:15:34Z [overcloud]: CREATE_IN_PROGRESS  Stack CREATE started
2016-09-23 09:15:34Z [HorizonSecret]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:34Z [RabbitCookie]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:35Z [ServiceNetMap]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:35Z [MysqlRootPassword]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:35Z [HeatAuthEncryptionKey]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:35Z [PcsdPassword]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:35Z [Networks]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:35Z [ServiceNetMap]: CREATE_COMPLETE  state changed
2016-09-23 09:15:35Z [RabbitCookie]: CREATE_COMPLETE  state changed
2016-09-23 09:15:35Z [HeatAuthEncryptionKey]: CREATE_COMPLETE  state changed
2016-09-23 09:15:35Z [PcsdPassword]: CREATE_COMPLETE  state changed
2016-09-23 09:15:35Z [HorizonSecret]: CREATE_COMPLETE  state changed
. . . . . .
2016-09-23 09:39:50Z [BlockStorageExtraConfigPost]: CREATE_COMPLETE  state changed
2016-09-23 09:39:51Z [CephStorageExtraConfigPost]: CREATE_COMPLETE  state changed
2016-09-23 09:39:51Z [ComputeExtraConfigPost]: CREATE_COMPLETE  state changed
2016-09-23 09:39:51Z [ObjectStorageExtraConfigPost]: CREATE_COMPLETE  state changed
2016-09-23 09:39:51Z [overcloud-AllNodesDeploySteps-5bfecsxdagiz]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-09-23 09:39:51Z [AllNodesDeploySteps]: CREATE_COMPLETE  state changed
2016-09-23 09:39:51Z [overcloud]: CREATE_COMPLETE  Stack CREATE completed successfully

 Stack overcloud CREATE_COMPLETE

Overcloud Endpoint: http://10.0.0.12:5000/v2.0
Overcloud Deployed

******************************
Another test on 09/25/2016
******************************
Stack .bashrc on VIRTHOST

export NODE_MEM=8000
export NODE_COUNT=2
export UNDERCLOUD_NODE_CPU=4
export NODE_DISK=80
export UNDERCLOUD_NODE_DISK=35
export NODE_CPU=4
export NODE_DIST=centos7
export UNDERCLOUD_NODE_MEM=12000
export FS_TYPE=ext4
# Use rspecific aliases and functions
export LIBVIRT_DEFAULT_URI="qemu:///system"

********************************
overcloud-deploy.sh
********************************

[stack@instack ~]$ cat overcloud-deploy.sh
#!/bin/bash -x
source /home/stack/stackrc
openstack overcloud deploy \
--libvirt-type qemu \
--ntp-server pool.ntp.org \
--templates /home/stack/tripleo-heat-templates \
-e  /home/stack/tripleo-heat-templates/overcloud-resource-registry-puppet.yaml \
-e  /home/stack/tripleo-heat-templates/environments/network-isolation.yaml \
-e  /home/stack/tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml \
-e  $HOME/network_env.yaml \
--control-scale 1 --compute-scale 1



[stack@instack ~]$ mistral execution-list
+----------+-------------+---------------+-------------+-------------------+---------+------------+------------+---------------+
| ID       | Workflow ID | Workflow name | Description | Task Execution ID | State   | State info | Created at | Updated at    |
+----------+-------------+---------------+-------------+-------------------+---------+------------+------------+---------------+
| 179ee399 | 91b46d6e-f6 | tripleo.plan_ |             |             | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -f9ff-4b | 29-41a8-bf4 | management.v1 |             |                   |         |            | 13:33:01   | 13:33:15      |
| b4-ab68- | 3-79e6cef19 | .create_defau |             |                   |         |            |            |               |
| ad09697e | 53c         | lt_deployment |             |                   |         |            |            |               |
| 8820     |             | _plan         |             |                   |         |            |            |               |
| 2722c9ce | 2a3c6e58-63 | tripleo.barem |             |             | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -d8ee-   | 17-449a-87c | etal.v1.regis |             |                   |         |            | 13:50:41   | 13:50:55      |
| 470b-    | 7-a0b1ac0ab | ter_or_update |             |                   |         |            |            |               |
| 957b-107 | 18b         |               |             |                   |         |            |            |               |
| b2859ccd |             |               |             |                   |         |            |            |               |
| c        |             |               |             |                   |         |            |            |               |
| b98bbae3 | e82c37ad-   | tripleo.barem | sub-        | 76ff2748-4922     | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -185e-   | 8d07-4a7b-  | etal.v1.set_n | workflow    | -4b1f-            |         |            | 13:50:48   | 13:50:51      |
| 4ba5     | 85cf-1140ab | ode_state     | execution   | a0c5-d607dc6a24d4 |         |            |            |               |
| -a97e-9e | 425c9d      |               |             |                   |         |            |            |               |
| 9ecc8b51 |             |               |             |                   |         |            |            |               |
| ee       |             |               |             |                   |         |            |            |               |
| d5fff31f | e82c37ad-   | tripleo.barem | sub-        | 76ff2748-4922     | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -5883    | 8d07-4a7b-  | etal.v1.set_n | workflow    | -4b1f-            |         |            | 13:50:48   | 13:50:51      |
| -46dd-a3 | 85cf-1140ab | ode_state     | execution   | a0c5-d607dc6a24d4 |         |            |            |               |
| bc-24926 | 425c9d      |               |             |                   |         |            |            |               |
| 8747688  |             |               |             |                   |         |            |            |               |
| 07bc3a5d | e82c37ad-   | tripleo.barem | sub-        | 3516fb1c-3b2a-    | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -f1fa-41 | 8d07-4a7b-  | etal.v1.set_n | workflow    | 4bab-             |         |            | 13:50:55   | 13:50:58      |
| 41-bda6- | 85cf-1140ab | ode_state     | execution   | ac07-481cbe74796e |         |            |            |               |
| a824b9cd | 425c9d      |               |             |                   |         |            |            |               |
| 9a3b     |             |               |             |                   |         |            |            |               |
| 51738f17 | 96820b49-32 | tripleo.barem |             |             | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -27d4-4f | 39-4197     | etal.v1.provi |             |                   |         |            | 13:50:55   | 13:51:02      |
| 12-af56- | -9caf-a6c42 | de            |             |                   |         |            |            |               |
| a948a522 | d418264     |               |             |                   |         |            |            |               |
| 97c2     |             |               |             |                   |         |            |            |               |
| 87607542 | e82c37ad-   | tripleo.barem | sub-        | 3516fb1c-3b2a-    | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -42c6    | 8d07-4a7b-  | etal.v1.set_n | workflow    | 4bab-             |         |            | 13:50:55   | 13:50:58      |
| -4a6d-8b | 85cf-1140ab | ode_state     | execution   | ac07-481cbe74796e |         |            |            |               |
| 26-4ab85 | 425c9d      |               |             |                   |         |            |            |               |
| d7998ad  |             |               |             |                   |         |            |            |               |
| de8a9706 | ae47b2fc-   | tripleo.barem |             |             | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -3f29-4c | bf56-4f43   | etal.v1.intro |             |                   |         |            | 13:51:16   | 13:53:16      |
| 1e-b969- | -92bf-b069f | spect_managea |             |                   |         |            |            |               |
| a42da88e | b7cc268     | ble_nodes     |             |                   |         |            |            |               |
| f6d3     |             |               |             |                   |         |            |            |               |
| 81369764 | 1ce6499e-   | tripleo.barem | sub-        | 45d1490d-f20a-497 | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -db33-4a | 7a0b-4610   | etal.v1.intro | workflow    | 7-ba81-e7bfe760ca |         |            | 13:51:17   | 13:53:13      |
| c8-b626- | -96af-09362 | spect         | execution   | fb                |         |            |            |               |
| f509e83a | 65674ca     |               |             |                   |         |            |            |               |
| 7746     |             |               |             |                   |         |            |            |               |
| 355bc308 | 9a9f0be3-0f | tripleo.barem |             |             | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -9c2d-49 | b8-4f92     | etal.v1.provi |             |                   |         |            | 13:53:15   | 13:53:27      |
| 67-8e7e- | -bc3f-0b4d0 | de_manageable |             |                   |         |            |            |               |
| 393c0389 | 82ccd90     | _nodes        |             |                   |         |            |            |               |
| 50c0     |             |               |             |                   |         |            |            |               |
| 43d70508 | 96820b49-32 | tripleo.barem | sub-        | 608c9105-fa1a-    | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -f07c-48 | 39-4197     | etal.v1.provi | workflow    | 4e32-b13a-        |         |            | 13:53:16   | 13:53:24      |
| 42-a2ff- | -9caf-a6c42 | de            | execution   | 333d9de066be      |         |            |            |               |
| 7aff0a3c | d418264     |               |             |                   |         |            |            |               |
| 579f     |             |               |             |                   |         |            |            |               |
| 7fd2a5fe | e82c37ad-   | tripleo.barem | sub-        | 89e7b777-d5a0     | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -1038-4f | 8d07-4a7b-  | etal.v1.set_n | workflow    | -4ebb-bd6f-       |         |            | 13:53:16   | 13:53:20      |
| 81-a19e- | 85cf-1140ab | ode_state     | execution   | 06c652de461a      |         |            |            |               |
| c77c0c96 | 425c9d      |               |             |                   |         |            |            |               |
| fa65     |             |               |             |                   |         |            |            |               |
| 9aa3e64b | e82c37ad-   | tripleo.barem | sub-        | 89e7b777-d5a0     | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -1323    | 8d07-4a7b-  | etal.v1.set_n | workflow    | -4ebb-bd6f-       |         |            | 13:53:16   | 13:53:20      |
| -41eb-bb | 85cf-1140ab | ode_state     | execution   | 06c652de461a      |         |            |            |               |
| b2-c3750 | 425c9d      |               |             |                   |         |            |            |               |
| e95fd75  |             |               |             |                   |         |            |            |               |
| 02d9dd3c | b33dd0c4-b8 | tripleo.plan_ |             |             | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -ccbe-48 | 10-4cde-    | management.v1 |             |                   |         |            | 14:01:30   | 14:01:37      |
| a1-ab72- | b49f-d22e90 | .update_deplo |             |                   |         |            |            |               |
| 094aa7b1 | 5560cb      | yment_plan    |             |                   |         |            |            |               |
| 6c1a     |             |               |             |                   |         |            |            |               |
| f6c95474 | b2f4ab26    | tripleo.deplo |             |             | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -5b7d-   | -7c5a-4ee2- | yment.v1.depl |             |                   |         |            | 14:01:38   | 14:01:51      |
| 441b-    | b665-7238c4 | oy_plan       |             |                   |         |            |            |               |
| b17c-102 | 19ab3b      |               |             |                   |         |            |            |               |
| fbb91191 |             |               |             |                   |         |            |            |               |
| b        |             |               |             |                   |         |            |            |               |
| 7f2a1e96 | b33dd0c4-b8 | tripleo.plan_ |             |             | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -7ce0-44 | 10-4cde-    | management.v1 |             |                   |         |            | 16:43:15   | 16:43:24      |
| d7-8af9- | b49f-d22e90 | .update_deplo |             |                   |         |            |            |               |
| a814c686 | 5560cb      | yment_plan    |             |                   |         |            |            |               |
| 51b1     |             |               |             |                   |         |            |            |               |
| e0967fc4 | b2f4ab26    | tripleo.deplo |             |             | SUCCESS | None       | 2016-09-25 | 2016-09-25    |
| -011d-42 | -7c5a-4ee2- | yment.v1.depl |             |                   |         |            | 16:43:25   | 16:43:40      |
| 36-a8ae- | b665-7238c4 | oy_plan       |             |                   |         |            |            |               |
| 53ed4e29 | 19ab3b      |               |             |                   |         |            |            |               |
| f561     |             |               |             |                   |         |            |            |               |
+----------+-------------+---------------+-------------+-------------------+---------+------------------------------------------

END UPDATE


 Due to Launchpad Bug  introspection hangs due to broken ipxe config
finally resolved on 09/01/2016  approach suggested in
TripleO manual deployment of 'master' branch by Carlo Camacho
has been retested.  As appears things in meantime have been changed. Following bellow is the way how mentioned above post worked for me right now on 32 GB VIRTHOST (i7 4790)

*****************************************
Tune stack environment on VIRTHOST
*****************************************
# useradd stack
# echo "stack:stack" | chpasswd
# echo "stack ALL=(root) NOPASSWD:ALL" | sudo tee -a /etc/sudoers.d/stack
#  chmod 0440 /etc/sudoers.d/stack
#  su - stack

***************************
Tune stack ENV
**************************
export NODE_DIST=centos7
export NODE_CPU=2
export NODE_MEM=7550
export NODE_COUNT=2
export UNDERCLOUD_NODE_CPU=2
export UNDERCLOUD_NODE_MEM=9000
export FS_TYPE=ext4

****************************************************************
Re-login to stack (highlight long line and copy if needed)
****************************************************************
 $ sudo yum -y install epel-release sudo
 $ yum -y install yum-plugin-priorities 
 $ sudo curl -o /etc/yum.repos.d/delorean.repo  http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tripleo/delorean.repo 
 $ sudo curl -o /etc/yum.repos.d/delorean-deps.repo  http://trunk.rdoproject.org/centos7/delorean-deps.repo 
 $ sudo yum install -y instack-undercloud
 $ instack-virt-setup

*********************
On instack VM
*********************
Create swap file per http://www.anstack.com/blog/2016/07/04/manually-installing-tripleo-recipe.html  :-

 #Add a 4GB swap file to the Undercloud
  sudo dd if=/dev/zero of=/swapfile bs=1024 count=4194304
  sudo mkswap /swapfile
  #Turn ON the swap file
  sudo chmod 600 /swapfile
  sudo swapon /swapfile
  #Enable it on start
  sudo echo "/swapfile   swap   swap    defaults        0 0" >> /etc/fstab

***************************
Restart instack VM
***************************

Next

  su - stack
  sudo yum -y install yum-plugin-priorities

  *************************************
  Update .bashrc under ~stack/ 
  *************************************
  export USE_DELOREAN_TRUNK=1
  export DELOREAN_TRUNK_REPO="http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tripleo/"
  export DELOREAN_REPO_FILE="delorean.repo"
  export FS_TYPE=ext4

  ************************************
  Re-login to stack
  ************************************

 $ git clone https://github.com/openstack/tripleo-heat-templates
 $ git clone https://github.com/openstack-infra/tripleo-ci.git

  $ ./tripleo-ci/scripts/tripleo.sh --repo-setup
  $ ./tripleo-ci/scripts/tripleo.sh --undercloud
  $  source stackrc
  $ ./tripleo-ci/scripts/tripleo.sh --overcloud-images
  $ ./tripleo-ci/scripts/tripleo.sh --register-nodes
  $ ./tripleo-ci/scripts/tripleo.sh --introspect-nodes

  ************************************************
  Passing step affected by mentioned bug
  ************************************************



  $ ./tripleo-ci/scripts/tripleo.sh --overcloud-deploy

  Issue at start up of Overcloud deployment


##################################################
tripleo.sh -- Overcloud create started.
##################################################
 See Launchpad bugs 1622720 1622683 status . UPDATE 09/17/2016 is providing links. Back porting patch https://review.openstack.org/gitweb?p=openstack/tripleo-common.git;a=patch;h=203460176750aeda6c0a2d39ce349ad827053b11
via rebuilding  openstack-tripleo-common-5.0.1-0.20160917031337.15c97e6.el7.centos.src.rpm && re-installing new rpm doesn't work for me.
##################################################
WARNING: openstackclient.common.utils is deprecated and will be removed after Jun 2017. Please use osc_lib.utils
WARNING: openstackclient.common.exceptions is deprecated and will be removed after Jun 2017. Please use osc_lib.exceptions
Creating Swift container to store the plan
Creating plan from template files in: /home/stack/openstack-tripleo-heat-templates/
Plan created
Deploying templates in the directory /home/stack/openstack-tripleo-heat-templates
Object GET failed: http://192.0.2.1:8080/v1/AUTH_b4438648a72446eca04d2d216261c373/overcloud/overcloud-without-mergepy.yaml 404 Not Found  [first 60 chars of response] 



  Finally overcloud gets deployed

 
  
****************************************************************************************
On instack VM  verified  https://bugs.launchpad.net/tripleo/+bug/1604770  #9
****************************************************************************************
[stack@instack ~]$ sudo su -
Last login: Thu Sep 15 16:19:07 UTC 2016 from 192.168.122.1 on pts/1
[root@instack ~]# rpm -qa \*ipxe\*
ipxe-roms-qemu-20160127-1.git6366fa7a.el7.noarch
ipxe-bootimgs-20160127-1.git6366fa7a.el7.noarch


[stack@instack ~]$ openstack stack list
WARNING: openstackclient.common.utils is deprecated and will be removed after Jun 2017. Please use osc_lib.utils
+------------------------+------------+-----------------+----------------------+--------------+
| ID                     | Stack Name | Stack Status    | Creation Time        | Updated Time |
+------------------------+------------+-----------------+----------------------+--------------+
| 7657df62-da09-4c0f-    | overcloud  | CREATE_COMPLETE | 2016-09-15T14:48:49Z | None         |
| bbdb-b9c95bdad537      |            |                 |                      |        |
+------------------------+------------+-----------------+----------------------+--------------+

[stack@instack ~]$ nova list
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| ID                                   | Name                    | Status | Task State | Power State | Networks            |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| 400e1499-5e02-4c92-a41b-814918f0edc3 | overcloud-controller-0  | ACTIVE | -          | Running     | ctlplane=192.0.2.15 |
| 58f3591f-c72f-4d97-9278-a33b3f631248 | overcloud-novacompute-0 | ACTIVE | -          | Running     | ctlplane=192.0.2.6  |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+

Managing and fixes required in overcloud

********************************************************************
Fix IP on Compute node && Open 6080 on Controller
********************************************************************

On Compute :-

[vnc]
vncserver_proxyclient_address=192.0.2.6
vncserver_listen=0.0.0.0
keymap=en-us
enabled=True
novncproxy_base_url=http://192.0.2.15:6080/vnc_auto.html <===

On Controller

Add line to /etc/sysconfig/iptables

-A INPUT -p tcp -m multiport --dports 6080 -m comment --comment "novncproxy" -m state --state NEW -j ACCEPT

Save /etc/sysconfig/iptables

#service iptables restart

[root@overcloud-controller-0 ~(keystone_admin)]# netstat -antp | grep 6080
tcp        0      0 192.0.2.15:6080         0.0.0.0:*               LISTEN      8397/python2       
tcp        1      0 192.0.2.8:56080         192.0.2.8:8080          CLOSE_WAIT  11606/gnocchi-metri
tcp        0      0 192.0.2.15:6080         192.0.2.1:47598         ESTABLISHED 28260/python2      
tcp        0      0 192.0.2.15:6000         192.0.2.15:36080        TIME_WAIT   -                  

[root@overcloud-controller-0 ~(keystone_admin)]# ps -ef | grep 8397

nova      8397     1  0 15:06 ?                 00:00:05 /usr/bin/python2 /usr/bin/nova-novncproxy --web /usr/share/novnc/
nova      28260  8397  3 17:37 ?           00:00:56 /usr/bin/python2 /usr/bin/nova-novncproxy --web /usr/share/novnc/
root       31149 23941  0 18:06 pts/0    00:00:00 grep --color=auto 8397

**********************************
Create flavors as follows
**********************************


[root@overcloud-controller-0 ~]# nova flavor-create "m2.small" 2  1000 20 1

+----+----------+-----------+------+-----------+------+-------+-------------+-----------+
| ID | Name     | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+----+----------+-----------+------+-----------+------+-------+-------------+-----------+
| 2  | m2.small | 1000      | 20   | 0         |      | 1     | 1.0         | True      |
+----+----------+-----------+------+-----------+------+-------+-------------+-----------+
[root@overcloud-controller-0 ~]# nova flavor-list
+--------------------------------------+---------------------+-----------+------+-----------+------+-------+-------------+-----------+
| ID                                   | Name                | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+--------------------------------------+---------------------+-----------+------+-----------+------+-------+-------------+-----------+
| 1                                    | 500MB Tiny Instance | 500       | 1    | 0         |      | 1     | 1.0         | True      |
| 2                                    | m2.small            | 1000      | 20   | 0         |      | 1     | 1.0         | True      |
+--------------------------------------+---------------------+-----------+------+-----------+------+-------+-------------+-----------+

[root@overcloud-controller-0 ~]# nova flavor-list
+----+---------------------+-----------+------+-----------+------+-------+-------------+-----------+
| ID | Name                | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+----+---------------------+-----------+------+-----------+------+-------+-------------+-----------+
| 1  | 500MB Tiny Instance | 500       | 1    | 0         |      | 1     | 1.0         | True      |
| 2  | m2.small            | 1000      | 20   | 0         |      | 1     | 1.0         | True      |
+----+---------------------+-----------+------+-----------+------+-------+-------------+-----------+

[root@overcloud-controller-0 ~]# glance image-list
+--------------------------------------+---------------+
| ID                                   | Name          |
+--------------------------------------+---------------+
| c9faf86d-4a06-401a-839c-c5bd48ff704a | CirrOS34Cloud |
| 4bf6f43d-8cba-43d7-9e34-347cff2d4769 | UbuntuCloud   |
| 81e031b0-11b7-440b-946f-b8f9e3a83c95 | VF24Cloud     |
+--------------------------------------+---------------+

[root@overcloud-controller-0 ~]# neutron net-list
+--------------------------------------+--------------+----------------------------------------+
| id                                   | name         | subnets                                |
+--------------------------------------+--------------+----------------------------------------+
| 2d0ccb5f-0cc8-4710-819d-7c148137aea2 | public       | 795e0fea-0550-44e8-abf3-afd316cd7843   |
|                                      |              | 192.0.2.0/24                           |
| e2a9edb9-8e01-4e99-83b2-6c6e705967fe | demo_network | 56b70753-e776-4ce8-9b28-650431b43a63   |
|                                      |              | 50.0.0.0/24                            |
+--------------------------------------+--------------+----------------------------------------+

[root@overcloud-controller-0 ~]# nova boot --flavor 2 --key-name oskey09152016 \
                                --image 81e031b0-11b7-440b-946f-b8f9e3a83c95 \
                                --nic net-id=e2a9edb9-8e01-4e99-83b2-6c6e705967fe  VF24Devs05
+--------------------------------------+--------------------------------------------------+
| Property                             | Value                                            |
+--------------------------------------+--------------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                           |
| OS-EXT-AZ:availability_zone          |                                                  |
| OS-EXT-SRV-ATTR:host                 | -                                                |
| OS-EXT-SRV-ATTR:hostname             | vf24devs05                                       |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | -                                                |
| OS-EXT-SRV-ATTR:instance_name        |                                                  |
| OS-EXT-SRV-ATTR:kernel_id            |                                                  |
| OS-EXT-SRV-ATTR:launch_index         | 0                                                |
| OS-EXT-SRV-ATTR:ramdisk_id           |                                                  |
| OS-EXT-SRV-ATTR:reservation_id       | r-psorddod                                       |
| OS-EXT-SRV-ATTR:root_device_name     | -                                                |
| OS-EXT-SRV-ATTR:user_data            | -                                                |
| OS-EXT-STS:power_state               | 0                                                |
| OS-EXT-STS:task_state                | scheduling                                       |
| OS-EXT-STS:vm_state                  | building                                         |
| OS-SRV-USG:launched_at               | -                                                |
| OS-SRV-USG:terminated_at             | -                                                |
| accessIPv4                           |                                                  |
| accessIPv6                           |                                                  |
| adminPass                            | dsFB8vrfUmv4                                     |
| config_drive                         |                                                  |
| created                              | 2016-09-15T12:01:34Z                             |
| description                          | -                                                |
| flavor                               | m2.small (2)                                     |
| hostId                               |                                                  |
| host_status                          |                                                  |
| id                                   | 212e06de-e971-428b-9e94-79dc8d91b6db             |
| image                                | VF24Cloud (81e031b0-11b7-440b-946f-b8f9e3a83c95) |
| key_name                             | oskey09152016                                    |
| locked                               | False                                            |
| metadata                             | {}                                               |
| name                                 | VF24Devs05                                       |
| os-extended-volumes:volumes_attached | []                                               |
| progress                             | 0                                                |
| security_groups                      | default                                          |
| status                               | BUILD                                            |
| tags                                 | []                                               |
| tenant_id                            | a1c9c1c1a1134384b4a496d585981aff                 |
| updated                              | 2016-09-15T12:01:34Z                             |
| user_id                              | e2383104829c45e1a3d70e11cc87d399                 |
+--------------------------------------+--------------------------------------------------+
[root@overcloud-controller-0 ~]# nova list
+--------------------------------------+-------------+--------+------------+-------------+-------------------------------------+
| ID                                   | Name        | Status | Task State | Power State | Networks                            |
+--------------------------------------+-------------+--------+------------+-------------+-------------------------------------+
| c7cea368-9602-421d-beb3-c0ed37379b57 | CirrOSDevs1 | ACTIVE | -          | Running     | demo_network=50.0.0.17, 192.0.2.104 |
| 212e06de-e971-428b-9e94-79dc8d91b6db | VF24Devs05  | BUILD  | spawning   | NOSTATE     | demo_network=50.0.0.15              |
+--------------------------------------+-------------+--------+------------+-------------+-------------------------------------+

[root@overcloud-controller-0 ~]# nova list
+--------------------------------------+-------------+--------+------------+-------------+-------------------------------------+
| ID                                   | Name        | Status | Task State | Power State | Networks                            |
+--------------------------------------+-------------+--------+------------+-------------+-------------------------------------+
| c7cea368-9602-421d-beb3-c0ed37379b57 | CirrOSDevs1 | ACTIVE | -          | Running     | demo_network=50.0.0.17, 192.0.2.104 |
| 212e06de-e971-428b-9e94-79dc8d91b6db | VF24Devs05  | ACTIVE | -          | Running     | demo_network=50.0.0.15              |
+--------------------------------------+-------------+--------+------------+-------------+-------------------------------------


  
Another option activate vlan10 following
http://bderzhavets.blogspot.com/2016/07/stable-mitaka-ha-instack-virt-setup.html
and instead of  `./tripleo-ci/scripts/tripleo.sh --overcloud-deploy`
run following deployment with network isolation activated :-

$touch -f  /home/stack/tripleo-heat-templates/puppet/post.yaml

 #!/bin/bash -x
 source /home/stack/stackrc
  openstack overcloud deploy \
--control-scale 1 --compute-scale 1 \
--libvirt-type qemu \
--ntp-server pool.ntp.org \
--templates /home/stack/tripleo-heat-templates \
-e /home/stack/tripleo-heat-templates/overcloud-resource-registry-puppet.yaml \
-e  /home/stack/tripleo-heat-templates/environments/network-isolation.yaml \
-e  /home/stack/tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml \
-e  $HOME/network_env.yaml


*****************************************************************
One more sample (no network isolation) :-
*****************************************************************
$touch -f  /home/stack/tripleo-heat-templates/puppet/post.yaml

$ cat deploy.sh
#!/bin/bash -x
source /home/stack/stackrc
openstack overcloud deploy \
  --libvirt-type qemu \
  --ntp-server pool.ntp.org \
  --templates /home/stack/tripleo-heat-templates \
  -e /home/stack/tripleo-heat-templates/overcloud-resource-registry-puppet.yaml \
  --control-scale 1 --compute-scale 2

[stack@instack ~]$ ./deploy.sh
+ openstack overcloud deploy --libvirt-type qemu --ntp-server pool.ntp.org --templates /home/stack/tripleo-heat-templates -e /home/stack/tripleo-heat-templates/overcloud-resource-registry-puppet.yaml --control-scale 1 --compute-scale 2
WARNING: openstackclient.common.utils is deprecated and will be removed after Jun 2017. Please use osc_lib.utils
WARNING: openstackclient.common.exceptions is deprecated and will be removed after Jun 2017. Please use osc_lib.exceptions
Creating Swift container to store the plan
Creating plan from template files in: /home/stack/tripleo-heat-templates
Plan created
Deploying templates in the directory /home/stack/tripleo-heat-templates
Object GET failed: http://192.0.2.1:8080/v1/AUTH_c79b54306a9044448b871f489749adef/overcloud/overcloud-without-mergepy.yaml 404 Not Found  [first 60 chars of response]
2016-09-17 19:15:50Z [overcloud]: CREATE_IN_PROGRESS  Stack CREATE started
2016-09-17 19:15:50Z [HorizonSecret]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:50Z [RabbitCookie]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:50Z [PcsdPassword]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:51Z [Networks]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:51Z [MysqlRootPassword]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:51Z [HeatAuthEncryptionKey]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:51Z [ServiceNetMap]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:51Z [overcloud-Networks-abtd3qkalqzy]: CREATE_IN_PROGRESS  Stack CREATE started
2016-09-17 19:15:51Z [ExternalNetwork]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:51Z [NetworkExtraConfig]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:51Z [StorageNetwork]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:51Z [ManagementNetwork]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:51Z [StorageMgmtNetwork]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:51Z [TenantNetwork]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:51Z [InternalNetwork]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:15:51Z [InternalNetwork]: CREATE_COMPLETE  state changed
2016-09-17 19:15:51Z [NetworkExtraConfig]: CREATE_COMPLETE  state changed
2016-09-17 19:15:51Z [StorageMgmtNetwork]: CREATE_COMPLETE  state changed
2016-09-17 19:15:51Z [ExternalNetwork]: CREATE_COMPLETE  state changed
2016-09-17 19:15:51Z [StorageNetwork]: CREATE_COMPLETE  state changed
2016-09-17 19:15:51Z [ManagementNetwork]: CREATE_COMPLETE  state changed
2016-09-17 19:15:51Z [HorizonSecret]: CREATE_COMPLETE  state changed
2016-09-17 19:15:51Z [TenantNetwork]: CREATE_COMPLETE  state changed
2016-09-17 19:15:51Z [RabbitCookie]: CREATE_COMPLETE  state changed
2016-09-17 19:15:51Z [overcloud-Networks-abtd3qkalqzy]: CREATE_COMPLETE  Stack CREATE completed successfully

. . . . . . .

2016-09-17 19:41:31Z [ObjectStorageExtraConfigPost]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:41:31Z [ControllerExtraConfigPost]: CREATE_IN_PROGRESS  state changed
2016-09-17 19:41:32Z [BlockStorageExtraConfigPost]: CREATE_COMPLETE  state changed
2016-09-17 19:41:32Z [CephStorageExtraConfigPost]: CREATE_COMPLETE  state changed
2016-09-17 19:41:32Z [ControllerExtraConfigPost]: CREATE_COMPLETE  state changed
2016-09-17 19:41:32Z [ComputeExtraConfigPost]: CREATE_COMPLETE  state changed
2016-09-17 19:41:32Z [ObjectStorageExtraConfigPost]: CREATE_COMPLETE  state changed
2016-09-17 19:41:32Z [overcloud-AllNodesDeploySteps-z3cb4xbleprv]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-09-17 19:41:33Z [AllNodesDeploySteps]: CREATE_COMPLETE  state changed
2016-09-17 19:41:33Z [overcloud]: CREATE_COMPLETE  Stack CREATE completed successfully

 Stack overcloud CREATE_COMPLETE

Overcloud Endpoint: http://192.0.2.13:5000/v2.0
Overcloud Deployed
[stack@instack ~]$ nova list
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| ID                                   | Name                    | Status | Task State | Power State | Networks            |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| 53d60a0c-d4fe-48fd-af78-fbc16c59bd5e | overcloud-controller-0  | ACTIVE | -          | Running     | ctlplane=192.0.2.15 |
| 098344d1-d403-40a7-8f20-6e417c132884 | overcloud-novacompute-0 | ACTIVE | -          | Running     | ctlplane=192.0.2.12 |
| 3dc3338f-c6e4-47b8-8b30-08fe45053e43 | overcloud-novacompute-1 | ACTIVE | -          | Running     | ctlplane=192.0.2.8  |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+

Not Found

The resource could not be found.<
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1647, in _retry
    service_token=self.service_token, **kwargs)
  File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1139, in get_object
    raise ClientException.from_response(resp, 'Object GET failed', body)
ClientException: Object GET failed: http://192.0.2.1:8080/v1/AUTH_7ea6220c67c84c828f4249b95886259f/overcloud/overcloud-without-mergepy.yaml 404 Not Found  [first 60 chars of response]

Not Found

The resource could not be found.<
Started Mistral Workflow. Execution ID: 807a7047-a1c3-4686-9be7-11d73e72dfb8
2016-09-23 09:15:34Z [overcloud]: CREATE_IN_PROGRESS  Stack CREATE started
2016-09-23 09:15:34Z [HorizonSecret]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:34Z [RabbitCookie]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:35Z [ServiceNetMap]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:35Z [MysqlRootPassword]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:35Z [HeatAuthEncryptionKey]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:35Z [PcsdPassword]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:35Z [Networks]: CREATE_IN_PROGRESS  state changed
2016-09-23 09:15:35Z [ServiceNetMap]: CREATE_COMPLETE  state changed
2016-09-23 09:15:35Z [RabbitCookie]: CREATE_COMPLETE  state changed
2016-09-23 09:15:35Z [HeatAuthEncryptionKey]: CREATE_COMPLETE  state changed
2016-09-23 09:15:35Z [PcsdPassword]: CREATE_COMPLETE  state changed
2016-09-23 09:15:35Z [HorizonSecret]: CREATE_COMPLETE  state changed


END UPDATE