The winds of change in cloud operations, and why integrations like NSX Data Center 3.2 + Advanced Load Balancer are important
Tags: avi, datacenternetworking, loadbalancing, nsxt
Published: 2021-12-26 19:42:59

---
title: The winds of change in cloud operations, and why integrations like NSX Data Center 3.2 + Advanced Load Balancer are important
published: true
date: 2021-12-26 09:00:00 UTC
tags: Avi,DatacenterNetworking,LoadBalancing,NSXT
canonical_url: https://blog.engyak.co/2021/12/the-winds-of-change-in-cloud-operations.html
---

### The Jetstreams

Cloud operators now provide two completely different classes of service to customers:

- Self-Service, VMs, Operating System Templates

  - Generally mature, some private cloud operators are smoothing out CMPs or such, but work as intended from a customer perspective   
  - Bringup is automated
  - Operating System level configuration is usually automated
  - Application-level configuration is not always automated or managed as code
  - **Cloud Provider typically will hold responsibility for a widget working**   
- Containers, Service Definitions, no GUI

  - Kubernetes fits squarely here, but other services exist
  - Not the most customer friendly, nascent 
  - **Application Owner has to hold responsibility for a widget working**

### Infrastructure Engineers as Agents of Change  

The industry cannot transition responsibility for "stuff working" to creative types (Web Developers, App Developers). Have you ever heard "it's the network"? How about "This must be a <issue I'm not responsible for>"?

This is a call for help. Once the current trends with Automation and reliability engineering slow down (Type 1 above), the second kind of automation is going to necessitate leveraging infrastructure expertise elsewhere. Services like Kubernetes both require a "distribution" of sorts, but there's nobody to blame when something fails to deploy.

### Why This Matters  

NSX-T's 3.2 release has provided a **ton** of goodies, with an emphasis on centralized management and provisioning. We're starting to see tools that will potentially support multiple inbound declarative interfaces to achieve similar types of work, and NSX Data Center Manager has all the right moving parts to provide that.

NSX ALB's Controller interface provides comprehensive self-service and troubleshooting information, and a "Lite" service portal.

NSX Datacenter + ALB presents a really unique value set, with one **provisioning point** for all services, in addition to the previously provided Layer 3 fabric integration. It's good to see this type of write-many implementation

### Let's try it out!

First, let's cover some prerequisites (detailed list here: [https://docs.vmware.com/en/VMware-NSX-T-Data-Center/3.2/installation/GUID-3D1F107D-15C0-423B-8E79-68498B757779.html](https://docs.vmware.com/en/VMware-NSX-T-Data-Center/3.2/installation/GUID-3D1F107D-15C0-423B-8E79-68498B757779.html)):

- Greenfield Deployment only. This doesn't allow you to pick up existing NSX ALB installations
- NSX ALB version 20.1.7+ or 21.1.2+ OVA  
- NSX Data Center 3.2.0+
- NSX ALB and NSX Data Center controllers must exist on the same subnet
- NSX Data Center and NSX ALB clusters should have a vIP configured
- **...it also can't support third party CAs**   

Once these are met,[the usual prerequisites](https://avinetworks.com/docs/21.1/avi-nsx-t-integration/) also matter. 

Deployment is extremely straightforward, and managed under **System -> Appliances**. This wizard will require you to upload the OVA, so get that rolling before filling out any forms:

[![](https://blogger.googleusercontent.com/img/a/AVvXsEiiNqyV2npjKGK6RiAqLDNAp1LQgYqAG4CbUkQk2E80BBz4YyKZvacF-xs6s78smcH2VYi3n5qGAZtTz-1NPFDv16PLcMyLU0tNJqzLOvMFGaXWIdmiQASE6pOS_w5mCL_XVKcX91xW3KmSKnwm8ELH7-10D8gAJQ4QPGG4seNb15HvJ6R02FhUJ24x=w838-h777)](https://blogger.googleusercontent.com/img/a/AVvXsEiiNqyV2npjKGK6RiAqLDNAp1LQgYqAG4CbUkQk2E80BBz4YyKZvacF-xs6s78smcH2VYi3n5qGAZtTz-1NPFDv16PLcMyLU0tNJqzLOvMFGaXWIdmiQASE6pOS_w5mCL_XVKcX91xW3KmSKnwm8ELH7-10D8gAJQ4QPGG4seNb15HvJ6R02FhUJ24x=s1061)
  

[![](https://blogger.googleusercontent.com/img/a/AVvXsEhE0ZNSnBkiJvs7z5Vc770PtfQdL6xduE4MVHDzUDpZFk8K9-K6yNSsfDTfN0oHlKvypZ-ShtQzwmYIdDAkZxcDD8kSMrSTvYfgIBG79yeHesyQ-W1WOwspbBUmPoZo0ZZy_TH2b8_BCBaXTQKG7gySYmBHTzfwRhmpgAY1zVdfl6UFPB6YZTrMyWaI=w837-h781)](https://blogger.googleusercontent.com/img/a/AVvXsEhE0ZNSnBkiJvs7z5Vc770PtfQdL6xduE4MVHDzUDpZFk8K9-K6yNSsfDTfN0oHlKvypZ-ShtQzwmYIdDAkZxcDD8kSMrSTvYfgIBG79yeHesyQ-W1WOwspbBUmPoZo0ZZy_TH2b8_BCBaXTQKG7gySYmBHTzfwRhmpgAY1zVdfl6UFPB6YZTrMyWaI=s1055)
The NSX Manager will take care of the VM deployment for you. Interestingly enough, this will allow us to potentially get rid of tools like PyVmOmi and let us deploy everything with Ansible/Terraform someday.  

[![](https://blogger.googleusercontent.com/img/a/AVvXsEgWG1sNA8LxledDVHyfnYPzOFwoL_SuZ1OuefNAykYG3VWKGEI7D1RhVtn_fxmh203WIPhooZQItLKhXiJgU1DJGv0orH0n4GbrBs3ekS0p5Z0VtuE3K2nxpFvMZ_tFk7h1vZ0qTFMIye2h-Z0BBrdQ_eOkratB8OiOihojyzPzkA2YuVbwGU5Ub5qE=w693-h442)](https://blogger.googleusercontent.com/img/a/AVvXsEgWG1sNA8LxledDVHyfnYPzOFwoL_SuZ1OuefNAykYG3VWKGEI7D1RhVtn_fxmh203WIPhooZQItLKhXiJgU1DJGv0orH0n4GbrBs3ekS0p5Z0VtuE3K2nxpFvMZ_tFk7h1vZ0qTFMIye2h-Z0BBrdQ_eOkratB8OiOihojyzPzkA2YuVbwGU5Ub5qE=s716)

Once it's done deploying **the first appliance** , it'll report a "Degraded" state until 3 controllers are deployed.

[![](https://blogger.googleusercontent.com/img/a/AVvXsEjWLGbvIeTd_VYGLZO9Je_jkoYHHB3LPJqPi9kEZNrMP58PrSD4ChwB1gNKuoiepMAE2x7qUOMJINu1uGFBD4tZuMGwDkIzYc9NphL7xkstwUb0xOuCd_oN242FjjIIOx54gav80AXapfbz9q4ltOpulBpCT8TLBdgLOr9KwJcMa0VsRgbzOMHpk4AZ=w729-h435)](https://blogger.googleusercontent.com/img/a/AVvXsEjWLGbvIeTd_VYGLZO9Je_jkoYHHB3LPJqPi9kEZNrMP58PrSD4ChwB1gNKuoiepMAE2x7qUOMJINu1uGFBD4tZuMGwDkIzYc9NphL7xkstwUb0xOuCd_oN242FjjIIOx54gav80AXapfbz9q4ltOpulBpCT8TLBdgLOr9KwJcMa0VsRgbzOMHpk4AZ=s1124)

Once installed, the NSX ALB objects should appear under **Networking -> Advanced Load Balancer** :

[![](https://blogger.googleusercontent.com/img/a/AVvXsEifuyZ1JYaVBkGYDqzCPkmyeh5gJ-jN7Wpg8tQDY0TcGTpsq_VlFwh1bdRvnZ6Zeb0O_nfUrYOIxQWm9PZFgbfDXTqJ-n1mji-nuaA1zcTyTRWbgFFPzwBa_esaRfe3KMXXw_ejIqh2Q9dKrl18bumCdCLkyQxvpsfoWxGGqT0PPQI-3nV9hnrlCTv-=w834-h417)](https://blogger.googleusercontent.com/img/a/AVvXsEifuyZ1JYaVBkGYDqzCPkmyeh5gJ-jN7Wpg8tQDY0TcGTpsq_VlFwh1bdRvnZ6Zeb0O_nfUrYOIxQWm9PZFgbfDXTqJ-n1mji-nuaA1zcTyTRWbgFFPzwBa_esaRfe3KMXXw_ejIqh2Q9dKrl18bumCdCLkyQxvpsfoWxGGqT0PPQI-3nV9hnrlCTv-=s1434)

At this point, NSX Datacenter -> NSX ALB is integrated, but not ALB -> Data Center. The next step is to configure an NSX-T cloud. I've covered the procedure for configuring an NSX-T cloud here: [https://blog.engyak.co/2021/09/vmware-nsx-alb-avi-networks-and-nsx-t.html](https://blog.engyak.co/2021/09/vmware-nsx-alb-avi-networks-and-nsx-t.html)

**Note:** Using a non-default CA Certificate for NSX ALB here will break the integration. It can be reverted back by reverting the certificate, and there doesn't appear to be an obvious way to change that yet. A Principal Identity is formed for the connection between systems, indicating that the feature is just not fully exposed to users yet.

### Viewing Services

A cursory review of the new ALB section indicates that existing vIPs don't appear via the ALB GUI, but the inverse is true. Let's try and build one for Jenkins! The constructs are essentially the same as with the ALB UI, but the process is **considerably simpler:**

 

First, create a vIP   

[![](https://blogger.googleusercontent.com/img/a/AVvXsEgbC14jvaZ76ZJE0oHfG6YqMgWaVMf3S8wNGIuv3jN1sQY3ImOMIWQ2Nzrcpok5K9uF-E0AfYK0z10Hcy7vtzAK4hm30--MpW34ttJr0Kooex88lTtIJMz_TJIBSvWLTpkl54XY2Yt0MS8HHgd5EirwnvKUjURDOQa6rdG0y7xrJaacYaOCCL8g1OYe=w640-h238)](https://blogger.googleusercontent.com/img/a/AVvXsEgbC14jvaZ76ZJE0oHfG6YqMgWaVMf3S8wNGIuv3jN1sQY3ImOMIWQ2Nzrcpok5K9uF-E0AfYK0z10Hcy7vtzAK4hm30--MpW34ttJr0Kooex88lTtIJMz_TJIBSvWLTpkl54XY2Yt0MS8HHgd5EirwnvKUjURDOQa6rdG0y7xrJaacYaOCCL8g1OYe=s1114)
Then, create the pool:  

[![](https://blogger.googleusercontent.com/img/a/AVvXsEjwBuhuDAjIeGdwWzXG6GF9nYjE6Y9YaBlulizvW07GyCZ6FXra9o4J_VXP5d7Juxb6KlRTrzLONnTnbfZl5PTsV4r1ZFm19AOo3bTZjNUkf87-RTOQKxjaBb-RmW2XLAa9R0bsIiZdFnyI4usF5ZkNPMakvXcJbCDLk2b8BV0rbN0Rv2_nRAlfo8dm=w640-h414)](https://blogger.googleusercontent.com/img/a/AVvXsEjwBuhuDAjIeGdwWzXG6GF9nYjE6Y9YaBlulizvW07GyCZ6FXra9o4J_VXP5d7Juxb6KlRTrzLONnTnbfZl5PTsV4r1ZFm19AOo3bTZjNUkf87-RTOQKxjaBb-RmW2XLAa9R0bsIiZdFnyI4usF5ZkNPMakvXcJbCDLk2b8BV0rbN0Rv2_nRAlfo8dm=s1119)

Finally, we will create the virtual service. **Note:** _nullPointerException_ seems to mean that the SE Group is incorrect, and may need to be manually resolved on the ALB controller.

Unlike most VMware products, NSX Data Center seems to handle multi-write (changes from **BOTH** the ALB and the Manager) fairly well.

[![](https://blogger.googleusercontent.com/img/a/AVvXsEgckBBDMrKfgPpjb87dJab-wRSRPrw8HEnyqz-bR2ieFINhUXtvxm2mUiiNrEqjIA0md30LW1wmxNWxnBz9vdfo9P-4bRbZPXFKkABjGywleqgoZQhkZJdZ_GNhHJA052OlG2md_gHGH_VbhJWZDoIKC-v3fPUX3ggpv_gkXG-Bqeb2Dl6zAdnq7u3T=w640-h418)](https://blogger.googleusercontent.com/img/a/AVvXsEgckBBDMrKfgPpjb87dJab-wRSRPrw8HEnyqz-bR2ieFINhUXtvxm2mUiiNrEqjIA0md30LW1wmxNWxnBz9vdfo9P-4bRbZPXFKkABjGywleqgoZQhkZJdZ_GNhHJA052OlG2md_gHGH_VbhJWZDoIKC-v3fPUX3ggpv_gkXG-Bqeb2Dl6zAdnq7u3T=s1008)

That's it!

Footnote: To use custom TLS profiles, it must be invoked via the API **only.** I am building a method to manage that here: [https://github.com/ngschmidt/python-restify/tree/main/nsx-t/profiles/tls](https://github.com/ngschmidt/python-restify/tree/main/nsx-t/profiles/tls)