Repository: ansible-collections/community.general

Issue:
 Ansible: cannot connect to the LXD server (due to python version) #79473 
### Summary

the lxd inventory plugin (and also molecule with lxd but that is another topic) does not work with python > 3.9.

python 3.10 breaks the LXD module due to SSL verification errors.

### Issue Type

Bug Report

### Component Name

lxd inventory plugin (and also molecule_lxd, but that is another topic).

### Ansible Version

```console (paste below)
$ ansible --version
ansible [core 2.11.11]
  config file = None
  configured module search path = ['/home/sun/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /home/sun/.local/lib/python3.8/site-packages/ansible
  ansible collection location = /home/sun/.ansible/collections:/usr/share/ansible/collections
  executable location = /home/sun/.local/bin/ansible
  python version = 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0]
  jinja version = 3.1.2
  libyaml = True
```


### Community.general Version

```console (paste below)
$ ansible-galaxy collection list community.general

Collection        Version
----------------- -------
community.general 6.0.1


Collection        Version
----------------- -------
community.general 3.8.1
```


### Configuration

```console (paste below)
$ ansible-config dump --only-changed
ANSIBLE_FORCE_COLOR(env: ANSIBLE_FORCE_COLOR) = True
```


### OS / Environment

any OS with python 3.10

### Steps to Reproduce
start a new LXD container with alpine 3.16.
```
lxc launch images:alpine/3.16 a1
```
install python3 (will install python 3.10):
```
lxc shell a1
apk update
apk add python3
```
run a simple lxd inventory plugin or molecule, or anything that uses lxd connection plugin and it will throw an error that it cannot connect to the remote LXD server.

but now do the above steps with alpine 3.15 (which only has python 3.9.15) and everything will work.

the inventory plugin can be used like this. create a lxd.yml in your inventory folder:
```yaml (paste below)
plugin: community.general.lxd
url: https://LXDREMOTEIP_HERE:8443
type_filter: both
```


### Expected Results

no error

### Actual Results

```console (paste below)
LXDRaiseException("cannot connect to LXD server").
```


### Code of Conduct

- [X] I agree to follow the Ansible Code of Conduct


Discussion:
Files identified in the description:
* `lib/ansible/plugins/inventory`

If these files are incorrect, please update the `component name` section of the description or use the `!component` bot command.

[click here for bot help](https://github.com/ansible/ansibullbot/blob/devel/ISSUE_HELP.md)
<!--- boilerplate: components_banner --->
unfortunately, it's been months I debugged this. otherwise I would smash you guys with code blocks and the solution to this. I know this is a poor bug report.

anyway, iirc it had something to do with the change of the ssl context in python 3.10. and you had to use ssl._create_default_https_context = ssl._create_unverified_context to make it work or something related to that. cant remember anymore.

but it was a really easy fix for me back then. basically, python 3.10 wants to sslverify the remote LXD's cert, and can't (since it is a self-signed cert), then gives up and throws an exception.

anyway, Im using alpine/3.15 for my ansible environments since then and have no problem with this bug anymore.

but since I didnt see anyone mention this bug that it is actually due to python 3.10, I thought I should mention it for future people coming from google etc.

so, you have any "cannot connect to LXD server", no matter if you're using the lxd inventory plugin or molecule with the molecule_lxd module? just get rid of python 3.10 and install python 3.9.15 and that will fix the problem.


!component =plugins/inventory/lxd.py
Files identified in the description:
* [`plugins/inventory/lxd.py`](https://github.com/ansible-collections/community.general/blob/main/plugins/inventory/lxd.py)

If these files are incorrect, please update the `component name` section of the description or use the `!component` bot command.

[click here for bot help](https://github.com/ansible/ansibullbot/blob/devel/ISSUE_HELP.md)
<!--- boilerplate: components_banner --->
cc @conloos
[click here for bot help](https://github.com/ansible/ansibullbot/blob/devel/ISSUE_HELP.md)
<!--- boilerplate: notify --->
I don't see any code that disables certificate validation in the existing code. So why do you need to disable certificate validation (which is something really dangerous!) to get this working? It sounds to me like there's another underlying problem you are working around by simply disabling certificate validation.
> I don't see any code that disables certificate validation in the existing code. So why do you need to disable certificate validation (which is something really dangerous!) to get this working? It sounds to me like there's another underlying problem you are working around by simply disabling certificate validation.

because - like I said - it is a private cert. especially when working with LXD. lxd generates a self-signed cert. and the python lib (whatever is used, Im not into python really), I guess it is the ssl lib, doesnt like self-signed certs.

I disabled the ssl_verify back then, because of the self-signed cert. not because I didnt want to verify a cert in general. it is the very special case of a **self-signed** cert verification that fails. I didnt know any other way around back then, so I just disabled it completely.
I don't see why this should change between Python 3.9 and Python 3.10. Self-signed certificates should never have been accepted.
I dont know. see this bug for example: https://bugs.gentoo.org/show_bug.cgi?id=835498

and see the commit that fixed that issue. it has something to do with `ssl.create_default_context()`.
`This works just fine with Python3.9 and below. But with Python3.10 I get...`

he discovered the same thing like me.
here is another example, with a similar solution:
https://stackoverflow.com/questions/35569042/ssl-certificate-verify-failed-with-python3/69724616#69724616

the web is full with questions regarding this. and all relates to python 3.10. everything < 3.10 works just fine.
Hello @all,

first thanks to: @omani for sharing that informations.

I took a look and I used code/utils at the inventory Plugin, which probably goes back to the early days of lxd implementations.
The code for opening the lxd-connections and certificate management is under: 
community.general/module_utils/lxd.py

If I see it correctly these functions are used in a lot of modules:

- inventory/lxd.py
- modules/lxd_container.py
- modules/lxd_profile.py
- modules/lxd_project.py

So i will go deeper to fix that problem but i have to build a testlab first.

Thanks Frank
> Self-signed certificates should never have been accepted.

The [default location](https://docs.ansible.com/ansible/latest/collections/community/general/lxd_container_module.html#parameter-client_cert)  of the client certificate implies the *authentication flow* described in [lxd docu](https://linuxcontainers.org/lxd/docs/master/howto/server_expose/#authenticate-with-the-lxd-server) .  
Following that method , all certificates in .config/lxc/servercerts/ could be trusted. 

*IMHO a lot better than explaining users, that lxd default authentication just is not secure and they should acknowledge that by setting validate_certs=false and feel guilty about it.*  

This approach to fixing the bug suggests the enhancement  **server_cert**  (in a 2nd PR perhaps?). 
* defaults to url if https .

@heino You probably invested significant effort in the *pyLXD / validate_certs=false* route. Do You see a place for that approach in Your work ?   From a first sight on read-the-docs it looks  like manageable effort:  

```python
client = Client(
endpoint='http://10.0.0.1:8443',
cert=('/path/to/client.crt', '/path/to/client.key'),
verify='/path/to/server.crt')
```





I just ran into a connection issue with a LXD using a SSL certificate issued by letsencrypt. Got the same output as reported in this issue:
```
LXDRaiseException("cannot connect to LXD server").
```

When i looked at the actual error it was:
```
Cannot create a client socket with a PROTOCOL_TLS_SERVER context (_ssl.c:801)
```

After some digging i found https://github.com/python/cpython/issues/96972 and [this line](https://github.com/ansible-collections/community.general/blob/b1d9507cd2986cc2f3e9d918a56477ef2eba3d1f/plugins/module_utils/lxd.py#L63).

After changing
```
            ctx = ssl.create_default_context(ssl.Purpose.CLIENT_AUTH)
```
to
```
            ctx = ssl.create_default_context(ssl.Purpose.SERVER_AUTH)
```

My connection is working just fine.

I'm using `Python 3.10.9`
Yes, it sounds like `Purpose.SERVER_AUTH` (the actual default value) is the correct value.
I created a PR for @Spunge's solution: #6034.

Resolving patch:
diff --git a/plugins/module_utils/lxd.py b/plugins/module_utils/lxd.py
--- a/plugins/module_utils/lxd.py
+++ b/plugins/module_utils/lxd.py
@@ -60,7 +60,7 @@ def __init__(self, url, key_file=None, cert_file=None, debug=False):
             self.cert_file = cert_file
             self.key_file = key_file
             parts = generic_urlparse(urlparse(self.url))
-            ctx = ssl.create_default_context(ssl.Purpose.CLIENT_AUTH)
+            ctx = ssl.create_default_context(ssl.Purpose.SERVER_AUTH)
             ctx.load_cert_chain(cert_file, keyfile=key_file)
             self.connection = HTTPSConnection(parts.get('netloc'), context=ctx)
         elif url.startswith('unix:'):


Test patch: