[oslo] No complains about rabbitmq SSL problems: could we have this in the logs?

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

[oslo] No complains about rabbitmq SSL problems: could we have this in the logs?

Thomas Goirand
Hi,

It took me a long long time to figure out that my SSL setup was wrong
when trying to connect Heat to rabbitmq over SSL. Unfortunately, Oslo
(or heat itself) never warn me that something was wrong, I just got
nothing working, and no log at all.

I'm sure I wouldn't be the only one happy about having this type of
problems being yelled out loud in the logs. Right now, it does work if I
turn off SSL, though I'm still not sure what's wrong in my setup, and
I'm given no clue if the issue is on rabbitmq-server or on the client
side (ie: heat, in my current case).

Just a wishlist... :)
Cheers,

Thomas Goirand (zigo)

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: [hidden email]?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Reply | Threaded
Open this post in threaded view
|

Re: [oslo] No complains about rabbitmq SSL problems: could we have this in the logs?

Mohammed Naser
For what it’s worth: I ran into the same issue.  I think the problem lies a bit deeper because it’s a problem with kombu as when debugging I saw that Oslo messaging tried to connect and hung after.

Sent from my iPhone

> On Oct 31, 2018, at 2:29 PM, Thomas Goirand <[hidden email]> wrote:
>
> Hi,
>
> It took me a long long time to figure out that my SSL setup was wrong
> when trying to connect Heat to rabbitmq over SSL. Unfortunately, Oslo
> (or heat itself) never warn me that something was wrong, I just got
> nothing working, and no log at all.
>
> I'm sure I wouldn't be the only one happy about having this type of
> problems being yelled out loud in the logs. Right now, it does work if I
> turn off SSL, though I'm still not sure what's wrong in my setup, and
> I'm given no clue if the issue is on rabbitmq-server or on the client
> side (ie: heat, in my current case).
>
> Just a wishlist... :)
> Cheers,
>
> Thomas Goirand (zigo)
>
> __________________________________________________________________________
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: [hidden email]?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: [hidden email]?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Reply | Threaded
Open this post in threaded view
|

Re: [oslo] No complains about rabbitmq SSL problems: could we have this in the logs?

Thomas Goirand
On 10/31/18 2:40 PM, Mohammed Naser wrote:

> For what it’s worth: I ran into the same issue.  I think the problem lies a bit deeper because it’s a problem with kombu as when debugging I saw that Oslo messaging tried to connect and hung after.
>
> Sent from my iPhone
>
>> On Oct 31, 2018, at 2:29 PM, Thomas Goirand <[hidden email]> wrote:
>>
>> Hi,
>>
>> It took me a long long time to figure out that my SSL setup was wrong
>> when trying to connect Heat to rabbitmq over SSL. Unfortunately, Oslo
>> (or heat itself) never warn me that something was wrong, I just got
>> nothing working, and no log at all.
>>
>> I'm sure I wouldn't be the only one happy about having this type of
>> problems being yelled out loud in the logs. Right now, it does work if I
>> turn off SSL, though I'm still not sure what's wrong in my setup, and
>> I'm given no clue if the issue is on rabbitmq-server or on the client
>> side (ie: heat, in my current case).
>>
>> Just a wishlist... :)
>> Cheers,
>>
>> Thomas Goirand (zigo)

I've opened a bug here:

https://bugs.launchpad.net/oslo.messaging/+bug/1801011

Cheers,

Thomas Goirand (zigo)

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: [hidden email]?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Reply | Threaded
Open this post in threaded view
|

Re: [oslo] No complains about rabbitmq SSL problems: could we have this in the logs?

Ken Giusti
Hi,

There does seem to be something currently wonky with SSL & oslo.messaging.   I'm looking into it now.

And there's this recently reported issue:


In the above bug something seems to have broken SSL between ocata and pike.  The current suspected change is a patch that fixed a threading issue.

Stay tuned...


On Thu, Nov 1, 2018 at 3:53 AM Thomas Goirand <[hidden email]> wrote:
On 10/31/18 2:40 PM, Mohammed Naser wrote:
> For what it’s worth: I ran into the same issue.  I think the problem lies a bit deeper because it’s a problem with kombu as when debugging I saw that Oslo messaging tried to connect and hung after.
>
> Sent from my iPhone
>
>> On Oct 31, 2018, at 2:29 PM, Thomas Goirand <[hidden email]> wrote:
>>
>> Hi,
>>
>> It took me a long long time to figure out that my SSL setup was wrong
>> when trying to connect Heat to rabbitmq over SSL. Unfortunately, Oslo
>> (or heat itself) never warn me that something was wrong, I just got
>> nothing working, and no log at all.
>>
>> I'm sure I wouldn't be the only one happy about having this type of
>> problems being yelled out loud in the logs. Right now, it does work if I
>> turn off SSL, though I'm still not sure what's wrong in my setup, and
>> I'm given no clue if the issue is on rabbitmq-server or on the client
>> side (ie: heat, in my current case).
>>
>> Just a wishlist... :)
>> Cheers,
>>
>> Thomas Goirand (zigo)

I've opened a bug here:

https://bugs.launchpad.net/oslo.messaging/+bug/1801011

Cheers,

Thomas Goirand (zigo)

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@...?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


--
Ken Giusti  ([hidden email])

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: [hidden email]?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Reply | Threaded
Open this post in threaded view
|

Re: [oslo] No complains about rabbitmq SSL problems: could we have this in the logs?

Ken Giusti
In reply to this post by Mohammed Naser
Hi Mohammed,

What release of openstack are you using?  (ocata, pike, etc)

Also just to confirm my understanding:  you do see the SSL connections come up, but after some time they 'hang' - what do you mean by 'hang'?  Do the connections drop?  Or do the connections remain up but you start seeing messages (RPC calls) time out?

thanks,

On Wed, Oct 31, 2018 at 9:40 AM Mohammed Naser <[hidden email]> wrote:
For what it’s worth: I ran into the same issue.  I think the problem lies a bit deeper because it’s a problem with kombu as when debugging I saw that Oslo messaging tried to connect and hung after.

Sent from my iPhone

> On Oct 31, 2018, at 2:29 PM, Thomas Goirand <[hidden email]> wrote:
>
> Hi,
>
> It took me a long long time to figure out that my SSL setup was wrong
> when trying to connect Heat to rabbitmq over SSL. Unfortunately, Oslo
> (or heat itself) never warn me that something was wrong, I just got
> nothing working, and no log at all.
>
> I'm sure I wouldn't be the only one happy about having this type of
> problems being yelled out loud in the logs. Right now, it does work if I
> turn off SSL, though I'm still not sure what's wrong in my setup, and
> I'm given no clue if the issue is on rabbitmq-server or on the client
> side (ie: heat, in my current case).
>
> Just a wishlist... :)
> Cheers,
>
> Thomas Goirand (zigo)
>
> __________________________________________________________________________
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: OpenStack-dev-request@...?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@...?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


--
Ken Giusti  ([hidden email])

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: [hidden email]?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev