Author Topic: [SOLVED] Login webadmin zentyal 7.x  (Read 4421 times)

cingo_5

  • Zen Apprentice
  • *
  • Posts: 5
  • Karma: +0/-0
    • View Profile
[SOLVED] Login webadmin zentyal 7.x
« on: July 19, 2024, 02:18:02 pm »
Hi

I manage about 70 zentyal systems and from today, i can't login in every zentyal 7.x dashboard.
it return 504 Gateway Time-out from nginx

zentyal.webadmin-nginx and zentyal.webadmin-uwsgi are up and running

no problem with zentyal 8.x

the problem started for all of them this morning, and the only thing in common is version 7.x

I tried to investigate and I see that during the login phase, requests are made to a public IP 3.121.107.3 so I tried to disable any traffic other than the LAN from the IP of the Zentyal machine but I still received the nginx timeout.
I finally disconnected the network cable from the machine and the console now opens...

is it possible there is something related to the crowdsrike problem?

anyone encountering the same problem?

Thank you
« Last Edit: July 23, 2024, 12:27:39 pm by cingo_5 »

juliocp1976

  • Zen Apprentice
  • *
  • Posts: 28
  • Karma: +2/-0
    • View Profile
Re: Login webadmin zentyal 7.x
« Reply #1 on: July 19, 2024, 03:07:40 pm »
hello
I have the same problem.

I already had this error 1 month ago on my servers, and strangely after 3 days they returned to normal access without the time-out error, I also didn't find anything related, I'm also waiting for a solution or answer that can identify this problem to resolve the situation delicate, unfortunately, if necessary, try accessing via RSAT if you need something in Zentyal.

jrtaylor

  • Zen Apprentice
  • *
  • Posts: 28
  • Karma: +6/-0
    • View Profile
Re: Login webadmin zentyal 7.x
« Reply #2 on: July 19, 2024, 03:51:02 pm »
I can confirm that this happening on zentyal 8 also.

rubicon

  • Zen Apprentice
  • *
  • Posts: 20
  • Karma: +2/-0
    • View Profile
Re: Login webadmin zentyal 7.x
« Reply #3 on: July 19, 2024, 04:06:53 pm »
I have the same problem, it hangs after logging in to the web. In the logs *84 no live upstreams while connecting to upstream, client

pcready.cl

  • Zen Samurai
  • ****
  • Posts: 290
  • Karma: +13/-1
  • Zentyal Installer in Chile
    • View Profile
    • PC Ready Chile SpA
Re: Login webadmin zentyal 7.x
« Reply #4 on: July 19, 2024, 06:27:26 pm »
Same problem here, several servers v6, 7, 8.
« Last Edit: July 19, 2024, 07:52:14 pm by pcready.cl »
Email: contacto@pcready.cl
Teléfono: (+56 32) 314 0883
Skype: pcready.cl
Web: https://www.pcready.cl

pcready.cl

  • Zen Samurai
  • ****
  • Posts: 290
  • Karma: +13/-1
  • Zentyal Installer in Chile
    • View Profile
    • PC Ready Chile SpA
Re: Login webadmin zentyal 7.x
« Reply #5 on: July 19, 2024, 07:44:54 pm »
/var/log/zentyal/error.log

Code: [Select]
2024/07/19 13:16:05 [error] 2658#2658: *23 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.x0.x0.x, server: , request: "GET / HTTP/1.1", upstream: "uwsgi://unix:///run/zentyal-webadmin/webadmin.sock", host: "x.x0.x.x3:xxxxx", referrer: "https://x.x0.x.x3:xxxxx/Login/Index"
2024/07/19 13:23:29 [error] 2658#2658: *41 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.x0.x0.x, server: , request: "GET / HTTP/1.1", upstream: "uwsgi://unix:///run/zentyal-webadmin/webadmin.sock", host: "x.x0.x.x3:xxxxx", referrer: "https://x.x0.x.x3:xxxxx/Login/Index"
2024/07/19 13:32:36 [error] 2658#2658: *45 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.x0.x0.x, server: , request: "GET / HTTP/1.1", upstream: "uwsgi://unix:///run/zentyal-webadmin/webadmin.sock", host: "x.x0.x.x3:xxxxx", referrer: "https://x.x0.x.x3:xxxxx/Login/Index"

Email: contacto@pcready.cl
Teléfono: (+56 32) 314 0883
Skype: pcready.cl
Web: https://www.pcready.cl

pcready.cl

  • Zen Samurai
  • ****
  • Posts: 290
  • Karma: +13/-1
  • Zentyal Installer in Chile
    • View Profile
    • PC Ready Chile SpA
Re: Login webadmin zentyal 7.x
« Reply #6 on: July 19, 2024, 07:51:49 pm »
v4.2.x servers still running in labs, 0 issues, looks like a core nginx issue.

In the lab I have ISOLATED Zentyal v6 and v7 from Internet servers to test, and these servers had the same error.... ¬¬
Email: contacto@pcready.cl
Teléfono: (+56 32) 314 0883
Skype: pcready.cl
Web: https://www.pcready.cl

pcready.cl

  • Zen Samurai
  • ****
  • Posts: 290
  • Karma: +13/-1
  • Zentyal Installer in Chile
    • View Profile
    • PC Ready Chile SpA
Re: Login webadmin zentyal 7.x
« Reply #7 on: July 19, 2024, 07:55:18 pm »
Please zentyal support or moderators, any trackbug to confirm the fail? thanks :)
Email: contacto@pcready.cl
Teléfono: (+56 32) 314 0883
Skype: pcready.cl
Web: https://www.pcready.cl

juliocp1976

  • Zen Apprentice
  • *
  • Posts: 28
  • Karma: +2/-0
    • View Profile
Re: Login webadmin zentyal 7.x
« Reply #8 on: July 19, 2024, 09:52:59 pm »
I did some investigation about the information in this issue, and the assumption appears to be true, the inaccessibility of update.zentyal.org causes the webadmin hanging and getting error 504 from nginx.

If I comment out the new version checking in the sources, then the webadmin Dashboard going to work again, without problems.



CREDITS: https://github.com/zentyal/zentyal/issues/2112


The file, which contains this version check is in /usr/share/perl5/EBox/Dashboard/CGI/Index.pm
In this file (as of Zentyal 7.1.2), starting at line 267, there is a function sub _getNewVersionFromCloud, which downloads a file from update.zentyal.org with wget (system call). wget normally timeouts in 900 secs, this is far too more than nginx waits for uWSGI answer. Unfortunately, if I set a much sorter timeout for wget (-T 15), it does not help. But if I comment out the relevant lines completely (273-278 for Zentyal 7.1.2), then this check it will be breasted, and the webadmin start working.

Of course, after modifying the file, the webadmin uwsgi process need to be killed (it is likely in a stuck state already), then a zs webadmin restart needed, too.

I wrote this result in #2170, too, for reference.

Gbn

  • Zen Apprentice
  • *
  • Posts: 2
  • Karma: +0/-0
    • View Profile
Re: Login webadmin zentyal 7.x
« Reply #9 on: July 20, 2024, 09:17:58 pm »
Thank you @juliocp1976, that fixed my issue.

I can confirm that the fix by commenting out these lines, the webinterface works again, and that www.zentyal.org and update.zentyal.org are not reachable from my 7.x version.

I have a 2nd Zentyal 8, check the file there, there is a timeout build in the 8 version

Zentyal 7 line:
system("wget --quiet -O /tmp/new-release - http://update.zentyal.org/update-from-'$version'.txt");

Zentyal 8 line:
 system("timeout 15 wget --timeout 15 --quiet -O /tmp/new-release - http://update.zentyal.org/update-from-'$version'.txt");

So in 8, there is a timeout and my 8 version shows the desktop.

Gerard

Gbn

  • Zen Apprentice
  • *
  • Posts: 2
  • Karma: +0/-0
    • View Profile
Re: Login webadmin zentyal 7.x
« Reply #10 on: July 20, 2024, 09:29:29 pm »
Confirmed, after making the line in 7.1.2 identical to the line in 8.x, the Dashboard keeps working normal, even when update.zentyal.org is not reachable.

Gerard

(mumbles something about CrowdStrike Falcon update, since outage started on 19th and update.zentyal.org not reachable since that time)


umeshhrr

  • Zen Apprentice
  • *
  • Posts: 6
  • Karma: +0/-0
    • View Profile
504 Gateway Time-out nginx
« Reply #11 on: July 22, 2024, 01:22:52 pm »
All,

We have few Zentyal 6.2 server's & Issue facing since 19.7.24. Please support..

Regard's
Umesh


blorente

  • Zentyal Staff
  • Zen Apprentice
  • *****
  • Posts: 25
  • Karma: +72/-0
    • View Profile
Re: Login webadmin zentyal 7.x
« Reply #12 on: July 22, 2024, 02:11:44 pm »
Hi everyone, we are working on this right now.

I'll reply on this thread as soon as we have the issue solved.

Sorry for the inconvenience
Zentyal Server Lead Developer

blorente

  • Zentyal Staff
  • Zen Apprentice
  • *****
  • Posts: 25
  • Karma: +72/-0
    • View Profile
Re: Login webadmin zentyal 7.x
« Reply #13 on: July 22, 2024, 02:25:39 pm »
Systems have recovered and are up and running.

The problem was caused by a system service that could not terminate correctly and consumed resources quickly, not giving the monitoring system time to solve the problem.

One more time, sorry for the inconvenience.

Have a nice day community!
Zentyal Server Lead Developer

cingo_5

  • Zen Apprentice
  • *
  • Posts: 5
  • Karma: +0/-0
    • View Profile
Re: Login webadmin zentyal 7.x
« Reply #14 on: July 23, 2024, 12:26:23 pm »
I confirm that the problem is solved.
Thank you all