Author Topic: Backup took to long to list files...  (Read 2211 times)

Gilberto Ferreira

  • Zen Hero
  • *****
  • Posts: 516
  • Karma: +12/-1
    • View Profile
Backup took to long to list files...
« on: August 03, 2019, 01:56:26 am »
Hi there!

I have Zentyal 3.5 here and install ebackup (duplicity) and for my mistake, I set to view all the files (or itens) into restore files tab...
There's thousands files and took too long list them...

The problem occur when I try to display this page:

https://189.115.89.18:50443/SysInfo/EBackup#RemoteFileList

I have seen that uwsgi process took 100% of CPU:

14917 ebox      20   0  757780 394492  54992 R 100,0  4,9   3:50.59 uwsgi                                                           

And I also notice that when I kill the process uwsgi, I am able to return to the dashboard after a while...

How can I reset the view to just 10 itens??

Thanks

https://photos.app.goo.gl/dzT53gAUa8ChLEhi9

« Last Edit: August 03, 2019, 05:56:48 am by Gilberto Ferreira »

doncamilo

  • Zen Samurai
  • ****
  • Posts: 478
  • Karma: +165/-1
    • View Profile
Re: Backup took to long to list files...
« Reply #1 on: August 04, 2019, 08:07:45 pm »
Hi!  :)
I don't know so old Zentyal versions.  :o

I have downloaded the Zentyal 3.5 code from Github and I have searched for 'ebackup' templates but the only config file I have found is this:
https://github.com/zentyal/zentyal/blob/3.5/main/ebackup/conf/ebackup.conf
which specifies:
 
Code: [Select]
# Config keys are set this way:
key = value

and

Code: [Select]
# This file contains the most basic settings, most other stuff is configured
# using the web interface.

So, I think you should be able to change the parameter here if you reach to know his name.

I haven't found any official download link for Zentyal 3.5, so, I can't do some trials as I would like to do.


Another option should be to move backuped files to an other folder (or to remove them) So you could re-take the control.

The last option I have in this moment is to change the value on the redis database and to restart the server.

Tell me how do you manages the issue please.

Cheers!
- Do my pigeons bother you passing over your land?
- They block the sun!

G. Guareschi., Don Camillo.,

Gilberto Ferreira

  • Zen Hero
  • *****
  • Posts: 516
  • Karma: +12/-1
    • View Profile
Re: Backup took to long to list files...
« Reply #2 on: August 04, 2019, 10:54:28 pm »
Hi!  :)
I don't know so old Zentyal versions.  :o

I have downloaded the Zentyal 3.5 code from Github and I have searched for 'ebackup' templates but the only config file I have found is this:
https://github.com/zentyal/zentyal/blob/3.5/main/ebackup/conf/ebackup.conf
which specifies:
 
Code: [Select]
# Config keys are set this way:
key = value

and

Code: [Select]
# This file contains the most basic settings, most other stuff is configured
# using the web interface.

So, I think you should be able to change the parameter here if you reach to know his name.

I haven't found any official download link for Zentyal 3.5, so, I can't do some trials as I would like to do.


Another option should be to move backuped files to an other folder (or to remove them) So you could re-take the control.

The last option I have in this moment is to change the value on the redis database and to restart the server.

Tell me how do you manages the issue please.

Cheers!

The conf files theres no options to edit the webadmin interface in backup sections, in order to restore the view option...
I also tried to change the folder name but not work at all.
How can I change redis-server??

Thanks a lot

doncamilo

  • Zen Samurai
  • ****
  • Posts: 478
  • Karma: +165/-1
    • View Profile
Re: Backup took to long to list files...
« Reply #3 on: August 08, 2019, 03:10:47 pm »
 :)

Zentyal 5.0 and Zentyal 6.0 have an utility called redisvi able to edit the database. But I don't know if it is ready on Zentyal 4.0.

I fear you'll have to use the usual redis command line tools. In a few days I'll be able to assist you in a more detailed way.

Cheers!
- Do my pigeons bother you passing over your land?
- They block the sun!

G. Guareschi., Don Camillo.,

Gilberto Ferreira

  • Zen Hero
  • *****
  • Posts: 516
  • Karma: +12/-1
    • View Profile
Re: Backup took to long to list files...
« Reply #4 on: August 09, 2019, 02:09:05 pm »
:)

Zentyal 5.0 and Zentyal 6.0 have an utility called redisvi able to edit the database. But I don't know if it is ready on Zentyal 4.0.

I fear you'll have to use the usual redis command line tools. In a few days I'll be able to assist you in a more detailed way.

Cheers!

Thanks

doncamilo

  • Zen Samurai
  • ****
  • Posts: 478
  • Karma: +165/-1
    • View Profile
Re: Backup took to long to list files...
« Reply #5 on: August 14, 2019, 12:47:24 am »
 :)

hi!

I think the better of the way in order to check if the redis database is storing the value of configuration that is breaking your systems is to install rdbtools https://github.com/sripathikrishnan/redis-rdb-tools.

This way you can use this tool this way:

Code: [Select]
sudo cp /var/lib/zentyal/dump.rdb .
rdb --command json dump.rdb  > redis.json

The redis.json file looks this way:

Code: [Select]
[{
"services/conf/ServiceTable/keys/srv11/configuration/keys/srvccnf16":"{\"destination_single_port\":\"139\",\"protocol\":\"tcp\",\"readOnly\":1,\"source_range_type\":\"any\",\"destination_range_type\":\"single\"}",
"network/ro/DNSResolver/keys/dnsr2":"{\"nameserver\":\"80.58.61.254\",\"interface\":\"eth0.dhclient\"}",
"services/ro/ServiceTable/keys/srv11/configuration/keys/srvccnf22":"{\"source_range_type\":\"any\",\"protocol\":\"tcp\",\"destination_single_port\":\"3268\",\"readOnly\":1,\"destination_range_type\":\"single\"}",
"ntp/conf/_serviceModuleStatus":"1",
"logs/state":"{\"_temporary_stopped\":0,\"_serviceInstalled\":1,\"_needsSaveAfterConfig\":0}",
"dns/ro/DomainTable/keys/dmn1/txt/keys/t1":"{\"txt_data\":\"lab4.lan\",\"readOnly\":1,\"custom\":\"_kerberos\",\"hostName_selected\":\"custom\"}",
"services/conf/ServiceTable/keys/srv11/configuration/keys/srvccnf23":"{\"destination_single_port\":\"3269\",\"source_range_type\":\"any\",\"destination_range_type\":\"single\",\"protocol\":\"tcp\",\"readOnly\":1}",
"dns/conf/DomainTable/order":"[\"dmn1\"]",
"services/conf/ServiceTable/keys/srv1/configuration/keys/srvccnf1":"{\"protocol\":\"any\",\"source_range_type\":\"any\",\"readOnly\":1,\"destination_range_type\":\"any\"}",
"services/ro/ServiceTable/keys/srv9/configuration/order":"[\"srvccnf9\"]",
"services/conf/ServiceTable/keys/srv11/configuration/keys/srvccnf20":"{\"destination_range_type\":\"single\",\"source_range_type\":\"any\",\"readOnly\":1,\"protocol\":\"tcp\",\"destination_single_port\":\"636\"}",
"firewall/ro/ExternalToEBoxRuleTable/order":"[\"extrnlt2\",\"extrnlt1\"]",
"ntp/ro/Servers/keys/sr1":"{\"server\":\"0.pool.ntp.org\"}",
"network/conf/DNSResolver/order":"[\"dnsr1\",\"dnsr2\"]",
"dns/ro/DomainIpTable/max_id":"2",
"network/conf/GatewayTable/max_id":"1",
(...)

You could share a link to your redis json file if you need some help in order to search the needed key.

I look forwards hearing for you.

Cheers!
- Do my pigeons bother you passing over your land?
- They block the sun!

G. Guareschi., Don Camillo.,

doncamilo

  • Zen Samurai
  • ****
  • Posts: 478
  • Karma: +165/-1
    • View Profile
Re: Backup took to long to list files...
« Reply #6 on: September 05, 2019, 02:37:39 pm »
 :)
If you feel confident with vi, Zentyal offers a tool (similar to "visudo") in order to show and edit the redis database.

The redisvi script is located on '/usr/share/zentyal/redisvi', but It seems to me that this configuration isn't stored on redis ( at least, I'm unable to found it)

Cheers!
- Do my pigeons bother you passing over your land?
- They block the sun!

G. Guareschi., Don Camillo.,