Zentyal Forum, Linux Small Business Server

Zentyal Server => Installation and Upgrades => Topic started by: ian on October 23, 2011, 10:16:02 am

Title: Uograde Zentyal 1.4 to release 2.2
Post by: ian on October 23, 2011, 10:16:02 am
Hello,

Is there an option to upgrade V1.4 to V2.2.

If not how is it possible to export the users and computer accounts from 1.4 and import them to the new release 2.2.


It is not so easy and takes a lot of work to upgrade an oparational 1.4 system with more than 100 users and +/- 50 computer in a domain.

Best regards,
Ian
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: J. A. Calvo on October 23, 2011, 10:16:48 pm
The only path for upgrading to 2.2 is through 2.0, so maybe you can try to upgrade your 1.4 to 2.0 first, and after having a working 2.0 installation you'll be able to use the migration tool for 2.2.
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: Sam Graf on October 23, 2011, 10:29:46 pm
Ian is specifically interested in knowing how to follow this advice, I think:
An upgrade from 1.4 (hardy based) to 2.2 (lucid based) is not trivial and probably the best is to reinstall. To migrate users and machines on Samba just dump your LDAP database and reimport it back into the new 2.2 install. We have made this to many customers and works fine.

Hopefully someone in the community can offer some specific guidance. :)
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: robb on October 23, 2011, 11:10:33 pm
Agree with Sam. Upgrade paths are a must when it comes to professional use of Zentyal. Especially upgradepaths between major releases.
I can imagine that a simple 'sudo do-release-upgrade' will break zentyal. But there should be an alternative so a system upgrade to the next LTS version can be done.
Next year another major release is coming up and I sincerely hope a decent upgrade path to Precise Pangolin will be offered.

For now, people are still struggling with the upgrade to lucid/zentyal 2.x and personaly I think it is not acceptable that, after more than 1 year, there is still no step by step guide to upgrade from ebox 1.4 to zentyal 2.x
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: christian on October 24, 2011, 06:45:13 am
Robb,

I do share.
Upgrade path can have different form: running script (like from 2.0 to 2.2) is one way to upgrade. Applying this to 1.4 to 2.0 jump is not realistic but minimal expectation is to have some clear process ensuring that nothing will be lost while following migration steps (could be, e.g. data backup, + system upgrade + new Zentyal install + data restore) and I believe this is the way most of us have upgraded. But this clear process and documentation is missing as far as I know.
LDAP backup is not enough (and even this deserves some documentation, most Zentyal users not understanding what this means and how to achieve it).
What's about Postgres DB, mail, web sites?
i.e., anything that will be lost because of new Zentyal installation must be saved and restored and this must be documented.
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: robb on October 24, 2011, 09:22:25 am
Hi Christian,

That's exactly what I mean. There must be a solid way on how to implement _all_ your settings AND data (office, db's, mail etc...) on the new release.
As far as I can see there are a few options. Based on using the same hardware, based on using new hardware or a last option is to use a virtualized environment.

It would be a nice gesture if a few active forum members, with some help of a Zentyal dev brainstorm on how to accomplish a fail/fool proof procedure on migrating from eBox1.4 to Zentyal 2.x (Can the 'x' be a 2 or will that be a step to far and do we need to go from 1.4 via 2.0 to 2.2?)
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: christian on October 24, 2011, 09:55:33 am
It would be a nice gesture if a few active forum members, with some help of a Zentyal dev brainstorm on how to accomplish a fail/fool proof procedure on migrating from eBox1.4 to Zentyal 2.x (Can the 'x' be a 2 or will that be a step to far and do we need to go from 1.4 via 2.0 to 2.2?)

For sure  ;) but this is quite time consuming  :-[
And it would be even nicer if THIS, among other "reliability related stuff" was the top priority above add of new features, components, whistles and bells  ::)

The point is that, at least to me, is also a matter of design: one need some tool to identity was is already configured (which modules are actives, which ones are installed...) ans what has been configured or customized. Migration tool or script will never cover everything but there is a very minimum not yet reached.
Furthermore, I would also vote for a disaster recovery mode in case migration fails: how do you ensure you do not lose everything if your migration script fails, for whatever reason.
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: robb on October 24, 2011, 10:12:01 am
Quote
Furthermore, I would also vote for a disaster recovery mode in case migration fails: how do you ensure you do not lose everything if your migration script fails, for whatever reason.
Modify message

This last point I cover by using a decent raid adapter with hotswap backplane. I bring down the server, break the raid1 config and reboot with failed disk0. If something turns out bad during migration, I revert to the original state by bringing down the server, take out the messed up migrationdisk1, put back disk0 and boot again with failed disk1. This is similar to making a snapshot of a virtual server.
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: christian on October 24, 2011, 10:28:15 am
Sure this works. And if migration is successful, you connect second disk again (assuming you have everything on one single (mirrored) disk and synchronize?
This is also already very advanced and not fitting 100% with Zentyal philosophy targeting SMBs.

Either everything is installed on one single disk or you have to proceed with clever custom installation, using multiple RAID for system, data...

Do not misunderstand my point. I'm sure what you do works. I did migrate/reinstall multiple times without loosing data (except first time when I reinstalled mail at the very beginning and loose all mailboxes  >:( ) but what I want to highlight here is that migration till now is not "end-user" oriented.
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: jsalamero on October 24, 2011, 04:10:03 pm
The number of users still running 1.4 is marginal so I'm not sure about making such big effort for a small number of users. LDAP (users, groups, passwd, domain computers, mail accounts, etc) can be easily migrated using ldapsearch, dumping into a ldif file users and groups OU and restoring it back with ldapadd. That will cover most of the cases and the most valuable information: the LDAP tree. Data can be migrated using standard backup tools (cp, rsync, etc).

Upgrade paths are not trivial tasks (see that migration tool from 2.0 to 2.2 is still in beta), but Zentyal team is committed to make best effort possible to provide migration paths.
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: robb on October 24, 2011, 06:34:03 pm
I agree that upgradepaths are no trivial tasks, but for a professional environment software upgrardes ARE trivial expectations and must be met. I know the Zentyal devs do a great job, and I only hope enough time is available and planned to make upgradespaths available.
If community help (like beta testing) is needed, maybe a specific call from the devs towards the community can be made.
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: jsalamero on October 24, 2011, 07:49:47 pm
Remember that you don't need to upgrade a server on production since support for that version is still available. Professional environments don't upgrade until: a new version of the software is required because a new feature is required or software version reaches end of support life.
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: robb on October 25, 2011, 12:24:13 am
Ok, then lets assume we have a server with a 5 year support timeframe and a 2 year major release update timeframe (where did I see this before.. :P )
Now I am at the end of a 5 year support timeframe.... What's next? I still will need to do the migration to the newest version. Since you have to update over 2 major releases, problems will be even bigger then for a single major release update.
I rather update with each major release then wait for the 5 years of support end making it necessary to have a decent and fail/fool proof upgrade procedure.
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: J. A. Calvo on October 25, 2011, 12:45:06 am
Next year another major release is coming up and I sincerely hope a decent upgrade path to Precise Pangolin will be offered.

Yes, you can be sure we'll do our best to allow a smooth upgrade from Lucid with Zentyal 2.2 to Precise with Zentyal 3.0 :)
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: christian on October 25, 2011, 09:48:19 am
I've no doubt whole Zentyal team is working in best effort mode  :) and I also understand that migration script for such open perimeter where everyone can customize a lot is really tricky.
This said, I do not fully share jsalamero's statement describing migration as ldap on one hand and data on the other hand.
Because of all different modules Zentyal offers, deploying again some pretty large environments can be very painful: once you have retrieved all users account, restored mailboxes and data, you still have to reconfigure manually DHCP, DNS, Firewall rules, think about secondary Zentyal servers (what's about slave ldap in the meantime?).
What is underlying is the lack of backup strategy that could be used to save Zentyal related data to be restored in case of new installation. I've to admit that this puzzles me a bit  ???

Everything done vie "upgrade" should maintain existing repositories assuming this is strategy implemented by Zentyal. So far, all previous upgrades before 2.0 to 2.2 have been done through complete re-installation, if I'm not wrong.

My point here is to highlight that such strategy will be very challenging because of the increasing amount of new features and product plus extended LTS support that may slow done system upgrades, resulting in bigger steps...
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: ian on October 25, 2011, 11:18:17 am
Hello,

Thanks for the posts.

As already told the major problem by updating or upgrading from Zentyal 1.4 to Zentyal 2.2 ( different OS 8.04 and 10.4 ),
is to backup and restore the server configuration ( install the new serever software and backup the data from the 1.4 server and restore the data to the new 2.2 server is no problem ).

In the past a have done several times an upgrade from 1.2 to 1.4 with no problems, but the release 2.0 and also release 2.2 has a different structure in the home map for the user accounts so 1.2 is not complete compatible with 2.2.

I have tested an upgrade from 1.2 to 2.0 :

On the 1.2 server backup the data and configuration ( configuration backup in the zentyal gui )
Install the new ubuntu software 10.04 LTS and the Zentyal communications and office module of Zentyal, activate the zentyal modules and restore the data and the configuration ( configuration in zentyal gui ).

It works but is not 100% ok, so it is not possible to add new windows client computers  to the domain, unless in command mode on the server adduser computername$ is executed then the new windows client could be added to the domain in the zentyal admin gui.

So upgrade is possible but not realy ok.
Is there any documentation of howto export the ldap users computeraccounts etc to a file and then import the file in the new server ?
The devloppers of Zentyal have made the backup-restore script ( that script export acconts an import them ) could that script not be adapted to backup the 1.4 configuration and restore the file in the correct form to a new 2.2 server configuration ?

Upgrade Zentyal on the same operating system was no problem in the past ( 1.2 to 1.4 ), is it not possible to upgrade from 2.0 to 2.2 by adapting the sources.list file to the new repository of the release 2.2 and the commands apt-get update and apt-get dist-upgrade ?

As already told there must be an easy way to upgrade to a new system without to have manually configure the whole domain with computer accounts accounts shares etc.

Thaks and best regards,
Ian
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: J. A. Calvo on October 26, 2011, 12:23:41 am
Upgrade Zentyal on the same operating system was no problem in the past ( 1.2 to 1.4 ), is it not possible to upgrade from 2.0 to 2.2 by adapting the sources.list file to the new repository of the release 2.2 and the commands apt-get update and apt-get dist-upgrade ?

As already told there must be an easy way to upgrade to a new system without to have manually configure the whole domain with computer accounts accounts shares etc.

Let me try to explain this, the changes between 2.0 and 2.2 are very different to the ones between 1.2 and 1.4, all packages have been renamed from ebox-* to zentyal-* as well as some critical stuff like /var/lib/ebox to /var/lib/zentyal, where the configuration is stored (the configuration backend was also rewritten to improve the performance, so a conversion process is required). That's the main reason to provide a separate tool to do the migration. We have also introduced changes in the framework to allow easier migrations in the future, so from now on we hope to make the dist-upgrade work when upgrading to the next versions.
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: ian on October 26, 2011, 10:32:38 am
Hello javier,

Thanks for the explanation.

Best regards,
Ian
Title: Re: Uograde Zentyal 1.4 to release 2.2
Post by: ian on October 26, 2011, 11:34:45 am
Hello,

Thanks for the posts sofar, but i still have the problem of how to export user accounts computer accounts etc of the release 1.4 and import them in the new release 2.2.

Is there more info about export and import the accmounts from the opne LDAp database ?

A solution for this problem could be a great help to upgrade my operational system 1.4 to 2.2 ( more tha 50 computer accounts and more than 100 user accounts.

Zentyal is a fantastic product, but scripts or tools to upgrade a LTS stable system with an Zentyal release to a newer LTS os and a new Zentyal relase wil be welcome.

Thanks and best regards,
ian