Hibernating GeoServer: seeking for scalability and robustness

I thought it would have been worth spending a few minutes to let people know about this development that we are bringing forward at GeoSolutions.
Being not only GeoServer developers but also GeoServer hungry users, we have been a bit unpleased in the past by the scalability problems that it was showing by the fact that:

  1. GeoServer was keeping all its configuration into memory
  2. GeoServer was making use XML files to handle its internal configuration

Now a lot of work has been lately for the upcoming 2.0 version of GeoServer, however, while 2 has been made less evident by GSIP 36 1 has not been touched yet.
If you use GeoServer the way we use it, with thousand of layers and with 10 to 100 new layers added daily (usually remote sensing data), you might agree with us that we need to:

  1. Not load and keep the entire configuration in memory
  2. Use a database store the configuration

In a few words, we need to improve scalability and robustness while tring to not jeopardize performance.

At GeoSolutions we have decided to tackle this problems by implementing a new GeoServer internal catalog that leverages on Hibernate as its persistence engine and that would also not bring the whole configuration into memory. Our goal is to be able to support at least Postgis, Oracle and H2 as the target database, but as you know, many more are supported by Hibernate.
The range of features that this work would open up is pretty wide, just think about using Hibernate distributed caching, simplified GeoServer replication, etc., etc.

The work is in progress, we have started to describe the details on the GeoServer wiki and we will be committing a first version beginning of September.
If you are interesting in supporting somehow (funding or human resources) this effort, please, drop me a few lines at simone.giannecchiniATgeo-solutions.it.

 
  • I have been facing exactly the same problem, and so it is good to hear that I am not alone and that work is being done in this area.

    I was considering building a system using the Rest API to replicate the state of the configuration database. The problem with this is there are many possibly ways for the state of the GeoServer to get out of sync with the configuration database. Having an hibernate based configuration system would be much better.

    Looking forward to this addition to the GeoServer.

  • AJ

    I’ve been a geoserver user for quite some time now and this is something i have been waiting a long time for…cant wait to try it out