We hope you'll join us for our 4/23 webinar on using data tables to apply reference ranges and AE codes in OC4. For more information and to register, visit https://register.gotowebinar.com/register/2882170018956684555

Performance Issues

Performance Issues
Hi OpenClinica users,
We are experiencing some performance issues on the application. Specifically, we have a form with 116 fields and it is taking 2 min 25 seconds to store in the database after clicking "submit" in the form. I'm focusing on the database, since I move it from one server to another server and got basically the same performance.
Has anyone experienced such a performance? Any ideas?
Thanks.
Jorge L. Montalvo
HHS/NIH/NIAID/OTIS/SAISB
Contractor
LTS Corp.
Computer Specialist/Web Developer
6700A Rockledge Dr
Suite 42A145
Bethesda, MD 20817
The information in this e-mail and any of its attachments is confidential and may contain sensitive information. It should not be used by anyone who is not the original intended recipient. If you have received this e-mail in error please inform the sender and delete it from your mailbox or any other storage devices. The National Institute of Allergy and Infectious Diseases (NIAID) shall not accept liability for any statement made that are the sender's own and not expressly made on behalf of the NIAID by one of its representatives.

Comments

  • sveroniksveronik Posts: 4
    Performance Issues
  • willilx9willilx9 Posts: 40
    We are using the OpenClinica 3.1.2 Enterprise Edition and we have been having some severe performance issues. It’s been taking a very long time when loading the subject matrix as well as getting to the Notes and Discrepancy section of the application.

    Does anyone have any suggestions on improving performance outside of upgrading?
  • willilx9willilx9 Posts: 40
    We are using the OpenClinica 3.1.2 Enterprise Edition and we have been having some severe performance issues. It’s been taking a very long time when loading the subject matrix as well as getting to the Notes and Discrepancy section of the application.

    Does anyone have any suggestions on improving performance outside of upgrading?
  • mvirtosumvirtosu Posts: 276 ✭✭
    Hi,

    This question has been asked before and this is what our sys admin successfully did to improve performance:

    I can not comment on the browser improving speed or not but to improve the performance of our OpenClinica install we did three major things.

    First we did not use version 3.1.2 we waited for 3.1.3. In testing we found 3.1.2 slow, 3.1.3 is a bit faster.

    Second we tuned the Postgres settings. If you go to here (http://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server) you can find lots of setting to tune your postgres. We only adjusted a couple of settings. These settings are what is recomended to adjust.


    Setting Recommended
    max_connections = 200
    shared_buffers = 512MB #1/4 your RAM, with a max of 512MB
    effective_cache_size = 1GB #1/2 your RAM
    checkpoint_segments= 32
    checkpoint_completion_target= 0.9
    work_mem = 16MB #1/32nd of shared_buffers above
    maintenance_work_mem= 256MB
    wal_sync_method = fsync_writethrough # previously fsync (commented)
    wal_buffers = 16MB
    random_page_cost = 3.0


    Third we increased the number of processors that Postgres had. We increased it to 8 processors with 8 GB of RAM. Going above 8 GB of ram did not make a difference.

    We found that with these three thing we were able to get OpenClinica to a resonable response time. Just as an fyi we are running OC on Windows without the benifit of a 64 bit database.

    I hope this helps.
    Sent: Tuesday, May 14, 2013 9:34 AM
    To: [email protected]; [email protected]
    Subject: [Developers] Performance Issues

    We are using the OpenClinica 3.1.2 Enterprise Edition and we have been having some severe performance issues. It’s been taking a very long time when loading the subject matrix as well as getting to the Notes and Discrepancy section of the application.

    Does anyone have any suggestions on improving performance outside of upgrading?
  • mvirtosumvirtosu Posts: 276 ✭✭
    Hi,

    This question has been asked before and this is what our sys admin successfully did to improve performance:

    I can not comment on the browser improving speed or not but to improve the performance of our OpenClinica install we did three major things.

    First we did not use version 3.1.2 we waited for 3.1.3. In testing we found 3.1.2 slow, 3.1.3 is a bit faster.

    Second we tuned the Postgres settings. If you go to here (http://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server) you can find lots of setting to tune your postgres. We only adjusted a couple of settings. These settings are what is recomended to adjust.


    Setting Recommended
    max_connections = 200
    shared_buffers = 512MB #1/4 your RAM, with a max of 512MB
    effective_cache_size = 1GB #1/2 your RAM
    checkpoint_segments= 32
    checkpoint_completion_target= 0.9
    work_mem = 16MB #1/32nd of shared_buffers above
    maintenance_work_mem= 256MB
    wal_sync_method = fsync_writethrough # previously fsync (commented)
    wal_buffers = 16MB
    random_page_cost = 3.0


    Third we increased the number of processors that Postgres had. We increased it to 8 processors with 8 GB of RAM. Going above 8 GB of ram did not make a difference.

    We found that with these three thing we were able to get OpenClinica to a resonable response time. Just as an fyi we are running OC on Windows without the benifit of a 64 bit database.

    I hope this helps.
    Sent: Tuesday, May 14, 2013 9:34 AM
    To: [email protected]g; [email protected]
    Subject: [Developers] Performance Issues

    We are using the OpenClinica 3.1.2 Enterprise Edition and we have been having some severe performance issues. It’s been taking a very long time when loading the subject matrix as well as getting to the Notes and Discrepancy section of the application.

    Does anyone have any suggestions on improving performance outside of upgrading?
  • willilx9willilx9 Posts: 40
    Thanks.
    Sent: Tuesday, May 14, 2013 10:20 AM
    To: [email protected]; [email protected]
    Subject: Re: [Developers] Performance Issues

    Hi,

    This question has been asked before and this is what our sys admin successfully did to improve performance:

    I can not comment on the browser improving speed or not but to improve the performance of our OpenClinica install we did three major things.

    First we did not use version 3.1.2 we waited for 3.1.3. In testing we found 3.1.2 slow, 3.1.3 is a bit faster.

    Second we tuned the Postgres settings. If you go to here (http://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server) you can find lots of setting to tune your postgres. We only adjusted a couple of settings. These settings are what is recomended to adjust.


    Setting Recommended
    max_connections = 200
    shared_buffers = 512MB #1/4 your RAM, with a max of 512MB
    effective_cache_size = 1GB #1/2 your RAM
    checkpoint_segments= 32
    checkpoint_completion_target= 0.9
    work_mem = 16MB #1/32nd of shared_buffers above
    maintenance_work_mem= 256MB
    wal_sync_method = fsync_writethrough # previously fsync (commented)
    wal_buffers = 16MB
    random_page_cost = 3.0


    Third we increased the number of processors that Postgres had. We increased it to 8 processors with 8 GB of RAM. Going above 8 GB of ram did not make a difference.

    We found that with these three thing we were able to get OpenClinica to a resonable response time. Just as an fyi we are running OC on Windows without the benifit of a 64 bit database.

    I hope this helps.
    Sent: Tuesday, May 14, 2013 9:34 AM
    To: [email protected]; [email protected]
    Subject: [Developers] Performance Issues

    We are using the OpenClinica 3.1.2 Enterprise Edition and we have been having some severe performance issues. It’s been taking a very long time when loading the subject matrix as well as getting to the Notes and Discrepancy section of the application.

    Does anyone have any suggestions on improving performance outside of upgrading?
  • abertuzziabertuzzi Posts: 51
    Mihai,
    are you running the application and the database on the same server or do you host the db on a separated database server?

    Reason why I am asking is that we too are trying to reduce the long times required for opening the Notes & Discrepancy page, but the simple tuning of the database allowed us just to reduce from 34 seconds to about 25 seconds the time to open the Notes & Discrepancy page for a Study/Site for which 1220 Discrepancy Notes existed.
    The tuning reduced the database execution time from 9 seconds to less than 1 seconds. Of the initial 9 seconds, about 4 seconds were spent executing a big master query and the other 5 seconds were spent executing 1220 times a small query, probably to collect details on each individual Discrepancy Note.

    In our installation the db is hosted on a separate (Oracle) database server.

    If there are evidence and estimates about the gain in performance that could be obtained joining the application and database on the same unit, this option could also be considered.

    Armando
    Sent: Tuesday, May 14, 2013 10:20 AM
    To: [email protected]; [email protected]
    Subject: Re: [Developers] Performance Issues

    Hi,

    This question has been asked before and this is what our sys admin successfully did to improve performance:

    I can not comment on the browser improving speed or not but to improve the performance of our OpenClinica install we did three major things.

    First we did not use version 3.1.2 we waited for 3.1.3. In testing we found 3.1.2 slow, 3.1.3 is a bit faster.

    Second we tuned the Postgres settings. If you go to here (http://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server) you can find lots of setting to tune your postgres. We only adjusted a couple of settings. These settings are what is recomended to adjust.


    Setting Recommended
    max_connections = 200
    shared_buffers = 512MB #1/4 your RAM, with a max of 512MB
    effective_cache_size = 1GB #1/2 your RAM
    checkpoint_segments= 32
    checkpoint_completion_target= 0.9
    work_mem = 16MB #1/32nd of shared_buffers above
    maintenance_work_mem= 256MB
    wal_sync_method = fsync_writethrough # previously fsync (commented)
    wal_buffers = 16MB
    random_page_cost = 3.0


    Third we increased the number of processors that Postgres had. We increased it to 8 processors with 8 GB of RAM. Going above 8 GB of ram did not make a difference.

    We found that with these three thing we were able to get OpenClinica to a resonable response time. Just as an fyi we are running OC on Windows without the benifit of a 64 bit database.

    I hope this helps.
    Sent: Tuesday, May 14, 2013 9:34 AM
    To: [email protected]; [email protected]
    Subject: [Developers] Performance Issues

    We are using the OpenClinica 3.1.2 Enterprise Edition and we have been having some severe performance issues. It’s been taking a very long time when loading the subject matrix as well as getting to the Notes and Discrepancy section of the application.

    Does anyone have any suggestions on improving performance outside of upgrading?
  • mvirtosumvirtosu Posts: 276 ✭✭
    Armando,

    We run application and Postgres database on the same server.

    I cannot speak of Notes and Discrepancy load times because we don’t use it. And I am not aware of any performance tests regarding joining/separating application and database, sorry.

    Mihai
    Sent: Wednesday, May 15, 2013 9:43 AM
    To: [email protected]
    Subject: Re: [Developers] Performance Issues

    Mihai,
    are you running the application and the database on the same server or do you host the db on a separated database server?

    Reason why I am asking is that we too are trying to reduce the long times required for opening the Notes & Discrepancy page, but the simple tuning of the database allowed us just to reduce from 34 seconds to about 25 seconds the time to open the Notes & Discrepancy page for a Study/Site for which 1220 Discrepancy Notes existed.
    The tuning reduced the database execution time from 9 seconds to less than 1 seconds. Of the initial 9 seconds, about 4 seconds were spent executing a big master query and the other 5 seconds were spent executing 1220 times a small query, probably to collect details on each individual Discrepancy Note.

    In our installation the db is hosted on a separate (Oracle) database server.

    If there are evidence and estimates about the gain in performance that could be obtained joining the application and database on the same unit, this option could also be considered.

    Armando
    Sent: Tuesday, May 14, 2013 10:20 AM
    To: [email protected]; [email protected]
    Subject: Re: [Developers] Performance Issues

    Hi,

    This question has been asked before and this is what our sys admin successfully did to improve performance:

    I can not comment on the browser improving speed or not but to improve the performance of our OpenClinica install we did three major things.

    First we did not use version 3.1.2 we waited for 3.1.3. In testing we found 3.1.2 slow, 3.1.3 is a bit faster.

    Second we tuned the Postgres settings. If you go to here (http://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server) you can find lots of setting to tune your postgres. We only adjusted a couple of settings. These settings are what is recomended to adjust.


    Setting Recommended
    max_connections = 200
    shared_buffers = 512MB #1/4 your RAM, with a max of 512MB
    effective_cache_size = 1GB #1/2 your RAM
    checkpoint_segments= 32
    checkpoint_completion_target= 0.9
    work_mem = 16MB #1/32nd of shared_buffers above
    maintenance_work_mem= 256MB
    wal_sync_method = fsync_writethrough # previously fsync (commented)
    wal_buffers = 16MB
    random_page_cost = 3.0


    Third we increased the number of processors that Postgres had. We increased it to 8 processors with 8 GB of RAM. Going above 8 GB of ram did not make a difference.

    We found that with these three thing we were able to get OpenClinica to a resonable response time. Just as an fyi we are running OC on Windows without the benifit of a 64 bit database.

    I hope this helps.
    Sent: Tuesday, May 14, 2013 9:34 AM
    To: [email protected]; [email protected]
    Subject: [Developers] Performance Issues

    We are using the OpenClinica 3.1.2 Enterprise Edition and we have been having some severe performance issues. It’s been taking a very long time when loading the subject matrix as well as getting to the Notes and Discrepancy section of the application.

    Does anyone have any suggestions on improving performance outside of upgrading?
This discussion has been closed.