Uploaded image for project: 'i2b2 Core Software'
  1. i2b2 Core Software
  2. CORE-313

CRC-PDO: AverageObservationPageMethod doesnt work

Details

    • Bug
    • Status: Reopened
    • Major
    • Resolution: Unresolved
    • None
    • TBD
    • None
    • None
    • Hide
      The way to test this is to
      1. Modify the crc properties file to use
      # Paging method can be SUBDIVIDE_INPUT_METHOD/AVERAGE_OBSERVATION_METHOD
      edu.harvard.i2b2.crc.pdo.paging.method=AVERAGE_OBSERVATION_METHOD

      2. Request a PDO using a large data set that exceeds the observation fact page size of 5000. This method will converge on a page size much faster than the SUBDIVIDE method
      Show
      The way to test this is to 1. Modify the crc properties file to use # Paging method can be SUBDIVIDE_INPUT_METHOD/AVERAGE_OBSERVATION_METHOD edu.harvard.i2b2.crc.pdo.paging.method=AVERAGE_OBSERVATION_METHOD 2. Request a PDO using a large data set that exceeds the observation fact page size of 5000. This method will converge on a page size much faster than the SUBDIVIDE method
    • edu.harvard.i2b2.crc

    Description

      This method was converging on a page size that was over the page size limit. Fix was to alter the algorithm.

      Attachments

        Activity

          Ascending order - Click to sort in descending order
          rm302 Reeta Metta added a comment -
          needs to be fixed for SQL server and PostgreSQL
          rm302 Reeta Metta added a comment - needs to be fixed for SQL server and PostgreSQL
          rm302 Reeta Metta added a comment -
          check for performance with large PDO set
          rm302 Reeta Metta added a comment - check for performance with large PDO set
          rm302 Reeta Metta added a comment -
          Oracle - 5K patientlist took 9.79seconds
          SQLServer took 45 seconds
          PostGresSQL timedout after 45 seconds with java.netsocketTimeoutException
          rm302 Reeta Metta added a comment - Oracle - 5K patientlist took 9.79seconds SQLServer took 45 seconds PostGresSQL timedout after 45 seconds with java.netsocketTimeoutException

          People

            mem61 Mike Mendis
            lcp5 Lori Phillips
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: