Uploaded image for project: 'i2b2 Core Software'
  1. i2b2 Core Software
  2. CORE-313

CRC-PDO: AverageObservationPageMethod doesnt work

Details

    • Bug
    • Status: Reopened
    • Major
    • Resolution: Unresolved
    • None
    • TBD
    • None
    • None
    • Hide
      The way to test this is to
      1. Modify the crc properties file to use
      # Paging method can be SUBDIVIDE_INPUT_METHOD/AVERAGE_OBSERVATION_METHOD
      edu.harvard.i2b2.crc.pdo.paging.method=AVERAGE_OBSERVATION_METHOD

      2. Request a PDO using a large data set that exceeds the observation fact page size of 5000. This method will converge on a page size much faster than the SUBDIVIDE method
      Show
      The way to test this is to 1. Modify the crc properties file to use # Paging method can be SUBDIVIDE_INPUT_METHOD/AVERAGE_OBSERVATION_METHOD edu.harvard.i2b2.crc.pdo.paging.method=AVERAGE_OBSERVATION_METHOD 2. Request a PDO using a large data set that exceeds the observation fact page size of 5000. This method will converge on a page size much faster than the SUBDIVIDE method
    • edu.harvard.i2b2.crc

    Description

      This method was converging on a page size that was over the page size limit. Fix was to alter the algorithm.

      Attachments

        Activity

          lcp5 Lori Phillips created issue -
          lcp5 Lori Phillips made changes -
          Field Original Value New Value
          Status New [ 10000 ] Open [ 1 ]
          lcp5 Lori Phillips made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          lcp5 Lori Phillips made changes -
          Developer Notes The way to test this is to
          1. Modify the crc properties file to use
          # Paging method can be SUBDIVIDE_INPUT_METHOD/AVERAGE_OBSERVATION_METHOD
          edu.harvard.i2b2.crc.pdo.paging.method=AVERAGE_OBSERVATION_METHOD

          2. Request a PDO using a large data set that exceeds the observation fact page size of 5000. This method will converge on a page size much faster than the SUBDIVIDE method
          Fix Version/s 1.7.11 [ 10703 ]
          Server Plug-in/s Modified edu.harvard.i2b2.crc [ 10114 ]
          Status In Progress [ 3 ] Ready to Test [ 10001 ]
          rm302 Reeta Metta made changes -
          Link This issue clone of CORE-315 [ CORE-315 ]
          rm302 Reeta Metta made changes -
          Link This issue clone of CORE-315 [ CORE-315 ]
          rm302 Reeta Metta made changes -
          Assignee Lori Phillips [ lcp5 ] Reeta Metta [ rm302 ]
          rm302 Reeta Metta made changes -
          Status Ready to Test [ 10001 ] Testing [ 10002 ]
          rm302 Reeta Metta added a comment -
          needs to be fixed for SQL server and PostgreSQL
          rm302 Reeta Metta added a comment - needs to be fixed for SQL server and PostgreSQL
          rm302 Reeta Metta made changes -
          Assignee Reeta Metta [ rm302 ] Mike Mendis [ mem61 ]
          Status Testing [ 10002 ] Reopened [ 4 ]
          mem61 Mike Mendis made changes -
          Status Reopened [ 4 ] In Progress [ 3 ]
          mem61 Mike Mendis made changes -
          Fix Version/s 1.7.12 [ 10901 ]
          rm302 Reeta Metta added a comment -
          check for performance with large PDO set
          rm302 Reeta Metta added a comment - check for performance with large PDO set
          rm302 Reeta Metta made changes -
          Assignee Mike Mendis [ mem61 ] Reeta Metta [ rm302 ]
          rm302 Reeta Metta made changes -
          Status In Progress [ 3 ] Ready to Test [ 10001 ]
          rm302 Reeta Metta made changes -
          Status Ready to Test [ 10001 ] Testing [ 10002 ]
          rm302 Reeta Metta added a comment -
          Oracle - 5K patientlist took 9.79seconds
          SQLServer took 45 seconds
          PostGresSQL timedout after 45 seconds with java.netsocketTimeoutException
          rm302 Reeta Metta added a comment - Oracle - 5K patientlist took 9.79seconds SQLServer took 45 seconds PostGresSQL timedout after 45 seconds with java.netsocketTimeoutException
          rm302 Reeta Metta made changes -
          Assignee Reeta Metta [ rm302 ] Mike Mendis [ mem61 ]
          Status Testing [ 10002 ] Reopened [ 4 ]
          rm302 Reeta Metta made changes -
          Fix Version/s 1.7.13 [ 10902 ]
          rm302 Reeta Metta made changes -
          Fix Version/s 1.7.12 [ 10901 ]
          rm302 Reeta Metta made changes -
          Fix Version/s TBD [ 11005 ]
          Fix Version/s 1.7.11 [ 10703 ]
          Fix Version/s 1.7.13 [ 10902 ]

          People

            mem61 Mike Mendis
            lcp5 Lori Phillips
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: