ndas frames test

Test Objectives

Verify that ldas is capable is processing ndas frames.

APIs affected by this test

All APIs are exercised via dataPipeline commands.

Setup

ligotools package is required for running this test. Check that it is mounted

Install the following tests script in a directory on your local machine or the ldas system
- verifyndas.tcl - driver script to submit ndas jobs and compare the end results

S2 ndas frame files and S3 frame files must be mounted on ldas system and known to diskcacheAPI:


        create RDS frames must have been run before this test because
        the result frames are needed as input here.


        Test Execution

		cd <your scripts directory>

		
        Usage: verifyndas.tcl [options] >& .log & 

        

            
                Option
                Description
			

                <-s>
                ldas site e.g. dev, lho, ldas-suntest3
        
e.g.

            verifyndas.tcl -s dev >& ndas.ver &
        
		
		
Test Validation:
        
        All dataPipelines should complete successfully

        
The xml files of each job are sorted and saved in a temp file. 
        The difference between the sorted raw frames and RDS frames xml files should be only in the process
        and wrapper data. 
        
        e.g. 
        >          "wrapperAPI","1.2.3","/ldcg_server/common/repository/ldas",778845803,"wrapperAPI is running on 2 nodes.",0,
                    "beowulf","search12",22018,778887032,778887034,31917015,"ldas-dev","process:process_id:0"
        677c677
        <          "wrapperAPI","process:process_id:0","-jobID","int","31917014",
        ---
        >          "wrapperAPI","process:process_id:0","-jobID","int","31917015",

        

        
        
Besides process and wrapper data, the difference between sorted raw frame and ndas frames besides process and wrapper data is a set of real numbers.
        The largest difference between them is always a constant:
        
        
        Largest Error 1: 2.670101e-01 (4.6544586e-04 6.0887286e-04)
        Largest Error 2: 1.054381e-06 (1.4819117187499999e+04 1.4819132812500000e+04)