This description file gives an overview of the directory - and filenaming convention and of the structure of the SOIR datafiles (.TAB) (written by E. NEEFS and A. MAHIEUX) PSA data level 1b ----------------- All the data of the precooling phase (answers to TC1 type commands) and all the data of the observation phase (answers to TC2 type commands) are considered, regardless their scientific usefulness. Assume that the precooling phase lasts Npre seconds and the observation phase Nobs seconds. Each second an observation is made. Source files used for level 1b construction are the Npre + Nobs csv-files at internal SOIR level 0.1. This level has been split in pre-flight and in-flight data: ./Archiving/VEXSPI_0.1_SR_(...)/DATA/pre-flight/YYYYMMDD_ind1_ind2/csv-files/ tmYYYYMMDDhhmmss.csv ./Archiving/VEXSPI_0.1_SR_(...)/DATA/in-flight/YYYYMMDD_ind1_ind2/csv-files/ tmYYYYMMDDhhmmss.csv with YYYY=year, MM=month, DD=day, hh=hours, mm=minutes, ss=seconds, ind1=keyword indicating the observation period (e.g. interference, pointing, mtp01,etc) , ind2=keyword indicating a subdivision in the observation period (e.g. day1, test3, occ12, etc) Example: Sept 12th 2006, MTP 05, Occultation 13 Precooling phase: Npre = 598 - start 2h 54min 21sec , end 3h 4min 18sec: ./Archiving/VEXSPI_0.1_SR_(...)/DATA/in-flight/20060912_mtp005_occ13/ csv-files/tm20060912025421.csv .. ./Archiving/VEXSPI_0.1_SR_(...)/DATA/in-flight/20060912_mtp005_occ13/ csv-files/tm20060912030418.csv Observation phase: Nobs = 593 - start 3h 4min 22sec , end 3h 14min 14sec: ./Archiving/VEXSPI_0.1_SR_(...)/DATA/in-flight/20060912_mtp005_occ13/ csv-files/tm20060912030422.csv .. ./Archiving/VEXSPI_0.1_SR_(...)/DATA/in-flight/20060912_mtp005_occ13/ csv-files/tm20060912031414.csv >From these (Npre + Nobs) source files the PSA data level 1b is constructed resulting in 1 science data table and 2 additional data tables (each table with its associated PDS label). All tables are in ASCII-format. The directory structure and file naming convention and the file contents are discussed in detail further on. Hence the PDS data set for one occultation consists of: 1 science data table and 1 associated label containing time, spectra and housekeeping data: ./VEXSPI_1003_1B/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_OBS.TAB ./VEXSPI_1003_1B/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_OBS.LBL 1 additional data table for telecommand 1 (TC1 suffix) and its associated label: ./VEXSPI_1003_1B/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_TC1.TAB ./VEXSPI_1003_1B/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_TC1.LBL 1 additional data table for telecommand 2 (TC2 suffix) and its associated label: ./VEXSPI_1003_1B/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_TC2.TAB ./VEXSPI_1003_1B/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_TC2.LBL with : * YYYY = year * MM = month * DD = day * T = measurement type * CC = chronological mesurement number of the day (starting at 1) T (measurement type) can have the following values : * I = Ingress (occultation) * E = Egress (occultation) * M = Miniscan * F = Fullscan (outside atmosphere) * A = Fullscan (inside atmosphere) * N = Nadir * C = Pointing calibration Example: Sept 12th 2006, MTP 05, Occultation 13 ./VEXSPI_1003_LEV1B/DATA/20060912_I01/20060912_I01_OBS.TAB ./VEXSPI_1003_LEV1B/DATA/20060912_I01/20060912_I01_OBS.LBL ./VEXSPI_1003_LEV1B/DATA/20060912_I01/20060912_I01_TC1.TAB ./VEXSPI_1003_LEV1B/DATA/20060912_I01/20060912_I01_TC1.LBL ./VEXSPI_1003_LEV1B/DATA/20060912_I01/20060912_I01_TC2.TAB ./VEXSPI_1003_LEV1B/DATA/20060912_I01/20060912_I01_TC2.LBL The science data tables contain all information that can be catalogued per second: time, spectrum, housekeeping. One column is added to distinguish precooling from observation phase data. Its format is shown in Table 4. C1 C2 C3 ... C10 C11 time phase bin0 bin7 housekeeping T1 ... T4 I1 ... I320 I1 ... I320 H1 ... H16 Table: PSA level 1B science data table, TAB-file format Ci (i=1 to 11) are 11 columns * C1 = 4 time items Ts (s=1 to 4) corresponding to the time stamps within 1 second observation (format "2006-08-09T01:30:53.000") (4 x 23 bytes, type character) * C2 = phase ("P" for precooling, "O" for observation phase) (2 bytes, type character) * C3 to C10 = 8 spectrum bins (bin0 through bin7) each bin consisting of 320 items Ij (j=1 to 320) corresponding to pixelj (8 x 320 x 10 bytes, type ASCII_integer) * C11 = 16 housekeeping items Hk (k=1 to 16) (16 x 11 bytes, type ASCII_real) The tables contain Npre + Nobs rows. The additional data tables for the SOIR telecommand of type 1 (issued to start the precooling phase) and type 2 (issued to start the observation phase) both have the format shown in Table 5. C1 C2 telecommand parameter name telecommand parameter value Table: PSA level 1B additional data table for TC1 and TC2, TAB-file format * C1 = name of the telecommand parameter (e.g. dpss, aofs1, deit3, ...) (8 bytes, type character) * C2 = value of the telecommand (8 bytes, type ASCII_integer) The TC1 table contains 10 rows; the TC2 table contains 31 rows. PSA data level 2 ---------------- Only the useful part (= the actual occultation) of the observation phase is considered. Assume a certain occultation containing N observations (= N seconds) at the internal SOIR level 0.3. Assume that in each observation (each second) spectra from P orders are registered. N is typically around 120, P can vary from 1 to 4. Source files used for level 2 construction are the N x P internal level 0.3 science csv-files ./Archiving/VEXSPI_0.3_SR_(...)/DATA/in-flight/YYYYMMDD_mtp0aa_occbb_c/csv/ tmYYYYMMDDhhmmss_orderxxxD.csv the corresponding attitude csv-file ./Archiving/ATTITUDE_FILES/MTPaa/YYYYMMDD_qqq.csv and the corresponding regression coefficient of the full sun spectrum file ./Archiving/VEXSPI_0.3_SR_(...)/DATA/in-flight/YYYYMMDD_mtp0aa_occbb_c/csv/ lin_regr_coeff.csv with YYYY=year, MM=month, DD=day, hh=hours, mm=minutes, ss=seconds, 0aa=mtp number, bb=occultation number in current mtp, c being equal to i in a ingress case or to e in a egress case, xxx=order number, D a letter present in case a given order has been scanned more than once during the occultation (not always present) and qqq=orbit number. Example: Sept 12th 2006, MTP 05, Orbit 144, Ingress, Occultation 13, P = 4 (orders per observation) Observation (second) N = 1 (3h 8min 22sec) ./Archiving/VEXSPI_0.3_SR_(...)/DATA/in-flight/20060912_mtp005_occ13_i/csv/ tm20060912030822_order126.csv ./Archiving/VEXSPI_0.3_SR_(...)/DATA/in-flight/20060912_mtp005_occ13_i/csv/ tm20060912030822_order127.csv ./Archiving/VEXSPI_0.3_SR_(...)/DATA/in-flight/20060912_mtp005_occ13_i/csv/ tm20060912030822_order128.csv ./Archiving/VEXSPI_0.3_SR_(...)/DATA/in-flight/20060912_mtp005_occ13_i/csv/ tm20060912030822_order129.csv .. Observation (second) N = 119 (3h 10min 0sec) ./Archiving/VEXSPI_0.3_SR_(...)/DATA/in-flight/20060912_mtp005_occ13_i/csv/ tm20060912031000_order126.csv ./Archiving/VEXSPI_0.3_SR_(...)/DATA/in-flight/20060912_mtp005_occ13_i/csv/ tm20060912031000_order127.csv ./Archiving/VEXSPI_0.3_SR_(...)/DATA/in-flight/20060912_mtp005_occ13_i/csv/ tm20060912031000_order128.csv ./Archiving/VEXSPI_0.3_SR_(...)/DATA/in-flight/20060912_mtp005_occ13_i/csv/ tm20060912031000_order129.csv ./Archiving/ATTITUDE_FILES/MTP05/20060912_144.csv ./Archiving/VEXSPI_0.3_SR_(...)/DATA/in-flight/20060912_mtp005_occ13_i/csv/ lin_regr_coeff.csv >From these (N x P + 1) source files the PSA data level 2 is constructed resulting in P science data tables and 3 additional data tables (each table with its associated PDS label). All tables are in ASCII-format. The directory structure and file naming convention and the file contents are discussed in detail further on. Hence the PDS data set for one occultation consists of P science data tables and P associated labels containing time, spectra, housekeeping and attitude data ./VEXSPI_2003_2/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_xxx.TAB ./VEXSPI_2003_2/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_xxx.LBL P additional data tables and P associated labels containing corresponding to the regression coefficient of the full sun spectrum file as a function of time ./VEXSPI_2003_2/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_Rxxx.TAB ./VEXSPI_2003_2/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_Rxxx.LBL 1 additional data table for telecommand (TC2 suffix) and its associated label ./VEXSPI_2003_2/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_TC2.TAB ./VEXSPI_2003_2/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_TC2.LBL 1 additional data table for treatment (TRT_suffix) and its associated label ./VEXSPI_2003_2/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_TRT.TAB ./VEXSPI_2003_2/DATA/YYYYMMDD_TCC/YYYYMMDD_TCC_TRT.LBL with : * YYYY = year * MM = month * DD = day * T = occultation type * CC = chronological mesurement number of the day (starting at 1) * xxx = order number T can have the following values : * I for an ingress occultation * E for an egress sunrise that was part of a sunrise + sunset combination), Example: Sept 12th 2006, MTP 05, Orbit 144, Occultation 13, P = 4 (orders per observation) 20060912_I01/20060912_I01_126.TAB 20060912_I01/20060912_I01_126.LBL 20060912_I01/20060912_I01_127.TAB 20060912_I01/20060912_I01_127.LBL 20060912_I01/20060912_I01_128.TAB 20060912_I01/20060912_I01_128.LBL 20060912_I01/20060912_I01_129.TAB 20060912_I01/20060912_I01_129.LBL 20060912_I01/20060912_I01_R126.TAB 20060912_I01/20060912_I01_R126.LBL 20060912_I01/20060912_I01_R127.TAB 20060912_I01/20060912_I01_R127.LBL 20060912_I01/20060912_I01_R128.TAB 20060912_I01/20060912_I01_R128.LBL 20060912_I01/20060912_I01_R129.TAB 20060912_I01/20060912_I01_R129.LBL 20060912_I01/20060912_I01_TC2.TAB 20060912_I01/20060912_I01_TC2.LBL 20060912_I01/20060912_I01_TRT.TAB 20060912_I01/20060912_I01_TRT.LBL The science data tables contain all information that can be catalogued per second in the observation for one specific order time, spectrum, housekeeping, attitude of the S/C. It has the format shown in Table 6. C1 C2 C3 C4 C5 C6 C7 time wavenumber bin 1 wavenumber bin 2 bin 1 bin 2 housekeeping attitude W1 ... W320 W1 ... W320 I1 ... I320 I1 ... I320 H1 ... H16 A1 ... A28 Table: PSA level 2 science data table, TAB-file format Ci (i=1 to 7) are 7 columns * C1 = time stamp corresponding to the order in the filename (format "2006-08-09T01:30:53.000") (23 bytes, type character) * C2 = wavenumber for bin 1 consisting of 320 items Wj (j=1 to 320). Each wavenumber Wj corresponds to one pixelj (320 x 7 bytes, type ASCII_real) * C3 = wavenumber for bin 2 consisting of 320 items Wj (j=1 to 320). Each wavenumber Wj corresponds to one pixelj (320 x 7 bytes, type ASCII_real) * C4 = spectrum from bin 1, consisting of 320 items Ij (j=1 to 320) corresponding to wavenumber Wj (320 x 10 bytes, type ASCII_real) * C5 = spectrum from bin 2, consisting of 320 items Ij (j=1 to 320) corresponding to wavenumber Wj (320 x 10 bytes, type ASCII_real) * C6 = 16 housekeeping items Hk (k=1 to 16) (16 x 11 bytes, type ASCII_real) * C7 = 28 attitude items Am (m=1 to 28) (28 x 11 bytes, type ASCII_real) The additional data table contains the regression coefficient of the full sun spectrum file as a function of time for this occultation. It has the format shown in Table 7. C1 C2 ... C1+i ... C321 C322 ... C321+i ... C641 bin number a coefficient a coefficient a coefficient b coefficient b coefficient b coefficient of regression for of regression for of regression for of regression for of regression for of regression for pixel 1 pixel i pixel 320 pixel 1 pixel i pixel 320 Table: PSA level 2 data table contains the regression coefficient of the full sun spectrum, TAB-file format * C1 = value of the telecommand (8 bytes, type ASCII_integer)) * C2 ... C321 and C322 ... C641 = value of the regression coefficient a and b (3519 bytes, type ASCII_integer) The additional data table for telecommand contains the SOIR telecommand of type 2 issued to start the observations for this occultation. It has the format shown in Table 8. C1 C2 telecommand parameter name telecommand parameter value Table: PSA level 2 additional data table for TC2, TAB-file format * C1 = name of the telecommand parameter (e.g. dpss, aofs1, deit3, ...) (8 bytes, type character) * C2 = value of the telecommand (8 bytes, type ASCII_integer) The table contains 31 rows. The science data table for treatment contains the history of processes the SOIR data underwent from their retrieval from the DDS until their insertion in PSA level 2. It has the format shown in Table 9. C1 C2 treatment action name treatment action value Table: PSA level 2 additional data table for TC2, TAB-file format * C1 = name of the treatment action (e.g. 0.1_to_0.2_script_version, 0.2_to_0.3_wavenumber_correction_file, 0.3_to_1.0_PDS_creation, etc) (40 bytes,type character) * C2 = value of the treatment action (16 bytes, type character) The table contains 6 rows.