[Input: titlepage.lyx] DISTRIBUTION LIST [float Table: +----------------------+------------------------------------+ | Recipient | Organization | +----------------------+------------------------------------+ | Jean-Pierre Bibring | Institut d'Astrophysique Spatial | +----------------------+------------------------------------+ | Yves Langevin | Institut d'Astrophysique Spatial | +----------------------+------------------------------------+ | Michel BerthŽ | Institut d'Astrophysique Spatial | +----------------------+------------------------------------+ | David Heather | SRE-OS/ESAC | +----------------------+------------------------------------+ ] [Input: changelog.lyx] Table of Contents List of Figures List of Tables 1 Introduction 1.1 Purpose and Scope The purpose of this EAICD (Experimenter to Planetary Science Archive Interface Control Document) is twofold. First it provides users of the OMEGA instrument with detailed description of the product and a description of how it was generated, including data sources and destinations. Secondly, the EAICD describes the interface to the Planetary Science Archive (PSA) of ESA and is the official document between each experimenter team and the PSA. 1.2 Archiving Authorities The Planetary Data System Standard is used as archiving standard by: • NASA for U.S. planetary missions, implemented by PDS • ESA for European planetary missions, implemented by the Research and Scientific Support Department (RSSD) of ESA ESA implements an online science archive, the Planetary Science Archive (PSA) • to support and ease data ingestion • to offer additional services to the scientific user community and science operations teams as e.g.: – search queries that allow searches across instruments, missions and scientific disciplines – download of data products, linked files and data sets The PSA aims for online ingestion of logical archive volumes and will offer the creation of physical archive volumes on request. 1.3 Contents This document describes the data flow of the OMEGA instrument on Mars Express from the S/C until the insertion into the PSA for ESA. It includes information on how data were processed, formatted, labeled and uniquely identified. The document discusses general naming schemes for data volumes, data sets, data and label files. Standards used to generate the product are explained. Software that may be used to access data product is explained. The design of the data set structure and the data product is given. Examples of these are given in the appendix. 1.4 Intended Readership The staff of the archiving authority (Planetary Science Archive, ESA, RSSD, design team) and any potential user of the OMEGA data. [math macro] [math macro] 1.5 Applicable Documents 1. Planetary Data System Data Preparation Workbook, February 17, 1995, Version 3.1, JPL, D-7669, Part1 2. Planetary Data System Standards Reference, August 1, 2003, Version 3.6, JPL, D-7669, Part 2 3. Mars Express Archive Generation, Validation and Transfer Plan, 2001 June 21, ESA-MEX-TN-4009 4. OMEGA Flight User Manual: OME-DU-0023-118-IAS, Version 3.0 5. Report of the IAU/IAG working group on cartographic coordinates and rotational elements of the planets and satellite: 2000, P.K. Seidelman, et al., Celestial Mechanics and Dynamical Astronomy, in Press, 2002. 6. Planetary Science Data Archive Technical Note, Geometry and Position Information, 8 October 2004, SOP-RSSD-TN-010, Issue 3 - Revision 3 [math macro] [math macro] 1.6 Acronyms and Abbreviations AD Applicable Document APID Application Process IDentifier CNES Centre National d'Etudes Spatiales DESPA DŽpartement de Recherches Spatiales DN Digital Number DDS Data Delivery System EAICD Experiment Archive Interface Control Document ESA European Space Agency ESOC European Space Operation Center ESTEC European Space Research and Technology Center FOV Field of View HK Housekeeping IAS Institut d'Astrophysique Spatiale IFOV Instantaneous Field of View IFSI Istituto di Fisica dello Spazio Interplanetario IKI Institut Kosmitcheski Isledovanie ISIS Integrated Software for Imaging Spectrometers IR Infrared OBT On Board Time MEX Mars Express NAIF Navigation Ancillary Information Facility OMEGA Observatoire pour la MinŽralogie, l'Eau, les Glaces et l'ActivitŽ PDS Planetary Data System PI Principal Investigator PSA Planetary Science Archive PVV PSA Volume Verifier RD Reference Document ROM Read-Only Memory S/C Spacecraft SCET Spacecraft Elapsed Time SWIR Short Wavelength Infrared channel TBC To Be Confirmed TBD To Be Defined VNIR Visible and Near Infrared channel WRT With Respect To 1.7 Contact Names and Addresses Gilles Poulleau, IAS Overall responsibility, automatic processing gilles.poulleau@ias.u-psud.fr +33 (0) 1 69 85 86 05 Brigitte Gondet, IAS Level 1 and 2 products, calibration brigitte.gondet@ias.u-psud.fr +33 (0) 1 69 85 86 35 Yves Langevin, IAS Software responsibility yves.langevin@ias.u-psud.fr +33 (0) 1 69 85 86 81 Nicolas Manaud, IAS Geometry products nicolas.manaud@ias.u-psud.fr +0033 (0) 1 69 85 86 20 Stephane Erard, IAS Level-3 and derived products stephane.erard@ias.u-psud.fr +33 (0) 1 69 85 86 41 2 Overview of Scientific Objectives, Instrument Design, Data Handling Process and Product Generation 2.1 Scientific Objectives The OMEGA mapping spectrometer will map the Martian surface with an IFOV of 1.2 mrad (4.1 arc minutes), and acquire for each resolved pixel the spectrum from 0.36 to 5.2 \mu m in 352 contiguous spectral channels (spectels). The optical part consists in two co-aligned units, each including a telescope: a Visible Channel (VNIR) analyses the light from 0.36 to 1.07 \mu m , using as a detector a bi-dimensional CCD THX7863 Thomson detector in a pushbroom mode: 96 spectral lines of 128 columns, imaging at once a crosstrack line of 128 pixels large at the surface of Mars; a Near Infrared Channel, named SWIR (Short Wavelength IR Channel) disperses the light through two spectrometers from 0.93 to 2.7 \mu m and 2.6 to 5.2 \mu m , onto two linear InSb arrays (whiskbroom mode) cooled down 70K, each with a dedicated cryocooler. A scanning mirror in front of the SWIR telescope permits to acquire crosstrack swaths of 16 up to 128 pixels width, for a maximum FOV of 8.8 degrees, thus matching the VNIR FOV. SNR of ³ 100 over the entire spectral range, for IR integration times of 5 ms per pixel, is the specification. Combining imagery and spectrometry, OMEGA is designed to provide the mineralogical and molecular composition of the surface and atmosphere of Mars through the spectral analysis of the re-diffused solar light and surface thermal emission. OMEGA will provide a global coverage at medium resolution (1 to 5 km) of the entire surface of Mars from altitudes 1000 to 4000 km, and snapshots of selected areas, amounting to at least a few percents of the surface, with a resolution of a few hundreds meters when observed close to periapsis (300 km altitude). More specifically, with the above-mentioned spatial resolution, OMEGA should allow: • to characterize the composition of surface materials, discriminating between the various classes of silicates, hydrated minerals, oxides and carbonates, organic frosts and ices; • to study the time and space distribution of atmospheric CO2, CO and H2O; • to identify the aerosols and dust particles in the atmosphere, and observe their time and space distributions • to monitor the surface dust transportation processes. 2.2 Instrument Design OMEGA is a mapping spectrometer working both in the visible and the infrared spectral ranges. It is constituted of two co-aligned channels, one working in the 0.38 to 1.05 \mu m visible and near infrared range (VNIR channel), the other in the 0.93 to 5.1 \mu m short wavelength infrared range (SWIR channel). The data products constitute three-dimensional (X, Y, lambda) image-cubes, with two spatial and one spectral dimension. The VNIR channel uses a bi-dimensional CCD detector, operated in a pushbroom mode. Its telescope acquires at once in its focal plane one cross-track line corresponding to the entire 8.8 degrees FOV, defined by an entrance slit; the second dimension of the image is provided by the motion of the S/C. Each line is spectrally dispersed along the columns of the array, the slit being imaged through a concave holographic grating. The SWIR channel operates in the whiskbroom mode: each imaged pixel is acquired at once by an IR telescope; a scanning mirror, in front of the telescope, permits to acquire crosstrack swaths of 16 up to 128 pixels width, for a maximum FOV of 8.8 degrees, thus matching the VNIR FOV, while the S/C motion provides the second spatial dimension. The imaged pixel is focused by the telescope on a slit, followed by a collimator. The beam is then split towards two separated spectrometers, to acquire the IR spectrum of each resolved pixel onto two InSb linear arrays of 128 spectels each, from 0.93 to 2.73 \mu m and from 2.55 to 5.1 \mu m respectively. Each array is cooled down 70 K by a dedicated cryocooler, while the entire spectrometer is cooled down 190 K by a conductive link to a passive radiator. The typical IR integration time, defined by the S/C ground track velocity and the spatial sampling chosen, is 5 msec. The corresponding VNIR integration times are 100 to 800 ms, depending on the swath width, thus the altitude. With such integration times, SNR > 100, over the entire spectral range, is the specification. OMEGA is made of two distinct units: • a Camera unit (OMEGA-C) with the VNIR and SWIR spectrographs, their associated electrical devices, and one electronics assembly for the control of the camera. All units are integrated onto a common base plate; its mass is 23.8 kg. • a Main Electronics module (OMEGA-ME), for the data processing and the general management of the instrument; its mass is 5.1 kg. VNIR spectrograph VNIR is made of two optical subsystems: a focusing telescope with its focal plane on a slit, and a spectrometer, that spreads the slit image in the spectral dimension. It provides image data in the spectral range 0.38 to 1.05 \mu m achieving a maximum spatial sampling of 0.4 mrad and a maximum spectral sampling of 50 Angstrom. A refractive telescope focuses the image on a slit placed on the Rowland circle of an aberration corrected concave holographic grating mirror. This element reflects and disperses the light on a CCD detector tangent to the Rowland circle. The detector used is the TH7863 frame transfer CCD produced by Thomson. The chosen grating mirror can create a flat image onto the focal plane. This property allows to match very well the flat detector matrix to the grating, without other optical components. A CCD frame is then composed of N rows each containing an image of the slit at a given wavelength, and M columns each containing the spectrum of a point along the slit. The bi-dimensional image of the surface is obtained by the pushbroom technique, in which the spacecraft movement along its orbit performs a scan of the slit across the planetary surface. The electrical signal from the detector is amplified and then digitized by a fast 12 bit A/D converter; after conversion, all data are processed within the OMEGA-ME. In order to decrease the detector noise, VNIR is cooled down 190 K by conduction to the SWIR mechanical unit. The choice of refractive over reflective optics was made because of the large (8.8 degrees) field of view requirement. The telescope has a 6 elements objective similar to that of a modern commercial photographic camera. The shape of the elements and the types of optical glass were chosen to obtain the best chromatic aberration corrections over the entire spectral range. The last element serves as a field lens, which matches the entire objective with the grating to avoid light losses. To avoid stress in the lenses at the working temperature, the two doublets are not cemented. The two glasses, FK54 and fused silica, have very different expansion coefficients of 8 and 0.55 x 10^{-6} / K at room temperature. The entrance aperture of 15.6 mm is defined by a diaphragm between the two doublets. An aberration corrected concave holographic grating is placed 142.7 mm from the entrance slit (which is in the focal plane of the telescope). The grating is tilted to form the spectrum at an angle of roughly 6 degrees from the optical axis. This angle does not allow CCD insertion near the entrance without beam obscuration; therefore, a folding mirror deflects the beam toward the side of the assembly, where the CCD can be mounted with ample clearance. The zero order spectrum, at 4.5 degrees from the folded optical axis (lying in the y-z plane) is directed into a light trap to prevent degradation of the image. The first order spectrum ranges in angle from 6 degrees at \lambda=0.35\mu m to 10 degrees for \lambda=1.05\mu m. The second and higher order spectra can, in principle, also degrade the data. Its contribution depends both on the grating efficiency, and the spectral distribution of the incident radiation. For this reason, a dedicated filter is mounted, in front of the detector. The concave, spherical, holographic grating in a Rowland mounting - where the entrance slit and the spectrum are on radii of curvature of the grating - makes the spectrometer compact, light, and simple. In fact, no collimator or camera lens is required and the spectrometer has only one element. Moreover, the focal plane image can be flat, to match the planar CCD sensors. Since the concave holographic grating is obtained by recording a perfect optical pattern with groove spacing absolutely constant, it has no ghosts. Stray light has also a much lower level than the best ruled gratings. Therefore, concave holographic gratings generally have a much higher signal to noise ratio than classically ruled gratings. The optical performances have been computed by ray tracing. In the focal plane the spot diagram is about the pixel size (23x23 microns). For off-axis propagation (4.4 degrees off-axis), the total spot size is about 2 pixels in the sagittal direction. More precisely, on axis and at 0.7 \mu m , 98.8 % of the energy falls within a 23x23 micron pixel; at 4.4 degrees off-axis and lambda = 0.4 \mu m , 74 % of the energy falls within a CCD element. When the light propagates off-axis, the spot size is smaller for the shorter wavelengths. The Pattern Generator (PG) determines the CCD integration time, and generates the timing signals necessary to transfer an image from the light sensitive area to the masked zone and then to the output shift register of the CCD. The output of the CCD is then amplified and converted by a fast 12-bit A/D converter under control of the PG. The timing of the instrument imposes a relatively high frequency for CCD operation. In fact, depending on the distance from the planet and hence on the spacecraft speed, the time TR between consecutive frames can be chosen as: 100, 200, 400 or 800 ms. During the TR period the integration, readout and data transmission processes must occur. To save time, integration and transmission of the previous frame are overlapped. Because the maximum data value, which can be transmitted during TR, is limited to 12288 bytes, it is not possible to read the total frame of 384x288 pixels, corresponding to 110592 bytes. We are forced to read only a sub-frame, or to reduce the number of pixels by summing them on chip. The combination of different scientific requirements, integration times and hardware limitations led us to the definition of 40 operation modes, which can be selected through commands sent to the spacecraft, ranging from the nominal (spatial x spectral) mode (128x96 with summation of 3x3 pixels), to the high spectral resolution mode (64x144), too the high speed mode (16x96) Summation along columns and rows will decrease the spatial and spectral resolution, but increases signal-to-noise ratio considerably. The implementation of mode 16x74 is the most critical due to the short time available to complete all the operations (TR = 100 ms). For this reason the Pattern Generator provides two values for the pixel readout frequency: f_{slow} = 500 kHz when the pixel voltage has to be digitized and f_{fast} = 4 MHz when the pixel is simply read from the CCD output register without any digital conversion. SWIR Spectrograph The IR channel is constituted of a telescope and its fore-optics, a beam splitter and two spectrometers, each with its detector array actively cooled. The telescope is a Cassegrain type one with a 200 mm focal length, a f/4 aperture, leading to a 1.2 mrad (4.1 arcmin) IFOV, and a 15 arcmin free field of view (including the positioning tolerances). The distance between the primary and the secondary mirrors is 51 mm; that between the secondary mirror and the image plane is 82 mm. In front of the telescope, a fore-optics system has the primary goal of providing a cross-track scanning of the IFOV. It includes two mirrors, a moving and a fixed one. The total scanning angle is \pm 4.4 degrees (FOV = 128 IFOV), and is adjusted to the OMEGA viewing direction. The control of the scanning mechanism is performed by a dedicated FPGA-based electronic sub-system. Focused by the telescope on an entrance slit, through a shutter, the beam is first collimated, then separated, by a dichroic filter with its cut-off wavelength at 2.7 \mu m towards two spectrometers, operating in the following spectral ranges: 0.93 to 2.73 \mu m and 2.55 to 5.1 \mu m . Each spectrometer includes a blazed grating working at its first order, and an optical reflective system, then a field mirror and a refractive refocusing system which gives a large aperture on the detection block (f/1.6): it images the spectrum onto a 128 elements InSb linear array, cooled down a temperature of < 80 K, and multiplexed by a charge transfer device. Sets of filters are implemented in front of the detector to reject the contribution of other orders from the grating. The InSb photodiodes have been manufactured by SAT. The dimension of each photosensitive element is 90 micron x 120 microns, with a pitch of 120 micron. All elements of the focal planes are hybridized on a ceramic with two electric circuit layers to connect the elements together. The ceramic is glued on a titanium base plate and covered with a titanium closure, which includes the filters. An internal calibration source is implemented, to control potential shifts of the overall spectrometer transmission, and to calibrate the relative response of each pixel. It is made of a tungsten lamp, operated as a black body, which can be power, heated at different temperatures. The calibration beam is reflected towards the spectrometer by diffusion on the backside of the entrance slit. SWIR requires an accurate thermal control, at three levels: • the IR detectors must be cooled down a temperature of < 80 K, controlled with an accuracy better than 0.1K. This is done by connecting them (copper heat link) to two cryocoolers, one for each array: they consist in Inframetrics 13000 series integral Stirling cycle coolers. Their guaranteed lifetimes are > 2500 hours. They are controlled by a dedicated electronics • the spectrometer must be cooled down to 190 K, in order both to allow the detectors to reach their required operational temperature (< 80 K), and to minimize the thermal background. This is achieved by conductive coupling (heat pipes) to a “low temperature” radiator, provided by the S/C; • the electronics and the cryocoolers heads must be coupled (copper links) to a “high temperature” (280 K) radiator to dissipate their energy. OMEGA-ME Unit The OMEGA main electronics is designed to power and control the instrument, to acquire and compress all scientific data on line, and to interface with the S/C telecommand/telemetry system. The entire system is cold redundant. Within OMEGA-ME, the Command and Data Processing Unit (CDPU) has the following tasks: • acquisition of all scientific data from VNIR and SWIR; • formatting for real time data compression • wavelet based data compression, followed by formatting of processed data • reception and formatting of HK data • forward all data to the S/C telemetry system The CDPU is based on a TSC21020 Temic processor, and integrated, together with a 6Mbyte SRAM, into a 3D packaged highly miniaturized cube, inherited from a ‚IVA/Rosetta development. Institut d'Astrophysique Spatiale is responsible for data preparation and distribution to CoI's. The relevant contact information is provided in section [sec:contact] page [sec:contact] . The following table describes the OMEGA data processing level: [float Table: Processing Level Definition 1A Raw data that have been separated by instrument and sorted by orbit number. It contains science and housekeeping data. 1B PDS formatted data, including decompressed science data, housekeeping, and geometry data. The science data are still uncalibrated. 2 Calibrated science data resulting from the data reduction done by the OMEGA software provided the dataset. 3 High level derived product such as mineralogical maps [Table 1: Data Level Definition ] ] IAS recovers two types of information relevant to OMEGA data: • All packets with an OMEGA APID (pull from ESOC dds to IAS) • SPICE kernels (pull from ESTEC navigation database to IAS). They are automatically processed into OMEGA data products, using the following procedure. 1. Every 12 hours, the IAS gateway server checks the arrival of new OMEGA packets on the DDS server at ESOC. Science packets are sorted by orbit number (4 digits) by comparing the generation time of the packet and the sequence of apocenter times. The corresponding file, , constitutes the level-1A data product (archived at ESOC for six months and at IAS permanently). The HK packets are also sorted by orbit number, constituting a file . If during such a search a new packet is found which belongs to an orbit with an already existing or file, the file is reopened and the packet is inserted at the ranking corresponding to increasing APID's. Only the last packet with a given APID is kept. If there is no file associated with the orbit of the packet, a corresponding is opened. At the end of the check procedure, all opened files are closed. 2. Once the checking procedure is complete, the server automatically reprocesses all level-1A data files, which have been created or modified. It sorts out the high rate telemetry packets, then decompresses the data and produces a series of preliminary PDS data cubes. Each data cube corresponds to the interval between the start and end of an observation (with a given set of observation parameters). There can be several observations for one orbit. The corresponding cubes are named , , ..., , then , then , , and so on if there are more than 10 cubes for an orbit. 3. After all the relevant level-A files have been processed, the server processes each new preliminary cube by determining the geometric information relevant for each of the three channels, each scan and each pixel, and using the latest relevant kernel received from ESTEC. This generates an auxiliary geometry file, . Part of the overall geometric information (e.g. minimum and maximum latitude, westernmost and easternmost longitude) is included in the label of the preliminary data cube, generating a final level-1B data cube . The format of level-1B PDS files and associated auxiliary PDS files is given in section 5.2. 4. Every 24 hours, the kernel directory in ESTEC is checked. If a new kernel is available, it is retrieved by the server. All auxiliary geometry cubes with dates, which are covered by the new kernel, are then reprocessed so as to take into account this new positioning and/or pointing information. The corresponding level-1B data cubes are updated accordingly. 5. After 30 days, it is considered that the navigation information will not be updated for a given orbit. Every 24 hours, each auxiliary geometry cube for which the orbit is older than 30 days is copied into a geometry cube, , which is therefore expected to provide the most accurate information on the observation geometry. To each science level-1B PDS file is associated a geometry PDS file containing information on the projection of the looking directions on the surface of Mars. The format of level-1B PDS files and associated geometry PDS files is given in section 4.1. The level-1B cubes will be used by the OMEGA team and they will be archived at the ESA's Planetary Science Archive (PSA) for long term preservation. During the proprietary period, a data reduction tool in IDL is made available to all coI's to read the level-1B data set and to convert it into a data set corrected for the photometric function, hence in physical units (W/m^{2}/steradian/\mu ). This data set is relevant for regions of the spectrum dominated by thermal emission (typically above 4 \mu m ). Another data set is provided in I/F, dividing by the solar spectrum, which is relevant for the region of the spectrum dominated by diffused sunlight (typically below 3 \mu m ). These two data cubes have the same dimensions as the corresponding level-1B cube. Eventually, The spectral information will be co-registered to the looking direction of the 65th spectel of the "IR C" channel of the OMEGA experiment. These processing tools are built on the best knowledge available on the instrument from ground calibration, self-consistency checks and comparison with other experiments (e.g. MOLA for altimetry data, THEMIS for spectral data). The OMEGA user is made aware that this understanding will evolve with the learning curve on the actual behaviour of OMEGA around Mars. The signal/noise obtained by OMEGA can exceed 1000 over part of the wavelength range, not taking into account the along-track summing by a factor of 1 to 4 which can be performed on-board when 128 scans are implemented. No ground calibration can provide that level of confidence, in particular for visible-near IR imaging spectrometry. As an example, for this type of experiments, an absolute photometric calibration level of 10 % is considered an ambitious goal, which can only be achieved after careful cross-comparison of actual data with the results of ground calibration and that of other experiments. Linearity or cross-talk at a level of a few percent has been observed to depend strongly on the stimulus during ground calibration. The Planetary Data Center at IAS will also maintain an archive of the OMEGA products. Level-1B, geometry files and various software tools will be distributed to co-Is during the operational phase, Example derived products (level-3 files) will also be produced and distributed at IAS as examples of the science which can be done with OMEGA. They will also be provided to the archive when available in a PDS compliant format. 2.3 Overview of Data Products 2.3.1 Pre-Flight Data Products No ground calibration information will be made available. The OMEGA team will provide and update relevant information so that the processing pipeline is up to date with the current understanding of the characteristics of OMEGA. 2.3.2 Sub-System Tests The only relevant sub-system test for this purpose will be performed if an anomaly is observed in the data packets. A fixed test data set can be generated by a specific command so as to check the integrity of the downlink chain, in any of the possible observation modes of OMEGA. The processing pipeline will generate a level 1B file with a fixed data pattern, which will have exactly the same format as a real observation with the same parameters. 2.3.3 Instrument Calibrations Calibration files (at IAS and PSA) Spectral Table giving for each channel (96 or144 visible, 256 IR) the exact spectral position Geometric Table giving for each pixel along a line (128 elements) the angular viewing direction Radiometric Transfer functions for each of the three channels, covering (0.35-5.2 \mu m ) The current version of the photometric function, the wavelength scale and the solar spectrum at OMEGA wavelengths, are provided together with the OMEGA data reduction software. 2.3.4 Other Files written during Calibration A series of observations of rocks and powders has been performed during calibration. This data set will be made available through a direct collaboration with the PI team. 2.3.5 In-Flight Data Products Raw data (at ESOC, PSA and IAS) ESOC and PSA will archive all data downlinked by MEX, sorted by APID. IAS will archive the packets relevant to OMEGA in dds format. Experiment Data Records (at IAS and PSA) Level-1B Science data product: One file, in PDS format, for each observation, including decompressed science data (level-1B), and all omega acquired HK. Derived Data Records (at IAS and PSA) Level-1B Geometry data product: One file, in PDS format, for each session, including all S/C derived geometrical information. A given file applies to a level-1B science data file and to the corresponding level-2 science data file. Reduced Data (at IAS, with selected subsets at PSA) Level-3 Science data product Example results when available. 2.3.6 Software Pipeline processing software MAKE_PDS tool is used to generate science level-1B data products. It will not be distributed neither at IAS nor PSA. GEOMEG is an IDL library designed to generate the OMEGA geometry data products. This software will be archived at PSA. The tool is a SPICE-based software using the MEX kernels data set as ancillary data (see 2.4.9 for details), and the MGS MOLA Mission Experiment Gridded Data Records as global topographic maps. The main GEOMEG functionalities are: • searching/loading required kernels • computing geometry information at times of pixels signal acquisition • formatting data in PDS format • updating science data product label Data reduction software The archive will include the software tools to reduce level 1B PDS cubes, but not the reduced data cubes, as these may evolve rapidly during the mission. The software tools will be included in the SOFTWARE directory as ZIP files indicating the version number. A new version will be provided as a release when warranted by deeper level knowledge of instrument behaviour. It contains a readme file, which indicates the changes since the last version (in particular in terms of photometric function and geometric calibration) and the confidence level, i.e. the magnitude of the variations in terms of spectral features, which are considered reliable by the PI team. These are expected to improve until the end of the mission. After the proprietary period, the same information (level-1B and processing tool to level-2) will be made available to the wide scientific community. The wide scientific community will be made aware that this "best-effort" level-2 processing tools may be superseded by later versions as the understanding of the instrument behaviour around Mars continues to improve. The users are strongly advised to take into account the confidence levels in the readme file encoded in the software package when publishing scientific results. The basic software tools (and its required input files, all in IDL) will be archived as part of the data volumes provided by IAS. A library written in C with the same capabilities will be provided in the software package so as to provide access to users, which cannot use IDL due to funding limitations. 2.3.7 Documentation The main document provided in the DOCUMENT subdirectory is the EAICD itself, which contains all the relevant information on the content of the level-1B science PDS cube and the corresponding geometry cube. The OMEGA Flight User Manual will also be provided as WORD and PDF document. Additional information is provided as small ASCII text file pointed by the data product label. Please refer to the section [sec:DocumentDirectory] page [sec:DocumentDirectory] describing the DOCUMENT directory content. 2.3.8 Derived and other Data Products All derived data (level-3) will be distributed in PDS format at IAS when ready, including: • Spectral cubes providing radiance spectra of the whole surface, derived from data merging of low-resolution observations. The tiling scheme is TBD, but will be as consistent as possible with other experiment products (TES...). • Cubes of modelled surface spectra, consisting in data spectrally merged with first order correction for thermal emission, atmospheric absorption and scattering, and surface photometric effects. These spectra will provide an estimate of surface normal albedo between 0.35 and 5.2 \mu m . • Spectral units maps, as derived from data analysis, together with corresponding type spectra. • Mineralogical maps deriving from data analyses. These maps will represent mineralogical fractions and estimated grain size in the observed regions. • Seasonal maps (clouds, dust storms, etc...). • Data derived from limb observations (gas and dust profiles, etc...). Representative level-3 products (maps) will be delivered to ESA for public outreach purpose. 2.3.9 Ancillary Data Usage As mentioned in section [sec:Software], we use SPICE kernels to generate the geometry data products. SPICE kernels are ancillary data files, which hold all the relevant information required to produce OMEGA observation geometry calculation. MEX-specific kernels are either converted from ESOC auxiliary data: orbit attitude, and time correlation files, or designed by the NAIF team. The following table described the kernels used by GEOMEG. This software also uses global topographic maps of Mars provided by the MOLA Mission Experiment Gridded Data Records (MEGDRs) at resolutions of 64, and 128 pixels per degree. See http://pds-geosciences.wustl.edu/missions/mgs/megdr.html for further details. [float Table: Type File Name Description SPK This file contains a Mars Express predict ephemeris after orbit insertion covering the time span starting at the date . CK Contains Mars Express predicted attitude information covering the time span starting at the date SCLK This file is a SPICE spacecraft clock (SCLK) kernel containing information required for MEX spacecraft on-board clock to UTC conversion. This file provides the same time information that the Time Correlation packets released via DDS. FK File containing the complete set of frame definitions for the Mars Express Spacecraft (MEX) including definitions for the MEX science instrument frames. This kernel also contains NAIF ID/name mapping for the MEX instruments. IK File containing OMEGA detectors geometry: scanning mirror motion, pixel field of view and optical distortion parameters SPK Contains ephemeris data for planet barycenters, and for the sun, earth and moon mass centers. Spans the entire MEX mission. SPK Contains ephemeris data for Phobos and Deimos. Spans the entire MEX mission. LSK File specifying the relationship between the Barycentric Dynamical Time (TDB, also called ephemeris time) and Coordinated Universal Time (UTC) up to the last modification in the leapseconds. PCK File containing the radii and orientation constants for Mars and its natural satellites. [Table 2: SPICE kernels used in Data Processing. x tokens indicate the version number of the kernel file ] ] 3 Archive Format and Content 3.1 Format and Conventions 3.1.1 Deliveries and Archive Volume Format The OMEGA data is delivered according to the release concept procedure, i.e. there is a single data set and data volume. A new release is provided for each complete set of 100 orbits. The name of the data volume is: 3.1.2 Data Set ID Formation The OMEGA data set ID is formed according to the scheme: . For example: Update Data Set ID Formation 3.1.3 Data Set Directory Structure The following figure shows the OMEGA data set directory structure: [float Figure: [Figure 1: Data Set Directory Structure ] ] 3.1.4 File Naming Convention The table [tab:DataFileNamingConvention] page [tab:DataFileNamingConvention] describes the naming convention used for files within the data directory: [float Table: Data product Level File name Science data 1B 1B Geometry data 1B [Table 3: Data File Naming Convention ] ] 3.2 Standards Used in Data Product Generation 3.2.1 PDS Standards The PDS standard for the cubes is that of PDS version 3.6 as described in the document [2] (JPL D-7669 part 2) 3.2.2 Time Standards Three time standards are used in the OMEGA data products:Correct information on time standards • UT: year, month, day, hour, minute, second, millisecond • SCET: seconds and fractions of seconds since January 1st 1970, 00:00:00 • On-Board time: seconds and fractions of seconds since last switch-on of the spacecraft (nominally after launch) The On-Board time is the only time available to the instrument during operation. It is reset each time a “time” TC is received by OMEGA. OMEGA uses a timer to update this time between two successive times TC. The on-board time at generation is written by OMEGA within each generated data packet For each packet, The SCET is generated by the spacecraft from the on-board time in the packet, according to its time synchronization information The UT time is generated by the DDS ground segment system from the SCET time when it encapsulates the packets so as to generate level-1A files 3.2.3 Cartographic Standards Inertial Reference Frame The Earth Mean Equator and Equinox of Julian Date 2451545.0 (referred to as the J2000 system) is standard inertial frame. Mars Body-Fixed Frame Body fixed frames are reference frames that do not move with respect to surface features of an object. The Mars Body-Fixed frame center is the center of mass of Mars. The spin axis of Mars defines the z-axis, whereas the prime meridian provides the direction of the x-axis that lies on the equatorial plane. The y-axis completes the right-handed frame. Values used to model the orientation of the north pole (including precession), and the prime meridian as a function of time, are those recommended by the International Astronomical Union and adopted by the Mars Express project. Coordinates System We use the planetocentric coordinates system that consists of longitude measured positive eastward and planetocentric latitude, defined as the angle between the equatorial plane and a line from the center of mass of Mars to given point. This system is right-handed and identical to spherical polar coordinates as commonly defined. Longitudes range from 0 to 360 degrees, and latitudes range from -90 to 90 degrees. Please refer to document [5] for further information on IAU 2000 standards. Reference Surface Two standards are used to model the surface of Mars. The first one is the digital terrain model (DTM) based on MOLA data, which defines Mars radius as a function of planetocentric latitude and longitude in the Mars-Body fixed frame. The second one is the triaxial ellipsoid centered on the planetocentric system origin that fits best the MOLA data. Note that the reference ellipsoid is used only the reference surface for defining map projections, whereas detailed topographic model (DTM) is used for accurate projection of remote-sensed data. Cartographic constants used for OMEGA data mapping can be found in the document [5]. Data acquired on Phobos will use Simonelli's model (TBC with T. Duxbury and ESA). OMEGA cartographic products will use a simple cylindrical projection, and possibly polar projections for regions located above 60¡ in latitude (TBC), so as to facilitate changes in data projections and comparison with other data sets. 3.2.4 Other Applicable Standards N/A 3.3 Data Validation The individual packet validation is performed by ESOC, which rejects non-compliant packets. All valid OMEGA packets containing science data (type 20, subtype 13) are integrated into the level-1A files to be processed into a set of PDS level-1B data products. OMEGA data is structured into sub-slices of 64 pixels by 64 spectels (48 spectels, 64 spectels or 80 spectels for the visible channel), each corresponding to an integer number of packets (1 in most compression modes, 2 for non compressed formats). A consistency check is performed during the decompression of the data stream. If the number of words required for decompression is different from the number of available data words, one considers that a SEU has occurred and the corresponding sub-slice values are set to 0. The OMEGA team members validate conversion of level-1B products into level-2 products interactively during the proprietary period. At the end of the proprietary period, a set of software products will be released, so as to provide the tools to generate level-2 products from the level 1B products in the database. It is expected that the understanding of the instrument behaviour will improve during the next few years, as was the case for other experiments of this type. These software products will be therefore be updated whenever a new release is deemed necessary. Similarly, the calibration data may be updated if the characteristics of the instrument in terms of spectral, spatial or radiometric performances change with time. The datasets will be validated through the PVV tool, and a peer review. The main purpose of PVV, distributed by ESA, is to provide the instrument archive team with a tool that allows it to check and verify their datasets before sending them to the PSA. It also shall be taken into account that this same tool will be used in the PSA before ingestion as an additional security step, to prevent whomever from accidentally or intentionally ingesting a wrong or corrupted dataset. It might happen too that some part of the dataset is lost during the transmission process, so the tool should prevent somehow for this inconvenience. 3.4 Data Set Directories Content 3.4.1 Root Directory Files in the Root Directory include an overview of the archive, a description of the volume for the PDS Catalog, and a list of errata or comments about the archive. The following files are contained in the Root Directory. [float Table: File Name Description Volume content and format information A cumulative listing of comments and updates concerning all archive volumes published to date A description of the contents of this volume in a PDS format readable by both humans and computers [Table 4: Data Set Root Directory Content ] ] 3.4.2 Catalog Directory The files in the Catalog Directory provide a top-level understanding of the mission, spacecraft, instruments, and data sets. The files in this directory are coordinated with the PSA team, who is responsible for loading them into the PDS catalog. The following files are found in the Catalog Directory. [float Table: File Name Description A description of the contents of this directory Data set information for the PDS catalog Instrument host (spacecraft) information for the PDS catalog Instrument information for the PDS catalog Mission information for the PDS catalog Software information for the PDS catalog For each data set, there is one release catalog file which defines, through release objects, a data products delivery to the PSA [Table 5: Data Set Catalog Directory Content ] ] 3.4.3 Index Directory Files in the Index Directory are provided to help the user locate products on this archive volume and on previously released volumes in the archive. The following files are contained in the Index Directory. [float Table: File Name Description A description of the contents of this directory A table listing all data products on this volume A PDS detached label that describes INDEX.TAB Geometry Index Table providing geometry and position information about the data product listed in INDEX.TAB Geometry Index label for Additional Index Table providing information about OMEGA at the time of observation, plus other geometrical parameters Index Label for [Table 6: Data Set Index Directory Content ] ] Please refer to document [6] for further information on geometry index, and refer to index label files themselves to have a complete description of the index table parameters. 3.4.4 Software Directory The Software directory contains software for extracting data from the data product files, and for data reduction. The main tools for using OMEGA data are described in the document: encoded in the SOFTNN.ZIP file. It will unzip as a subdirectory () so as to maintain the history of the changes in the reduction process. A path file (), included in needs to be edited to the specific user environment so as to provide the proper path to the OMEGA data directory, where the user stores the science data cubes and the OMEGA geometry directory, where the user stores the geometry cubes The readomega.pro routine reads an omega data cube, creating IDL arrays idat (raw data), jdat (I/F) and kdat (radiance). The readomega tool also reads the companion geometry cube, providing information on the location of the IFOV of each pixel on Mars (or Phobos, when relevant) as derived from the SPICE kernels provided by the project. Input files to readomega.pro are also included in , providing the current version of the photometric function, the wavelength scale and the solar spectrum at OMEGA wavelengths, which is used to derive I/F values from radiance values. The following files are contained in the Software Directory: [float Table: File Name Description A description of the contents of this directory A ZIP file containing all needed files for OMEGA data reduction for the first release (first public delivery) The label for this file This file provides an overview of the ZIP file format A ZIP file with the second version of the OMEGA reduction The label for this file [Table 7: Data Set Software Directory Content ] ] 3.4.5 Document Directory The Document Directory contains documentation to help the user understand and use the archive data. The following files are contained in the Document Directory. [float Table: File Name Description A description of the contents of this directory The OMEGA Experiment Archive Interface Control Document (this document) as a MS Word document The OMEGA Experiment Archive Interface Control Document (this document) as text. The OMEGA Experiment Archive Interface Control Document (this document) as a PDF file. A PDS detached label describing all EAICD related documents and figures. PNG Figure 1 for the ASCII version PNG Figure 2 for the ASCII version PNG Figure 3 for the ASCII version PNG Figure 4 for the ASCII version PNG Figure 5 for the ASCII version The OMEGA Flight User Manual as MS Word document The OMEGA Flight User Manual as PDF document A PDS detached label describing FUM related documents Description of the geometry data cubes content Label file for Description of the Mars Express spacecraft orientation Label file for Description of the OMEGA calibration parameters Label file for Description of the OMEGA instrument Label file for [Table 8: Data Set Document Directory Content ] ] 3.4.6 Data Directory The Data directory contains the science and geometry data product, both at level-1B. Science data files are sorted into subdirectories by groups of 100 orbits according to the following scheme: DATA | `- ORBnn where are the first two digits of the stating orbit number. Data obtained before arrival at Mars (EV and IC mission phases) are stored in the CRUISE sub-directory according to the following scheme: DATA | '-- CRUISE Geometry data files are sorted into subdirectories by groups of 100 orbits according to a similar scheme: DATA | `-- GEMnn where are the first two digits of the stating orbit number. Example: the subdirectory contains all the data files corresponding to orbits from 1200 and 1299. There are no geometry data products for cruise data. Science and geometry data files are named according to the Table [tab:DataFileNamingConvention] page [tab:DataFileNamingConvention]. 4 Detailed Interface Specifications 4.1 Data Product Design A series of PDS files starting from level-1B is generated for each sub-session of OMEGA, i.e. a series of scans performed in the same operational mode (IR mode, VIS mode, spatial summing) as described in section [sec:InstrumentDesign]. These PDS files contain all the scientific data and geometry data produced by OMEGA. The PDS label is always included in the file 4.1.1 Science Level-1B Data Product The EDR data files contain the DN numbers from the experiment as PDS files in the QUBE format. An example PDS label for a 1B OMEGA data file is given in annex [sec:DataPDSLabelExample]. File Characteristics Data Elements PDS data product labels contain data element information that describes important attributes of the physical structure of a data product file. The PDS file characteristic data elements are: RECORDTYPE RECORDBYTES FILERECORDS LABELRECORDS FILENAME The data element identifies the record characteristics of the data product file. Physical records are always fixed-length. The data element identifies the number of bytes in each physical record in the data product file. Records length is always equal to 512 bytes. The data element identifies the number of physical records in the file. The data element identifies the number of physical records that make up the PDS product label. The data element identifies the name of the geometry file. The Planetary Science Archive of ESA implements the “Release concept”: data is delivered as units (releases), which can be updated (revision). Two specific data elements are included to handle the release concept: RELEASEID REVISIONID defines the release number and defines the revision number. Data Object Pointers Identification Data Elements The label refers to a single data object, which is a QUBE. The data object starts in the next physical record after the PDS product label area. The data object pointer takes the following form: QUBE = nnn where represents the starting record number within the geometry file (first record is numbered 1). Data Identification Elements The following data identification elements provide additional information about the data product. DATASETID = "MEX-M-OMEGA-2-EDR-FLIGHT-V1.0" PRODUCTID = "ORB00181DATA" PRODUCTTYPE = EDR PRODUCTCREATIONTIME = 2004-03-24T12:33:18.000 PRODUCERINSTITUTIONNAME = IAS PIPDSUSERID = BIBRING SPACECRAFTNAME = "MARS EXPRESS" MISSIONPHASENAME = "MC PHASE 1" INSTRUMENTID = OMEGA INSTRUMENTTYPE = "IMAGING SPECTROMETER" INSTRUMENTDESC = "OMEGADESC.TXT" INSTRUMENTCALIBRATIONDESC = "OMEGACALIBRATIONDESC.TXT" DATAQUALITYID = 3 DATAQUALITYDESC = " from 0 to 3 depending on missing lines and compression errors" MISSINGSCANLINES = 0 CHANNELID = (IRC,IRL,VIS) SOFTWAREVERSIONID = "OMEGA 4.5" TARGETNAME = MARS EDR stands for Experiment Data Records. The element provides the time at which the geometry data product has been generated. The indicates in which phase of the mission the data was acquired. Mission phases are: EV, IC (cruise phase), and then MC PHASE 1 to N (Mars orbit). Two files are referred to in the DOCUMENT directory: and OMEGA_CALIBRATION_DESC.TXT which contain information on the instrument and on the ground calibration respectively. The element provides the target of the observation. It can be , , or . Descriptive Data Elements In addition to the data identification elements, we included descriptive data elements that provide an overview of the observation geometry and some information on the data product generation process. ORBITNUMBER The element is the number of the Mars Express orbit around Mars at observation time. MAXIMUMLATITUDE MINIMUMLATITUDE EASTERNMOSTLONGITUDE WESTERNMOSTLONGITUDE The element specifies the northernmost latitude of the spatial area covered by the observation. The element specifies the southernmost latitude of the spatial area covered by the observation. The element provides the maximum numerical value of planetocentric longitude of the spatial area covered by the observation, unless it crosses the prime meridian. The element provides the minimum numerical value of planetocentric longitude of the spatial area covered by the observation, unless it crosses the prime meridian. Angles are expressed in degrees. SLANTDISTANCE The element provides a measure of the distance, in kilometers, from the spacecraft to the center of the observation along the line of sight. SOLARLONGITUDE SOLARDISTANCE SUBSOLARLONGITUDE SUBSOLARLATITUDE The element provides the areocentric longitude of the Sun that is a measure of season on Mars, in degrees. The element provides the value of the distance from the center of the observation to the apparent position of the Sun, in kilometer. The and the elements provide respectively the longitude and the latitude of the sub-solar point at observation time. The sub-solar point is defined as the intersection point between the apparent position vector of the Sun in the Mars-fixed rotating frame, and the reference surface of Mars. The following data elements contain information on the operating mode of OMEGA COMMANDNAME = "OMEGANOMINAL" COMMANDDESC = "00838383,00303030,04600900,050000EF, 06001549,07708721,08000000,0900006F,0AEED804" This indicates the series of hexadecimal commands, which were sent to OMEGA for this particular data set. They control the operational modes INSTRUMENTMODEID = ( 06,06,09) EXPOSUREDURATION = (5.0,5.0, 50.0) DOWNTRACKSUMMING = 1 indicates the operating mode for each of the 3 channels of OMEGA (IRC, IRL, VIS). The mode is always the same for IRC and IRL, from 0 to 10. The VIS operating mode can range from 0 to 41. Add more detailed description of instrument mode INSTCMPRSNAME = "WAVELET" INSTCMPRSRATE = 3.00 indicates which of the 3 types of compression was used for the data: , or . In the "WAVELET" compression mode, indicates the requested compression rate in bits per data. It is set as 12 for "NONE" and as 5 for "REVERSIBLE OFFSET = 0.0 SCALINGFACTOR = 0.983 Add more detailed description of instrument mode Fixed parameters. The indicates the IFOV ratio between the VIS and IR channels STARTTIME = 2004-01-14T00:19:12.032 STOPTIME = 2004-01-14T00:23:03.059 SPACECRAFTCLOCKSTARTCOUNT = "22054009.23265" SPACECRAFTCLOCKSTOPCOUNT = "22054240.00630" Add information on how those times are obtained Data Object Definitions The data object is a QUBE that does not fulfill ISIS standards. The binary data is constituted of a cube, 7 side planes in the X direction and 1 side plane in the Y direction. The data cube is coded as 16 bits signed integers (). All side-planes are coded as 32 signed bits integers () [float Table: Keyword Definition Typical value Dimension of the qube Names of axes Core dimensions of axes Core element size Core element type Base value item scaling* Multiplier for core item scaling* Storage allocation for suffix elements Suffix dimensions of axes Minimum valid core value Special value indicating 'invalid' data Special value indicating representation saturation at low end** Special value indicating instrument saturation at low end** Special value indicating representation saturation at high end** Special value indicating instrument saturation at high end** Name of value stored in core Unit of core values [Table 9: Science Data Qube Keywords Definition ] ] Among the keywords mentionned above, only can take different values: • The first dimension, named , refers to the length of scan. It can be 16, 32, 64, or 128 pixels. It gives the first spatial dimension. • The second dimension, named , refers to the number of spectral elements in each spectrum. It can be either 352 (nominal) or 400 (high VIS spectral resolution) • The third dimension, named , refers to the rank of the scan. It is the second spatial dimension. The side plane added to the X dimension contains either 352 or 400 values for each scan, depending on the visible mode. The first 256 values correspond to the dark current for the IR channels. The next 8 values correspond to dark currents of shielded spectels (2 at each end of the C and L IR channels). The next 88 or 136 values are given a constant value corresponding to the offset applied to the visible channel, which takes into account the operating temperature of the VIS CCD. 7 side planes are added to the Y dimension. For each scan, each of the seven side-lines has a dimension corresponding to the length of the scan (16, 32, 64 or 128). All information is included in the first 16 data, which correspond to the minimum length of these lines. The other data are set to 0. [float Figure: [Figure 2: Conceptual view of the Science Data Qube ] ] All analog values are expressed as a 32 bits signed integer: • temperatures are expressed as multiples of 0.001 ^{\circ} C • voltages are expressed as multiples of 0.001 V • currents are expressed as multiples of 0.001 A 1st side plane scanning mirror position (in Data Numbers coming out of the scanner monitoring device) 2nd side plane information on the time at the beginning of the scan, in the following order: • UT time: 7 values (year, month, day, hour, minute, second, millisecond) • On-Board time: 2 values (seconds, milliseconds) • SCET time: 4 values (2 for seconds, 2 for microseconds) 3rd side plane selected temperatures • Temperature detector block C (SOA 5) • Temperature detector block L (SOA 6) • Temperature spectro C1 (SOA 1) • Temperature spectro C2 (SOA 2) • Temperature spectro L1 (SOA 3) • Temperature spectro L2 (SOA 4) • Temperature slit (SOA 8) • Temperature detector C (SES 6, raw data) • Temperature detector L (SES 14, raw data) 4th side plane electronics and cooler temperatures • Temperature spectro structure (SOA 9) • Temperature 190 K interface (SOA 10) • Temperature detector L (HR) (SOA 11) • Temperature SEP module (SEP 1) • Temperature electronics 1 (SEA 3) • Temperature electronics 2 (SEA 4) • Temperature calibration source (SOA 7) • Temperature 280 K (PF 1) • Temperature SKA motor C (SKA 1) • Temperature SKA motor L (SKA 2) • Temperature SKC C (SKC 1) • Temperature SKC L (SKC 2) • Temperature SES C (SES 5) • Temperature SES L (SES 13) • Temperature SES (SES 17) 5th side plane scanner, voltages, currents, status • Temperature FOA (FEA 1) • Temperature FEA (FEA 2) • +12 V FEA (SEP 2) • Voltage + 5V PF (SEA 5) • Voltage +15V PF (SEA 6) • Voltage -15V PF (SEA 7) • Status on-off (SEA 9) • Voltage motor C (SKA 3) • Current motor C (SKA 4) • Voltage motor L (SKA 5) • Current motor L (SKA 6) • Voltage setting C (SKA 7) • Voltage setting L (SKA 8) • Status (SEA 10) • Current (calibration source) (SEA 1) • Voltage (calibration source) (SEA 2) 6th side plane SES voltages • VGL1 C (SES 1) • PHIP LB C (SES 2) • Polarization diode C (SES 3) • Video offset C (SES 4) • 24 Volts C (SES 7) • constant offset C (SES 8) • VGL1 L (SES 9 • PHIP LB L (SES 10) • Polarization diode L (SES 11) • Video offset L (SES 12) • 24 Volts L (SES 15) • constant offset (SES 16) 7th side plane VEA subsystem (visible channel) • Setting 15 volts (VEA 2) • Setting -15 volts (VEA 3) • Setting 5 volts (VEA 1) • Setting -5 volts (VEA 4) • Temperature CCD (VEA 7) • Temperature optics (VEA 6) • Temperature electronics VEA (VEA 5 • Current (calibration source) (VEA 8) • Status calibration + test (VEA 10) • Operation mode (VEA 11) • Frame number (VEA 12) • Command Echo 1 (VEA 13) • Command Echo 2 (VEA 14) • Number of transmitted blocks (VEA 15) • Number of spectral elements (VEA 16) 4.1.2 Geometry Level-1B Data Product A geometry data product is equal to a single data file, which has the PDS format. It contains the observation geometry of each pixel for each of the three OMEGA detectors.The data product label is attached at the beginning of the data product file. The following subsections describe in details the content of this label and the data object it is referring to. An example label for a geometry data product is provided in annex [sec:GeometryPDSLabelExample] . [float Figure: [Figure 3: View of a geometry data product ] ] File Characteristics Data Elements PDS data product labels contain data element information that describes important attributes of the physical structure of a data product file. The PDS file characteristic data elements are: RECORDTYPE RECORDBYTES FILERECORDS LABELRECORDS FILENAME The data element identifies the record characteristics of the data product file. Physical records are always fixed-length. The data element identifies the number of bytes in each physical record in the data product file. Records length is always equal to 512 bytes. The data element identifies the number of physical records in the file. The data element identifies the number of physical records that make up the PDS product label. The data element identifies the name of the geometry file. The Planetary Science Archive of ESA implements the "Release" concept: data is delivered as units (releases), which can be updated (revision). Two specific data elements are included to handle the release concept: RELEASEID REVISIONID defines the release number and defines the revision number. Data Object Pointers Identification Data Elements The label refers to a single data object, which is a QUBE. The data object starts in the next physical record after the PDS product label area. The data object pointer takes the following form: QUBE = nnn where nnn represents the starting record number within the geometry file (first record is numbered 1). Data Identification Elements The following data identification elements provide additional information about the data product. DATASETID = "MEX-M-OMEGA-2-EDR-FLIGHT-V1.0" PRODUCTID = "ORB00181GEOM" PRODUCTTYPE = EDR PRODUCTCREATIONTIME = 2004-09-29T08:46:38.098 PRODUCERINSTITUTIONNAME = IAS PIPDSUSERID = BIBRING SPACECRAFTNAME = "MARS EXPRESS" MISSIONPHASENAME = "MC PHASE 1" INSTRUMENTID = OMEGA TARGETTYPE = PLANET TARGETNAME = MARS STARTTIME = 2004-01-14T00:19:12.032 STOPTIME = 2004-01-14T00:23:03.059 SPACECRAFTCLOCKSTARTCOUNT = "22054009.23265" SPACECRAFTCLOCKSTOPCOUNT = "22054240.00630" EDR stands for Experiment Data Records. The element provides the time at which the geometry data product has been generated. The element provides the target of the observation. It can be , , or . Descriptive Data Elements In addition to the data identification elements, we included descriptive data elements that provide an overview of the observation geometry and some information on the data product generation process. ORBITNUMBER SPACECRAFTPOINTINGMODE SPACECRAFTORIENTATION The element is the number of the Mars Express orbit around Mars at observation time. The element indicates the spacecraft-pointing mode during the observation. It can be , , , or . These values result from an analysis of orbit and attitude data at observation time. Let the +Zb axis be the pointing direction of the spacecraft. We assume a nadir-pointing mode when the +Zb axis is continuously pointing to the center of Mars. We assume the spacecraft is along-track pointing when the +Zb axis is lying on the s/c orbit plane and is separated from the vector pointing to the center of Mars by a constant offset angle. The across-track pointing is defined as follows: the +Zb axis is continuously lying on the plane perpendicular to s/c orbit plane and passing by the center of Mars and the spacecraft position. In other words, the +Zb axis is rotated about the spacecraft velocity vector by a constant offset angle. This angle is provided within the label by mean of the following keyword: MEX: OFFSETANGLE In the last case, the spacecraft is 3-axes pointing or inertial pointing. This means that the spacecraft orientation is fixed with respect to stars background. If so, pointing coordinates in J2000 frame are provided by mean of the two following keywords: RIGHTASCENSION DECLINATION The element indicates whether the +Yb axis is oriented towards the spacecraft velocity vector, (0,1,0), or in the opposite direction, (0,-1,0). See appendix 5 to get further information on the spacecraft frame. MAXIMUMLATITUDE MINIMUMLATITUDE EASTERNMOSTLONGITUDE WESTERNMOSTLONGITUDE The element specifies the northernmost latitude of the spatial area covered by the observation. The element specifies the southernmost latitude of the spatial area covered by the observation. The element provides the maximum numerical value of planetocentric longitude of the spatial area covered by the observation, unless it crosses the prime meridian. The element provides the minimum numerical value of planetocentric longitude of the spatial area covered by the observation, unless it crosses the prime meridian. Angles are expressed in degrees. SLANTDISTANCE The element provides a measure of the distance, in kilometers, from the spacecraft to the center of the observation along the line of sight. SOLARLONGITUDE SOLARDISTANCE SUBSOLARLONGITUDE SUBSOLARLATITUDE The element provides the areocentric longitude of the Sun that is a measure of season on Mars, in degrees. The element provides the value of the distance from the center of the observation to the apparent position of the Sun, in kilometer. The and the elements provide respectively the longitude and the latitude of the sub-solar point at observation time. The sub-solar point is defined as the intersection point between the apparent position vector of the Sun in the Mars-fixed rotating frame, and the reference surface of Mars. DATADESC = "GEOCUBEDESC.TXT" The pointer provides the name of the file describing the content of the geometry data qube. DATAQUALITYID SOFTWARENAME SPICEFILENAME The element is always . The element indicates the name and the version number of the software that has been used to generate the geometry data product. The element provides the list of all the SPICE kernels required and used to generate the geometry data product of concern. Data Object Definitions The data object is a QUBE that does not fulfill ISIS standards. Unlike science level-1B data qubes, geometry qubes do not hold suffix areas, but have the same core structure. This core is a three-dimensional array with two spatial dimensions, and one dimension used to store the observation geometry parameters. The qube's structure and attributes are described by the following keywords: [float Table: Keyword Definition Typical value Dimension of the qube Names of axes Core dimensions of axes Core element size Core element type Base value item scaling* Multiplier for core item scaling* Storage allocation for suffix elements Suffix dimensions of axes Minimum valid core value Special value indicating 'invalid' data Special value indicating representation saturation at low end** Special value indicating instrument saturation at low end** Special value indicating representation saturation at high end** Special value indicating instrument saturation at high end** Name of value stored in core Unit of core values [Table 10: Geometry Qube Keywords Definition ] ] Among the keywords mentionned above, only can take different values: • The first dimension, named , refers to the length of scan. It can be 16, 32, 64, or 128 pixels. It gives the first spatial dimension. • The second dimension, named , actually refers to the 51 parameters describing the geometry of the observation of concern. • The third dimension, named , refers to the rank of the scan. It is the second spatial dimension. The first and third dimensions are the same as that of the corresponding science level-1B data cube. From geometry planes, one value of the corresponding parameter is associated to each of the spectra in the science level-1B data cubes. There is an exception to this: the second plane is used to store information on time at the beginning of the IR scan. The following table lists the parameters contained within the data cube, which describes the geometry of an OMEGA observation: [float Table: # Parameter Unit ¥ 1 IR scan mirror position ¥ 2 time at the beginning of the IR scan See note 1 ---------------------------------------------------------------------------------------------------------------- 13*SWIR-C 3 incidence angle w.r.t the outward normal to the reference ellipsoid 4 emergence angle w.r.t the outward normal to the reference ellipsoid 5 incidence angle w.r.t the opposite direction of the center of Mars 6 emergence angle w.r.t the opposite direction of the center of Mars 7 longitude of the pixel footprint center point 8 latitude of the pixel footprint center point 9 incidence angle w.r.t the local normal 2 10 emergence angle w.r.t the local normal 2 11 phase angle w.r.t the local normal 2 12 slant distance from the spacecraft to pixel footprint center point 13 elevation of the pixel footprint center point 2 14-17 longitude of the 4 pixel footprint corner points 18-21 latitude of the 4 pixel footprint corner points SWIR-L 22-36 same information as plane 7-21 for SWIR-L channel VNIR 37-51 same information as plane 7-21 for VNIR channel [Table 11: Geometry Data Qube Parameters Description ] ] 1. Time information format: • UT: year, month, day, hour, minute, second, millisecond (7 values) • OBT: seconds, milliseconds (2 values) • SCET: seconds (2 values), microseconds (2 values) 2. In the case of limb observations, incidence and emergence angles (planes number 9,10,24,25,39, and 40) are computed with respect to the opposite direction of the center of Mars instead of using local topography. Also, planes number 13, 28, and 43 are replaced with the altitude of the central tangent point above the surface of Mars, plus an offset equal to 65536. For further information on observation geometry please refer to appendix [sec:GeometricalParametersDefinition]. [float Figure: [Figure 4: Conceptual view of the Geometry Data Qube ] ] A Geometrical Parameters Definition Pixel footprint A pixel footprint is the figure on the surface of Mars resulting from the projection (intersection) of the pixel's field of view boundary vectors onto the surface. Intersection/impact points coordinates on the surface define the pixel footprint. Indeed, although the term of pixel footprint does not make so much sense in the case of a limb observation, we use it to describe the figure on the surface defined the four boundary impact points. Note that the pixel footprint center point is the intersection point between the pixel boresight and the surface of Mars (surface observation), or the impact point built from the pixel boresight (limb observation). Impact and tangent point An impact point is the intersection between the vector from the center of Mars to a tangent point and a reference surface. A tangent point is the closest point to the center of Mars (center of mass) lying on the pixel boresight. We use the term of tangent point only when the pixel field of view boundary vectors do not intersect the surface. [float Figure: [Figure 1: Overview of pixel observation geometry ] ] Incidence angle The incidence angle (i) is the angle between the "surface" normal vector at the intercept/impact point (surface) and the vector from the intercept/impact point to the Sun. Emergence angle Also called emission angle (e), this angle is the angle between the "surface" normal vector at the intercept/ impact point and the vector from intercept/ impact point to the spacecraft. Phase angle The phase angle (?) is the angle between the vector from the intercept/impact point to the Sun, and the vector from the intercept/impact point to the spacecraft. Spacecraft "mechanical/structure" frame The "mechanical/structure frame" frame (Xb, Yb, Zb), with respect to which orientation of all science instruments and spacecraft structures are defined, is called frame in the MEX SPICE implementation. This frame is defined as follows: • the payloads are located on the +Zb axis (the Main Engine being on the -Zb axis); • the HGA is located on -Xb axis; • the +Y axis is defined so that the (Xb,Yb,Zb) frame is right-handed. • the origin of this frames is the launch vehicle interface point. B Example of PDS label of an OMEGA 1B data product PDSVERSIONID = 3 LABELREVISIONNOTE = "2004-09-03, YL-BG-JZ" /* File format and length */ RECORDTYPE = FIXEDLENGTH RECORDBYTES = 512 FILERECORDS = 54299 LABELRECORDS = 11 FILENAME = "ORB00180.QUB" QUBE = 12 DATASETID = "MEX-M-OMEGA-2-EDR-FLIGHT-V1.0" RELEASEID = 0001 REVISIONID = 0000 PRODUCTID = "ORB00180DATA" PRODUCTTYPE = EDR STANDARDDATAPRODUCTID = "OMEGA DATA" PIPDSUSERID = BIBRING MISSIONNAME = "MARS EXPRESS" MISSIONPHASENAME = "MC PHASE 1" INSTRUMENTNAME = "Observatoire Mineralogie, Eau, Glaces, Activite" PRODUCERINSTITUTIONNAME = "IAS" INSTRUMENTID = OMEGA INSTRUMENTTYPE = "IMAGING SPECTROMETER" INSTRUMENTDESC = "OMEGADESC.TXT" INSTRUMENTCALIBRATIONDESC = "OMEGACALIBRATIONDESC.TXT" DATAQUALITYID = 3 DATAQUALITYDESC = " from 0 to 3 depending on missing lines and compression errors" MISSINGSCANLINES = 0 CHANNELID = (IRC,IRL,VIS) SOFTWAREVERSIONID = "OMEGA 4.5" TARGETNAME = MARS ORBITNUMBER = 18 PRODUCTCREATIONTIME = 2004-09-29T08:46:38.098 STARTTIME = 2004-01-14T00:19:12.032 STOPTIME = 2004-01-14T00:23:03.059 SPACECRAFTCLOCKSTARTCOUNT = "22054009.23265" SPACECRAFTCLOCKSTOPCOUNT = "22054240.00630" MAXIMUMLATITUDE = -54.594 MINIMUMLATITUDE = -65.256 EASTERNMOSTLONGITUDE = 322.959 WESTERNMOSTLONGITUDE = 318.126 SLANTDISTANCE = 1112.726 /* set of commands */ COMMANDNAME = "OMEGANOMINAL" COMMANDDESC = "00838383,00303030,04600900,050000EF, 06001549,07708721,08000000,0900006F,0AEED804" /* instrument status */ INSTRUMENTMODEID = ( 06,06,09) EXPOSUREDURATION = (5.0,5.0, 50.0) DOWNTRACKSUMMING = 1 INSTCMPRSNAME = "WAVELET" INSTCMPRSRATE = 3.00 OFFSET = 0.0 SCALINGFACTOR = 0.983 MEX:SCANMODEID = NOMINAL /* can be "FIXED" OR "DEFAULT" */ MEX:FOCALPLANETEMPERATURE = ( 77.6, 77.5,274.6) MEX:FOCALPLANETEMPERATUREDESC=" temperatures of the C, L, V detectors" MEX:SPECTROMETERTEMPERATURE = (182.9,181.0,191.7) MEX:SPECTROMETERTEMPERATUREDESC=" temperatures of the C, L, V spectrometers" OBJECT = QUBE /* ISIS cube with non-standard sideplanes */ AXES = 3 AXISNAME = (SAMPLE,BAND,LINE) COREITEMS = ( 64,352,576) CORENAME = "RAW DATA NUMBER" COREUNIT = "N/A" COREITEMTYPE = LSBSIGNEDINTEGER COREITEMBYTES = 2 COREBASE = 0.0 COREMULTIPLIER = 1.0 COREVALIDMINIMUM = "N/A" CORENULL = "N/A" CORELOWREPRSATURATION = -32768 CORELOWINSTRSATURATION = -32768 COREHIGHREPRSATURATION = 32767 COREHIGHINSTRSATURATION = 32767 /* suffix definitions for OMEGA */ SUFFIXBYTES = 4 SUFFIXITEMS = (1,7,0) /* number of sideplanes */ SAMPLESUFFIXNAME = "DARK" SAMPLESUFFIXUNIT = "N/A" SAMPLESUFFIXITEMTYPE = LSBSIGNEDINTEGER SAMPLESUFFIXITEMBYTES = 4 SAMPLESUFFIXBASE = 0.0 SAMPLESUFFIXMULTIPLIER = 1.0 SAMPLESUFFIXVALIDMINIMUM = "N/A" SAMPLESUFFIXNULL = "N/A" SAMPLESUFFIXLOWREPRSAT = -32768 SAMPLESUFFIXLOWINSTRSAT = -32768 SAMPLESUFFIXHIGHREPRSAT = 32767 SAMPLESUFFIXHIGHINSTRSAT = 32767 SAMPLESUFFIXNOTE = "The sample sideplane contains the offset spectrum subtracted after acquisition. Visible: constant value" BANDSUFFIXNAME = "HOUSEKEEPINGPARAMETERS" BANDSUFFIXUNIT = "N/A" BANDSUFFIXITEMTYPE = LSBSIGNEDINTEGER BANDSUFFIXITEMBYTES = 4 BANDSUFFIXBASE = 0.0 BANDSUFFIXMULTIPLIER = 1.0 BANDSUFFIXVALIDMINIMUM = "N/A" BANDSUFFIXNULL = "N/A" BANDSUFFIXLOWREPRSAT = -32768 BANDSUFFIXLOWINSTRSAT = -32768 BANDSUFFIXHIGHREPRSAT = 32767 BANDSUFFIXHIGHINSTRSAT = 32767 BANDSUFFIXNOTE = "Housekeeping parameters and sideplane structure are detailed in the OMEGA EAICD document" HOUSEKEEPINGDESCRIPTION = "OMEGAHK.TXT" ENDOBJECT = QUBE END C Example of PDS label of a level-1B geometry data product PDSVERSIONID = 3 LABELREVISIONNOTE = "22-SEP-2004, N. Manaud" /* FILE CHARACTERISTICS */ RECORDTYPE = FIXEDLENGTH RECORDBYTES = 512 FILERECORDS = 14695 LABELRECORDS = 7 FILENAME = "ORB00180.NAV" RELEASEID = 0001 REVISIONID = 0000/* DATA OBJECT POINTER /* QUBE = 8/* IDENTIFICATION DATA ELEMENTS */ DATASETID = "MEX-M-OMEGA-2-EDR-FLIGHT-V1.0" PRODUCTID = "ORB00180GEOM" PRODUCTTYPE = EDR STANDARDDATAPRODUCTID = "OMEGA GEOMETRY" PRODUCTCREATIONTIME = 2004-09-29T17:14:02.000 PRODUCERINSTITUTIONNAME = IAS PIPDSUSERID = BIBRING SPACECRAFTNAME = "MARS EXPRESS" MISSIONPHASENAME = "MC PHASE 1" INSTRUMENTNAME = "Observatoire Mineralogie, Eau, Glaces, Activite" INSTRUMENTID = OMEGA TARGETTYPE = PLANET TARGETNAME = MARS STARTTIME = 2004-01-14T00:19:12.032 STOPTIME = 2004-01-14T00:23:03.059 SPACECRAFTCLOCKSTARTCOUNT = "22054009.23265" SPACECRAFTCLOCKSTOPCOUNT = "22054240.00630"/* DESCRIPTIVE DATA ELEMENTS */ ORBITNUMBER = 18 SPACECRAFTPOINTINGMODE = "NADIR" SPACECRAFTPOINTINGMODEDESC = "The NADIR pointing mode is used for science observations nominally around the pericentre. In this pointing mode the Z-axis of the spacecraft points towards the centre of Mars and the X-axis perpendicular to the ground track." MEXORIENTATIONDESC = "MEXORIENTATIONDESC.TXT" MAXIMUMLATITUDE = -54.594 MINIMUMLATITUDE = -65.256 EASTERNMOSTLONGITUDE = 322.959 WESTERNMOSTLONGITUDE = 318.126 SLANTDISTANCE = 1112.73 SOLARLONGITUDE = 333.1 SOLARDISTANCE = 223058058.31 SUBSOLARLONGITUDE = 297.174 SUBSOLARLATITUDE = -11.118 DATADESC = "GEOCUBEDESC.TXT" DATAQUALITYID = "NULL" SOFTWARENAME = "GEOMEG V4 / 2" SPICEFILENAME = "ATNMP03060219182200088.BC, ORMM03122218090600052.BSP, MEX040730STEP.TSC, MEXOMEGAV04.TI, MEXV05.TF, DE405S.BSP, MAR0332000-2025.BSP, MARSIAU2000v0.TPC, NAIF0007.TLS"/* DATA OBJECT DEFINITIONS */ OBJECT = QUBE AXES = 3 AXISNAME = (SAMPLE,BAND,LINE) COREITEMS = (64,51,576) COREITEMBYTES = 4 COREITEMTYPE = LSBSIGNEDINTEGER COREBASE = 0.0 COREMULTIPLIER = 1.0 SUFFIXBYTES = 4 SUFFIXITEMS = (0,0,0) COREVALIDMINIMUM = "NULL" CORENULL = "NULL" CORELOWREPRSATURATION = -2147483648 CORELOWINSTRSATURATION = -2147483648 COREHIGHREPRSATURATION = 2147483647 COREHIGHINSTRSATURATION = 2147483647 CORENAME = "RAW DATA NUMBER" COREUNIT = DIMENSIONLESS ENDOBJECT = QUBEEND D PDS Glossary Archive An archive consists of one or more data sets along with all the documentation and ancillary information needed to understand and use the data. An archive is a logical construct independent of the medium on which it is stored. Archive Volume, Archive Volume Set A volume is a unit of media on which data products are stored; for example, one CD-ROM or DVD-ROM. An archive volume is a volume containing all or part of an archive; that is, data products plus documentation and ancillary files. When an archive spans multiple volumes, they are called an archive volume set. Usually the documentation and some ancillary files are repeated on each volume of the set, so that a single volume can be used alone. Catalog Information Descriptive information about a data set (e.g. mission description, spacecraft description, instrument description), expressed in Object Description Language (ODL), which is suitable for loading into a PDS catalog. Data Product A labeled grouping of data resulting from a scientific observation, usually stored in one file. A product label identifies, describes, and defines the structure of the data. An example of a data product is a planetary image, a spectrum table, or a time series table. Data Set An accumulation of data products. A data set together with supporting documentation and ancillary files is an archive.