MODIS Atmosphere
MODIS Atmosphere Home Products  Images  Validation  News  Staff  Forum  Reference  Tools  Help
Aerosol Product  Water Vapor Product  Cloud Product  Atmosphere Profile Product  Cloud Mask Product   Joint Atmosphere ProductLevel-2 Products
Daily Global Product  Eight-Day Global Product  Monthly Global ProductLevel-3 Products       Filled Land Surface Albedo ProductFilled Normalized Difference Vegetative Index ProductOne-Minute Land Ecosystem Classification ProductLevel-3 Ancillary Land Surface Products
Eight Day Global
Introduction
Grids & Mapping
Terra Browse Imagery
Aqua Browse Imagery
Known Problems
Modification History
Format & Content
Detailed File Spec
Terra Browse Imagery
Aqua Browse Imagery
Known Problems
Modification History
Format & Content
Detailed File Spec
Acquiring Data
Filename Convention
Analysis Tools
Theoretical Basis
Validation
Algorithm Software
Production Plan
Support Team

HISTORY

PGE Information

The 08_E3 product is produced from the Program Executable (PGE) identified as PGE70.

Product Change History

PGE70 Version Detail
Product impact changes only
High Impact = High Impact     Moderate Impact = Moderate Impact     Low Impact = Low Impact
(Dates show approximate starting production date)

PGE70 v4.2.0 includes:       ( Terra Forward: ~01.Jan.2004       Aqua Forward & Reprocess: ~01.Jan.2004 )

  • Eight Day Global (v4.2.0)
      High Impact New Multiday Weighting Scheme for Aerosol Products. Implemented a new multiday weighting scheme for all Aerosol derived parameters. The old scheme was using unweighted daily statistics to create multiday mean and standard deviation statistics. The new scheme is a pixel count weighted scheme with a pixel count screen. The screen requires there to be at least 6 L2 pixel observations in a L3 grid cell for a particular day, for that days L3 grid value to be included in the computation of the multiday mean and standard deviation statistics. This new scheme was specified by the Aerosol group (Remer et. al).
      High Impact Cloud Fraction Infrared SDS Name Change. Changed the SDS name of Cloud Fraction (derived from Cloud Mask) from "Cloud_Fraction_Infrared" to simply "Cloud_Fraction". This change was applied to the daytime only, nighttime only, and both day and night cloud fraction parameters. This change was performed to sync the name with the L2 input SDS name and also to minimize confusion since the cloud mask is based on BOTH infrared and solar spectral tests. It should be noted that this is the primary cloud fraction parameter in the MODIS Atmosphere L3 product.
      High Impact Change to (Aerosol) Optical Depth Ratio Small Ocean parameter. Dropped the 3rd (multiple solution) dimension on the parameter Optical_Depth_Ratio_Small_Ocean_860. Previously this was a 3D array populated with the best and average solutions, now it's a 2D array populated with only the best solution. In addition the _860 string (denoting that this was derived from the .86 micron band) used in the SDS name was dropped because there are no longer multiple wavelength solutions stored. Only the .55 micron solutions are kept. Also corrected the specification of the QA bits applied to the Optical_Depth_Ratio_Small_Ocean parameter. Previously the QA Confidence Flag bits for average solution was applied, this was corrected to use the QA Confidence Flag bits for best solution.
      Moderate Impact (Aerosol) Mass Concentration Ocean Correction. Corrected the specification of the QA bits applied to the Mass_Concentration_Ocean parameter. Previously the QA Confidence Flag bits for average solution was applied, this was corrected to use the QA Confidence Flag bits for best solution. Also corrected the long name of the Mass_Concentration_Ocean parameter. Previously the long name specified it was BOTH best and average solutions. This was corrected to note that this is only the best solution.
      Moderate Impact (Aerosol) Effective Radius Ocean Correction. Corrected the specification of the QA bits applied to the Effective_Radius_Ocean parameter. Previously the QA Confidence Flag bits for average solution was applied, this was corrected to use the QA Confidence Flag bits for best solution. Also corrected the long name of the Effective_Radius_Ocean parameter. Previously the long name specified it was BOTH best and average solutions. This was corrected to note that this is only the best solution.
      Moderate Impact Cloud Condensation Nuclei Ocean Correction. Corrected the specification of the QA bits applied to the Cloud_Condensation_Nuclei_Ocean parameter. Previously the QA Confidence Flag bits for average solution was applied, this was corrected to use the QA Confidence Flag bits for best solution. Also corrected the long name of the Cloud_Condensation_Nuclei_Ocean parameter. Previously the long name specified it was the average solution. This was corrected to note that this is only the best solution.
      Moderate Impact Angstrom Exponent (1 & 2) Ocean Correction. Corrected the specification of the QA bits applied to the Angstrom_Exponent_(1 & 2)_Ocean parameters. Previously the QA Confidence Flag bits for average solution was applied, this was corrected to use the QA Confidence Flag bits for best solution. Also corrected the long name of the Angstrom_Exponent_(1 & 2)_Ocean parameters. Previously the long name specified it was the average solution. This was corrected to note that this is only the best solution.
      Low Impact (Aerosol) Effective Optical Depth Average Ocean Longname Correction. Corrected the local attribute 'longname' of the Effective_Optical_Depth_Average_Ocean parameter. Previously the longname specified it was the best solution. This was corrected to specify it is the average solution.
  • Runtime Scripts
      Low Impact Production (PGE Version) History Attribute Added. A 'PRODUCTIONHISTORY' attribute, which identifies the chain of PGE versions contributing input to the current PGE, is now written to the HDF product archive metadata record. The string consists of multiple PGE IDs and version numbers separated by semicolons. A typical value of the PRODUCTIONHISTORY attribute is "PGE69:4.2.0;PGE56:4.2.0;PGE70:4.2.0", where the PGE69 entry denotes the version of the 5° Tiling code, the PGE56 entry denotes the version of the Daily code, and the PGE57 entry denotes the version of the Eight-Day code used to produce the HDF product file.
      Low Impact Aqua VersionId Changed from 003 to 004. ECS Core attribute VersionId (the Collection identifier) for all Aqua HDF files was changed from 003 to 004. Terra files continue to have their Collection Version ID set at 004.
      Low Impact Processing Environment Attribute Added. ECS Core attribute "ProcessingEnvironment", describing whether the file was produced in a UNIX or LINUX environment, was added to the Archive metadata.
      Low Impact Toolkit Upgrade. The SDPTK (toolkit) configuration was upgraded from 'SDPTK5.2.4v1_64_f90' to 'SDPTK5.2.9v1_64_f90'.


Terra Collection 004 Continues Start of Aqua Collection 004


PGE70 v4.1.0 includes:       ( Terra Forward: ~3.June.2003       Aqua Forward: ~3.June.2003 )

  • Eight Day Global (v4.1.0)
      High Impact Correct Multiday Weighting Problem for all 06_L2 Derived Parameters. Change the Weighting Data Set local attribute on all MOD06_OD derived products from Cloud_Fraction_(Total,Water,etc)_Pixel_Counts to Successful_(Total,Water,etc)_Cloud_Retrieval_Pixel_Counts (see item below for detail). Previously these parameters were weighted by counts (when computing the multiday average) that included failed retrievals. The new version now correctly excludes failed retrievals from the counts. It should be noted that the visible impact (seen by viewing imagery) before and after this correction is negligable, however it can be detected when making grid by grid before and after numerical comparisons (scatter plots, etc.)
      High Impact Correct and Rename Cloud Retrieval Fraction (separated by phase) related SDS's. Change the SDS name for 06_OD derived parameters related to statistics derived the number of successful cloud retrievals. This SDS parameter was previously called Cloud_Fraction_Total, Cloud_Fraction_Water, etc. The new name is Successful_Total_Cloud_Retrieval_Fraction, Successful_Water_Cloud_Retrieval_Fraction, etc. Previously these SDS's incorrectly included failed retrievals, the new corrected parameter does not. Note that the change in the SDS name was instituted to help alleviate confusion from users (since the old SDS name was misleading) and will demark the new (correct) computation. Expanded the long name local attribute to help explain and document this parameter.
      High Impact Extend Cloud Top Temperature histogram and joint histogram bins from 220K to 190K. Add new histogram and (ice cloud phase only) joint histogram bins for Cloud_Top_Temperature, extending the bins down to 190K. Previously the histogram bin lower limit was 220K.
      Moderate Impact Multiday Weighting Scheme Change for Water Vapor and Profile parameters. Change the multiday weighting scheme for 05_L2 and 07_L2 derived parameters from confidence histogram weighting to total pixel count weighting. Note that this has no impact on the L3 data, since neither group of parameters uses a QA assignment of 0 (no confidence data). However this does simplfy the computation and makes the weighting scheme easier to document and understand.
      Moderate Impact Add Solar and Sensor Angle SDS's. Add Solar and Sensor: Zenith and Azimuth Angle SDS’s. These are derived from 5km daytime-only L2 data.
      Low Impact Drop all Cloud_Fraction_SWIR parameters. All Cloud_Fraction_SWIR parameters were removed due to the pertinent flag not being set in the 06_L2 HDF input file. These SDS's have contained all fill (missing data) since launch.
      Low Impact Cloud Fraction from Cloud Mask long-name change. Change long_name of Cloud_Fraction_Infrared to “Cloud Fraction from Cloud Mask (count of lowest 2 clear sky confidence levels, cloudy & probably cloudy / total count)”. Note that the SDS name used (Cloud_Fraction_Infrared) is misleading since this parameter is derived from both IR and Visible tests; however an SDS name change was rejected since it would have created a discontinuity in the MODIS Terra reprocessing stream. Low Impact Correct Local Attributes on Water_Vapor_Near_Infrared_Clear parameter. Correct the local attribute on Water_Vapor_Near_Infrared_Clear relating to the valid categories. Note that these attributes were not used to compute the parameter in the E3 or M3 code, but are only specified for documentation purposes to show how the parameter was computed in the tiling (TL) code.

PGE70 v4.0.2 includes:       ( Terra Forward: ~01.Nov.2002       Aqua Forward: ~01.Nov.2002 )

  • Eight-Day Global (v4.0.2)
      High Impact Bug Fix - Population of Log Statistics. Changed the Statistic_Type local attribute for all log statistics from "Logarithmic" to "Simple" and "Simple_Std". This allows the software to compute and write out common logarithm statistics without necessitating any software changes. Previously all log statistics were unpopulated. Note that the only parameter that is specified to compute and store log statistics is Cloud_Optical_Thickness.
      Moderate Impact Bug Fix - Population of Several Cloud Optical Thickness SDS's. Corrected the "Derived From L3 Daily Data Set" local attribute for several of the Cloud Optical Thickness SDS's. A number of these were specified incorrectly and this prevented data population of the associated arrays.
      Moderate Impact Remove Cloud Top QA-Related SDS's and Parameters. Removed QA attributes & all QA-related SDS's for all Cloud Top Property parameters (those derived from MOD06_CT). This was done because no meaningful QA is supplied for these parameters. Now, only simple unweighted statistics are computed at L3 for these parameters.
      Moderate Impact Remove Cirrus Reflectance QA-Related SDS's and Parameters. Removed QA attributes & all QA-related SDS's for the Cirrus_Reflectance parameter. This was done because no meaningful QA is supplied for this parameter.
      Low Impact Cloud Optical Thickness Log Statistics - Local Attribute Update. Optimized the scale factor, added the necessary offset, and corrected the valid range for all cloud optical thickness log statitics. The new values are optimized for storing common (base 10) logarithms.

PGE70 v4.0.1 includes:       ( Terra Forward: Changes promoted in v4.0.2       Aqua Forward: ~01.Sep.2002 )

  • Eight-Day Global (v4.0.1)
      Low Impact Version 4 Operational in Aqua. Version 4.0.1 MOD_PR08E promotes Terra collection 3 v3.1.1 S/W and product changes (see below) to run in Terra collection 4 and Aqua collection 3 processing. Only S/W version and data collection identifiers are updated.

PGE70 v4.0.0 includes:       ( Terra Forward: Changes promoted in v4.0.2       Aqua Forward: Changes promoted in v4.0.1 )

  • Eight-Day Global (v4.0.0)
      Low Impact Initial Version 4. This is the initial Version 4 S/W delivery of the Atmosphere Level 3 1-Degree eight-day compositing code. It consists of the v3.1.0 statistics algorithm package together with an updated ECS metadata interface. The S/W is designed for use on both Terra and Aqua data streams with Terra products (MOD08_E3) directed into ECS data "Collection 4" and Aqua products (MYD08_E3) into "Collection 3".


Start of Terra Collection 004 Start of Aqua Collection 003


PGE70 v3.1.1 includes:       ( Terra Forward: ~01.Aug.2002       Aqua Forward: Changes promoted in v4.0.1 )

  • Eight-Day Global (v3.1.1)
      High Impact Correct Specification Error in Cloud Top Temperature & Cloud Effective Emissivity Joint Histograms. Corrected error in specification of Cloud Top Temperature and Cloud Effective Emissivity joint histograms. Binning with the Day+Night product was changed to Day only to match King's cloud parameters.
      High Impact Add Retrieved Temperature Profile. Retrieved Temperature Profile SDS's (from the Atmosphere Profile Product) were added.
      Moderate Impact Correct Small Cloud Fraction Truncation Error. Modified the scale factor for all fraction statistics to keep more decimal places and prevent small fractions from being truncated to 0%.
      Moderate Impact Change Weighting Scheme on all Cloud Optical Parameters. Changed the weighting scheme for all Cloud Optical Parameters from fraction weighting to pixel count weighting. Note that a bug was found in the pixel count weighting portion of the code in early 2003 - resolution is pending.
      Moderate Impact Add Cloud Top Pressure vs Effective Emissivity Joint Histograms. Added Cloud Top Pressure vs Cloud Effective Emissivity joint histograms.
      Moderate Impact Cloud Top Temperature (Joint Histogram) Dimension Correction. Corrected the Cloud Top Temperature dimension specification in the Cloud Effective Radius Ice vs Cloud Top Temperature joint histogram.
      Moderate Impact Drop Mixed Cloud Phase as a Valid Category. Modified the local attribute "Aggregation_Valid_Category_Values" for all Cloud Optical parameters, dropping Mixed Phase as a valid category. Dropped all Mixed Phase parameters; however a Mixed Phase for Cloud Fraction SWIR was added for potential future categorical expansion of this parameter (Platnick). These changes will be noted in a new version of the QA Plan expected to be released in late Spring 2003.
      Moderate Impact Remove Aerosol Joint Histograms. Aerosol Parameter joint histograms were dropped (found to be unnecessary).
      Moderate Impact Remove Contrail SDS's. All Contrail-related SDS's were dropped (due to poor performance).
      Moderate Impact Remove K-Index SDS. All K_Index SDS's were dropped (due to poor performance).
      Moderate Impact Pixel Count Computation Tweak. Enhanced code to allow pixel count computations on 3-D parameters in addition to 2-D parameters for which this feature already existed.
      Moderate Impact Add Divide by Zero Check. Increased the robustness of the statistical algorithm that computes weighted means and standard deviations by adding a divide by zero check.
      Low Impact Cloud Optical Thickness and Effective Radius Scale and Range Optimization. Tuned the scale factor on all Cloud Optical Thickness and Cloud Effective Radius parameters to keep more decimal places. Corrected the valid range on Cloud Effective Radius parameters.
      Low Impact Optical Depth Ration Small Ocean Long Name Clarification. Clarified the multiple dimensions of the SDS Optical Depth Ratio Small Ocean in the long_name local attribute.
      Low Impact Infrared Cirrus and High Cloud Fraction Long Name Clarification. Corrected long_name local attribute on Infrared Cirrus and High Cloud Fraction parameters.
      Low Impact Cloud Phase Infrared Long Name Clarification. Clarified the multiple dimensions of the SDS Cloud Phase Infrared in the long_name.

PGE70 v3.1.0 includes:       ( Terra Forward: ~01.Apr.2002       Aqua Forward: ~01.Jun.2002 )

  • Eight-Day Global (v3.1.0)
      Moderate Impact L2 Aerosol Changes Promoted Into L3. Changes at Level 3 were made to retain compatibility with concurrent changes in the Level 2 Aerosol product. Note that this version of the L3 production S/W is incompatible with older versions of the L2 (input) aerosol product (MOD04_L2), which evolved concurrently and prompted these changes. New SDS's: Small Mode Optical Depth for Land and Ocean & Normalized Reflected Flux for Land and Ocean . SDS Name Changes: Optical Depth Ratio Small Land (Dust_Weighting_Factor_Land was changed to Optical_Depth_Ratio_Small_Land) & Optical Depth Ratio Small Ocean (Optical_Depth_Ratio_Small_Ocean was changed to Optical_Depth_Ratio_Small_Ocean_0.86µm).
      Moderate Impact Cloud Top Temperature Joint Histogram Bin Boundary Adjustment. Cloud_Top_Temperature histogram and joint histogram bin boundaries were adjusted (optimized).
      Moderate Impact Cloud Fraction Weighting Scheme Change. All Fraction statistics are now computed as "unweighted". This was done to make the results easier (and more intuitive) to interpret.

PGE70 v3.0.2 includes:       ( Terra Forward: ~01.Nov.2001 )

  • Eight-Day Global (v3.0.2)
      Low Impact Port To Linux. MOD_PR08E was ported to a Linux platform via changes in the makefile and MOD_PR08E.f90.

PGE70 v3.0.1 includes:       ( Terra Forward: ~01.Aug.2001 )

  • Eight-Day Global (v3.0.1)
      Moderate Impact Histogram and Joint Histogram Bin Boundary Change. The Atmosphere Level 3 Eight-Day product specification was changed by redefining Histogram and Joint Histogram bin boundaries, mainly for the cloud parameters.

PGE70 v3.0.0 includes:       ( Terra Forward: Changes promoted in v3.0.1 )

  • Eight-Day Global (v3.0.0)
      Low Impact Consistent Year Processing (Collection 003). MOD_PR08E was tweaked to run in the MODIS "Consistent Year" processing collection. Changes in ECS metadata direct the Atmosphere L3 Eight-Day product into MODIS Data Collection 003, and comply with recent refinements in MODIS metadata standards.


Start of Terra Collection 003