LP DAAC Homepage
Home About Products Data Tools Order Data News Help/Edu Links Contact Us

Instructions for Handling ASTER and MODIS Data Sets Using the Data Pool HDFEOS-to-GeoTiff (DP-HEG) Tool

1.0 Introduction

2.0 Using DP-HEG with ASTER Data Sets

2.1 DP-HEG ASTER Output Files

2.2 Description of the Results Page Returned from a DP-HEG Search for ASTER Level-1B Data Sets

2.3 Default Values Used in the Format and Projection Conversion Utility For ASTER Level-1B Data Sets

2.4 Handling ASTER Bands 3N and 3B

2.5 Geo-referencing DP-HEG-derived ASTER Output

3.0 Using DP-HEG with MODIS Data Products

3.1 Spatial Subsetting

3.2 Description of the Results Page Returned from a DP-HEG Search for MODIS Data Products

3.3 Default Values Used in the Format and Projection Conversion Utility For MODIS Grid Products

4.0 Ordering Options for ASTER and MODIS Products

5.0 Resources


1.0 Introduction

The Data Pool HDFEOS-to-GeoTiff (DP-HEG) is an interface where a set of tools is available as part of the ordering process from the LP DAAC (http://lpdaac.usgs.gov/main.asp) for data manipulation of ASTER and MODIS data sets via the Data Pool (http://lpdaac.usgs.gov/datapool/datapool.asp). The following is a set of basic instructions highlighting the functionality and capabilities of the DP-HEG. There are varying options for processing and ordering different ASTER and MODIS products. The following instructions are therefore broken down by the two sensors.

Note: DP-HEG is not a set of stand-alone tools that you download for independent use. It is also important to remember that the DP-HEG is different from the stand-alone HEG tool.

The following tables outline the basic capabilities of the Data Pool HEG and the various output options that are available for the ASTER Level-1B and the MODIS products:

Key Data Pool HEG Capabilities
Service Options
Format Conversion HDF-EOS or GeoTiff
Projection Conversion UTM, Geographic, Polar Stereographic, Sinusoidal
Spatial Subsetting Only for MODIS Data

Data Pool HEG Output Products Available for ASTER and MODIS Data
Output ASTER Level-1B Products Terra MODIS Grid Products Aqua MODIS Grid Products
HDF No-Change (Original) x x x
GeoTiff No-Change/UTM x    
GeoTiff No-Change/Sin   x x
HDF Geographic x x x
GeoTiff Geographic x x x
HDF Polar Stereographic x x x
GeoTiff Polar Stereographic x x x
HDF UTM (North-Up) x x x
GeoTiff UTM (North-Up) x x x


2.0 Using DP-HEG with ASTER Data Set

The only ASTER product available via the Data Pool is the ASTER Level-1B data set over U.S. and its territories. The ASTER Level-1B Registered Radiance at the Sensor product contains radiometrically calibrated and geometrically co-registered data for all the channels acquired previously through the telemetry streams of the VNIR, SWIR, and TIR telescopes in ASTER Level-1A (http://lpdaac.usgs.gov/aster/ast_l1b.asp).

The embedded functionality in DP-HEG allows you to manipulate ASTER Level-1B with particular format conversion and projection options. The following table highlights those available options and also provides details on the ordering mechanisms.

Input Output Format Output Projection Description
ASTER Level-1B HDF-EOS + UTM No change No change The original ASTER HDF-EOS swath-oriented UTM projection is copied to the DP download directory.
ASTER Level-1B HDF-EOS + UTM GeoTiff No change The original ASTER HDF-EOS swath-oriented UTM projection is converted to swath-oriented single-band UTM GeoTiff files. Each band has an accompanying geolocation text file extracted from the embedded HDF geometric control table (GCT) metadata. These are arrays of pixel/line locations and their geographic latitude and longitude coordinates. The original HDF metadata file is also provided with an input.xml extension.
ASTER Level-1B HDF-EOS + UTM No change Geographic The original ASTER HDF-EOS swath-oriented UTM projection is converted to Geographic projection with single-band HDF-EOS files. Each band has an accompanying metadata file with a .met extension. The original HDF metadata file is also provided with an input.xml extension.
ASTER Level-1B HDF-EOS + UTM GeoTiff Geographic The original ASTER HDF-EOS swath-oriented UTM projection is converted to Geographic projection with single-band GeoTiff files. Each band has an accompanying metadata file with a .met extension. The original HDF metadata file is also provided with an input.xml extension.
ASTER Level-1B HDF-EOS + UTM GeoTiff UTM North-Up The original ASTER HDF-EOS swath-oriented UTM projection is converted to swath-oriented single-band North-Up UTM GeoTiff files. Each band has an accompanying geolocation text file extracted from the embedded HDF geometric control table (GCT) metadata. These are arrays of pixel/line locations and their geographic latitude and longitude coordinates. The original HDF metadata file is also provided with an input.xml extension.
ASTER Level-1B HDF-EOS + UTM GeoTiff Polar Stereographic The original ASTER HDF-EOS swath-oriented UTM projection is converted to Polar Stereographic projection with single-band GeoTiff files. Each band has an accompanying metadata file with a .met extension. The original HDF metadata file is also provided with an input.xml extension.
ASTER Level-1B HDF-EOS + UTM No change UTM North-Up The original ASTER HDF-EOS swath-oriented UTM projection is converted to swath-oriented single-band North-Up UTM GeoTiff files. Each band has an accompanying geolocation text file extracted from the embedded HDF geometric control table (GCT) metadata. These are arrays of pixel/line locations and their geographic latitude and longitude coordinates. The original HDF metadata file is also provided with an input.xml extension.
ASTER Level-1B HDF-EOS + UTM No change Polar Stereographic The original ASTER HDF-EOS swath-oriented UTM projection is converted to Polar Stereographic projection with single-band GeoTiff files. Each band has an accompanying metadata file with a .met extension. The original HDF metadata file is also provided with an input.xml extension.


2.1 DP-HEG ASTER Output Files

The output files from DP-HEG have an elaborate file naming convention. The following description is designed to provide broad guidelines for interpreting the file names.

Output File Name Description
HDF-EOS
No change in format and projection

AST_L1B_00309162003161040_10012003140030.hdf AST_L1B_00309162003161040_10012003140030.hdf.xml AST_L1B_00309162003161040_10012003140030.hdfmet

ConverterSynopsis.txt
003: Version Number

09162003161040: Acquisition Date & Time (mmddyyyyhhmmss)

10012003140030: Production Date & Time (mmddyyyyhhmmss)
GeoTiff
No change in projection
AST_L1B_00309162003161040_10012003140030.hdf.input.xml

AST_L1B_003091620031_10012003140030_ImageData4_453_5.tif
AST_L1B_003091620031_10012003140030_ImageData4_453_5.tif.met
AST_L1B_003091620031_10012003140030_ImageData4_453_5_geolocations.txt

AST_L1B_003091620031_10012003140030_ImageData14_453_15.tif
AST_L1B_003091620031_10012003140030_ImageData14_453_15.tif.met
AST_L1B_003091620031_10012003140030_ImageData14_453_15_geolocations.txt

AST_L1B_003091620031_10012003140030_ImageData3N_453_3.tif
AST_L1B_003091620031_10012003140030_ImageData3N_453_3.tif.met
AST_L1B_003091620031_10012003140030_ImageData3N_453_3_geolocations.txt

ConverterSynopsis.txt
input.xml: Input hdf-EOS metadata

453: Unique DP-HEG Identifier

Data4 through Data9: SWIR Bands 4-9

Data10 through Data14: TIR Bands 10-14

Data1 through Data3N: VNIR Bands 1-4

ConverterSynopsis.txt: Processing log files
HDF-EOS Geographic AST_L1B_00309162003161040_10012003140030.hdf.input.xml

AST_L1B_003091620031_10012003140030_ImageData8_452_9.hdf
AST_L1B_003091620031_10012003140030_ImageData8_452_9.hdf.met

AST_L1B_003091620031_10012003140030_ImageData13_452_14.hdf
AST_L1B_003091620031_10012003140030_ImageData13_452_14.hdf.met

AST_L1B_003091620031_10012003140030_ImageData3B_452_4.hdf
AST_L1B_003091620031_10012003140030_ImageData3B_452_4.hdf.met

ConverterSynopsis.txt
input.xml: Input hdf-EOS metadata

452: Unique DP-HEG Identifier

Data4 through Data9: SWIR Bands 4-9

Data10 through Data14: TIR Bands 10-14

Data1 through Data3N: VNIR Bands 1-4

ConverterSynopsis.txt: Processing log files
GeoTiff Geographic AST_L1B_00309162003161040 _10012003140030.hdf.input.xml

AST_L1B_003091620031_10012003140030_ImageData7_454_8.tif
AST_L1B_003091620031_10012003140030_ImageData7_454_8.tif.met

AST_L1B_003091620031_10012003140030_ImageData14_454_15.tif
AST_L1B_003091620031_10012003140030_ImageData14_454_15.tif.met

AST_L1B_003091620031_10012003140030_ImageData1_454_1.tif
AST_L1B_003091620031_10012003140030_ImageData1_454_1.tif.met

ConverterSynopsis.txt
input.xml: Input hdf-EOS metadata

454: Unique DP-HEG Identifier

Data4 through Data9: SWIR Bands 4-9

Data10 through Data14: TIR Bands 10-14

Data1 through Data3N: VNIR Bands 1-4

ConverterSynopsis.txt: Processing log files


2.2 Description of the Results Page Returned from a DP-HEG Search for ASTER Level-1B Data Sets

The following is a description of the icons returned on the "Results" page from an ASTER Level-1B data search.

  • Once you initiate the Data Pool client interface, you can employ a drill-down search method to identify granules that meet your spatial/temporal interests (http://e4eil01u.ecs.nasa.gov:22000/WebAccess/helpFrame.html)
  • The "Results" page lists 7 columns: Granule, Size, BeginDate, EndDate, BeginTime, EndTime, and Day-NightFlag
Screenshot of the Results page from an ASTER Level-1B data search.
  • In the Granule column, there are 9 icons, each representing a different function:

  • Icons representing each different function.
    Download Granule Download Granule
    Download Granule using zip compression (*.zip) Download Granule using zip compression (*.zip)
    Download Granule using gnu zip compression (*.gzip) Download Granule using gnu zip compression (*.gzip)
    Download Granule using UNIX compression (*.Z) Download Granule using UNIX compression (*.Z)
    View complete metadata View complete metadata
    View browse file View browse file
    View metadata and browse files View metadata and browse files
    Add granule to Shopping Cart Add granule to Shopping Cart
    DP-HEG Data format and projection conversion utility DP-HEG Data format and projection conversion utility

    The functionality supported by the last two icons, the shopping cart (shopping cart), and the format and projection conversion utility (projection conversion utility), are elaborated in the preceding tables above. Some key points and caveats regarding the DP-HEG functionality include the following:

    • Order Thresholds: There are no problems with single-granule orders but multiple-granule orders could pose problems such as failed orders and missing metadata information
    • Proliferation of Files: Presently, the upper limit on the number of DP-HEG orders while using the shopping cart is 50 granules. But selecting this upper limit could potentially add over 2,250 individual files in one directory
    • System Instability with Large Orders: In light of the above, placing a large order is expected to cause system instability. This is further aggravated by the need to maintain a large number of temporary files, and concurrency in those file names

    The format and projection conversion utility (projection conversion utility ) initiates the "Select Conversion Parameters" GUI where you have the opportunity to define format conversion, projection conversion and spatial subsetting functions.



    2.3 Default Values Used in the Format and Projection Conversion Utility For ASTER Level-1B Data Sets

    The DP-HEG conversion software calculates and uses appropriate default projection parameters for certain combinations of formats and projections. You need to provide values for these fields only if your projection requirements are different. The following table identifies the format and projection combinations for ASTER Level-1B data sets that accept optional alternative user-supplied parameter values.

    Note: WGS84 is the default datum used for the projection conversions.

    Format and Projection Combinations Input Fields
    HDF-EOS + UTM Latitude in Zone and Longitude in Zone (Decimal Degrees)
    HDF-EOS + Polar Stereographic Central Longitude, Latitude of True Scale, False Easting, False Northing (Meters)
    GeoTiff + UTM Latitude in Zone and Longitude in Zone (Decimal Degrees)
    GeoTiff + Polar Stereographic Central Longitude, Latitude of True Scale, False Easting, False Northing (Meters)


    2.4 Handling ASTER Bands 3N and 3B

    The ASTER bands 3N (nadir) and 3B (backward) have different image dimensions, and presently, they are handled differently in various image processing software packages. The 400-line offset in the band 3B is excluded, however, all the overlapping areas between bands 3N and 3B are present.



    2.5 Geo-referencing DP-HEG-derived ASTER Output

    Presently, there are problems with some software packages' handling the geo-referencing for an ASTER HDF-EOS format scene that is projected to Geographic. For more information on geo-referencing ASTER Level-1 data, consult the following URL: http://lpdaac.usgs.gov/aster/ASTER_GeoRef_FINAL.pdf



    3.0 Using DP-HEG with MODIS Data Products

    There are a number of MODIS products derived from both the Terra and Aqua platforms that are available in the Data Pool (http://lpdaac.usgs.gov/datapool/datatypes.asp). Presently, there are 19 MODIS products that are handled by DP-HEG. As additional data products are made available, this section will accordingly be updated. These products include the following:

    The following table describes the various format and projection conversion output options the DP-HEG offers for the 19 Terra and Aqua MODIS Grid products.

    Note: Currently MODIS products that cross the International Dateline (180th meridian) or the Poles may produce unreliable results. This is being addressed and will be corrected in the near future.

    Input Output Format Output Projection Description
    MODIS Grid Products HDF-EOS + Sin. No change No change The original MOD09A1 HDF-EOS format and Sinusoidal projection are retained and copied to the DP download directory.
    MODIS Grid Products HDF-EOS + Sin. No change* Sinusoidal The original MOD09A1 HDF-EOS format is retained while converting its projection to Sinusoidal. Each band has an accompanying metadata file with a .met extension. The original HDF metadata file is also provided with an input.xml extension.
    MODIS Grid Products HDF-EOS + Sin. No change* Geographic The original MOD09A1 HDF-EOS format is retained while converting its projection to Geographic. Each band has an accompanying metadata file with a .met extension. The original HDF metadata file is also provided with an input.xml extension.
    MODIS Grid Products HDF-EOS + Sin. No change* Polar Stereographic The original MOD09A1 HDF-EOS format is retained while converting its projection to Polar Stereographic. Each band has an accompanying metadata file with a .met extension. The original HDF metadata file is also provided with an input.xml extension.
    MODIS Grid Products HDF-EOS + Sin. No change* UTM The original MOD09A1 HDF-EOS format is retained while converting its projection to UTM. Each band has an accompanying metadata file with a .met extension. The original HDF metadata file is also provided with an input.xml extension.
    MODIS Grid Products HDF-EOS + Sin. GeoTiff* Sinusoidal The original MOD09A1 HDF-EOS format is converted to GeoTiff while retaining its projection in Sinusoidal. Each band has an accompanying metadata file with a .met extension. The original HDF metadata file is also provided with an input.xml extension.
    MODIS Grid Products HDF-EOS + Sin. GeoTiff* Geographic The original MOD09A1 HDF-EOS format is converted to GeoTiff and its projection is converted to Geographic. Each band has an accompanying metadata file with a .met extension. The original HDF metadata file is also provided with an input.xml extension.
    MODIS Grid Products HDF-EOS + Sin. GeoTiff* Polar Stereographic The original MOD09A1 HDF-EOS format is converted to GeoTiff and its projection is converted to Polar Stereographic. Each band has an accompanying metadata file with a .met extension. The original HDF metadata file is also provided with an input.xml extension.
    MODIS Grid Products HDF-EOS + Sin. GeoTiff* UTM The original MOD09A1 HDF-EOS format is converted to GeoTiff and its projection is converted to UTM. Each band has an accompanying metadata file with a .met extension. The original HDF metadata file is also provided with an input.xml extension.

    * Except for the original HDF-EOS product in Sinusoidal projection, all other format and projection options will output single band layers with accompanying metadata files.



    Output File Name Description
    HDF-EOS
    No change in format and projection

    MOD09A1.A2003177.h11v05.004.2003194092334.hdf
    MOD09A1.A2003177.h11v05.004.2003194092334.hdf.xml
    MOD09A1.A2003177.h11v05.004.2003194092334.hdfmet

    ConverterSynopsis.txt
    A2003177: Acquisition Year/Julian Date

    h11v05: TileID

    003: Version Number

    2003194092334: Julian Processing Date & Time (yyyydddhhmmss)
    GeoTiff
    No change in projection

    MOD09A1.A2003177.h11v05.004.2003194092334.hdf.input.xml

    MOD09A1_A2003177_h11v05_004_2003194092334_sur_refl_b01_2885.tif
    MOD09A1_A2003177_h11v05_004_2003194092334_sur_refl_b01_2885.tif.met

    ConverterSynopsis.txt
    input.xml: Input hdf-EOS metadata

    2885: Unique DP-HEG Identifier

    ConverterSynopsis.txt: Processing log files
    HDF-EOS
    Geographic

    MOD09A1.A2003177.h11v05.004.2003194092334.hdf.input.xml

    MOD09A1_A2003177_h11v05_004_2003194092334_sur_refl_b01_2885.hdf
    MOD09A1_A2003177_h11v05_004_2003194092334_sur_refl_b01_2885.hdf.met

    ConverterSynopsis.txt
    input.xml: Input hdf-EOS metadata

    2885: Unique DP-HEG Identifier

    ConverterSynopsis.txt: Processing log files


    3.1 Spatial Subsetting

    Spatial Subsetting is available for the 19 MODIS Grid products that are handled by DP-HEG. The bounding rectangle of the area to be subsetted is defined in decimal degree coordinates via the Spatial Subsetting Dialog that allows the application of these settings to all applicable granules in the shopping cart and/or making these the default settings. The specified latitude and longitude coordinates of the area to be subset must at least partially intersect the granule or the subsetting operation will not work correctly.



    3.2 Description of the Results Page Returned from a DP-HEG Search for MODIS Data Products

    The following is a description of the icons returned on the "Results" page from a MODIS MOD09A1 data search.

    • Once you initiate the Data Pool client interface, you can employ a drill-down search method to identify granules that meet your spatial/temporal interests (http://e4eil01u.ecs.nasa.gov:22000/WebAccess/helpFrame.html)
    • The "Results" page lists 7 columns: Granule, Size, BeginDate, EndDate, BeginTime, EndTime, and Day-NightFlag
    Icons returned on the Results page from a MODIS MOD09A1 data search.
    Download Granule Download Granule
    Download Granule using zip compression (*.zip) Download Granule using zip compression (*.zip)
    Download Granule using gnu zip compression (*.gzip) Download Granule using gnu zip compression (*.gzip)
    Download Granule using UNIX compression (*.Z) Download Granule using UNIX compression (*.Z)
    View complete metadata View complete metadata
    View browse file View browse file
    View metadata and browse files View metadata and browse files
    Add granule to Shopping Cart Add granule to Shopping Cart
    DP-HEG Data format and projection conversion utility DP-HEG Data format and projection conversion utility

    The details in section 2.2 describing the icons and their functionality on the results page are exactly applicable to MODIS products as well. The only difference stems from the list of available options that may uniquely be applicable to MODIS products.



    3.3 Default Values Used in the Format and Projection Conversion Utility For MODIS Grid Products

    The DP-HEG conversion software calculates and uses appropriate default projection parameters for certain combinations of formats and projections. You need to provide values for these fields only if your projection requirements are different. The following table identifies the format and projection combinations for MODIS Grid products that accept optional alternative user-supplied parameter values.

    Note: WGS84 is the default datum used for the projection conversions.

    Format and Projection Combinations Input Fields
    HDF-EOS + UTM Latitude in Zone and Longitude in Zone (Decimal Degrees)
    HDF-EOS + Polar Stereographic Central Longitude, Latitude of True Scale, False Easting, False Northing (Meters)
    HDF-EOS + Sinusoidal Central Longitude (Decimal Degrees), False Easting, False Northing (Meters)
    GeoTiff + UTM Latitude in Zone and Longitude in Zone (Decimal Degrees)
    GeoTiff + Polar Stereographic Central Longitude, Latitude of True Scale, False Easting, False Northing (Meters)
    GeoTiff + Sinusoidal Central Longitude (Decimal Degrees), False Easting, False Northing (Meters)


    4.0 Ordering Options for ASTER and MODIS Products

    The ASTER Level-1B and MODIS Products can be ordered either as individual or multiple granules. The following table provides details on both the options.

    Ordering Options Description
    Ordering individual granules The user picks the product options & supplies user name & eMail address. A confirmation eMail is sent to the user upon completion of request. A notification eMail is sent upon completion of the order. The only exception is in the case of the "No change to HDF-EOS" option, where only the notification eMail is sent to the user.
    Ordering individual granules via Shopping Cart The user selects granules from the Data Pool and loads them in the Shopping Cart while also picking one product option for each individual granule. All the DP-HEG-processed data files are delivered to the user in a single directory. All relevant details on how and where to retrieve the files from are sent in the confirmation and notification eMails to the user.
    Bulk ordering via Shopping Cart The user selects granules from the Data Pool and loads them in the Shopping Cart while also picking one product option for all the granules. All the DP-HEG-processed data files are delivered to the user in a single directory. All relevant details are sent in the confirmation and notification eMails to the user.


    5.0 Resources

    DP-HEG Users Guide
    http://edhs1.gsfc.nasa.gov:8001/edhs1.gsfc.nasa.gov/QuickSearch?515-EMD-002

    HDF-EOS Tools and Information Center
    General Overview of HDF-EOS


    For additional questions or concerns regarding the DP-HEG, contact:

    LP DAAC User Services
    U.S. Geological Survey (USGS)
    Earth Resources Observation and Science Center (EROS)
    47914 252nd Street
    Sioux Falls, SD 57198-0001

    Phone: 605-594-6116
    Toll Free:  866-573-3222

    866-LPE-DAAC
    Fax: 605-594-6963
    Email: LPDAAC@eos.nasa.gov
    Web: http://LPDAAC.usgs.gov




    This site is hosted by the USGS - NASA Distributed Active Archive Center
    U.S. Government: Public Information Exchange Resource
    NASA: Privacy Policy and Important Notices
    USGS: Privacy Statement, Disclaimer, Accessibility, FOIA
    DOI: Privacy Statement, Privacy Disclaimer, No FEAR Act, FOIA,
    Performance Plan, Children's Privacy
    URL: http://LPDAAC.usgs.gov/landdaac/tools/heg/heg_summary.asp
    Technical Contact: LPDAAC@eos.nasa.gov
    Last Update: Wednesday, September 26, 2007
    Download Adobe Acrobat Reader
    Link to USA.gov