MONTHLY REPORT - May 1999

BNL - Scientific Information Systems Group:


Joyce Tichler, head

Database and Web Page Development: Kathy Doty, Laurie Gregory,
Li Hong Ma (Lynn), Richard Wagener, Graham Campbell, Ron Peierls,
Dave Stampf

External Data: Laurie Gregory Alice Cialella, Li Hong Ma,
Richard Wagener

Satellite Data: Peter Minnett, Richard Wagener

System Management: Laurie Gregory Richard Wagener,
Graham Campbell
_______________________________________________
SCIENCE APPLICATIONS

The Model Location Time Series (MOLTS) data ingest is working for
surface parameters is both the SGP and NSA CART site areas.

Modified the WPDN surface ingest to accomodate additional stations.

Finishing CSPHOT ingests for aerosol optical thickness data
(both screened and un-screened), Almucantar, Size distribution
and principle planes data.

Started ECMWF Ascii (from Jacob) data ingest.

Started TOMS ingest. (see more info below under SATELLITE DATA)

EXTERNAL DATA

Processed Oklahoma Mesonet QA data for 9903.

We realized that the data we had been receiving from ECMWF covered
the wrong rectangle - ie a band from +20 to -20 in latitude covering
all but the Pacific Ocean! ECMWF graciously volunteered to replace that
data with the correct data for us at no additional cost. They asked
us to delete all the incorrect data. With the cooperation of the Archive
staff and the few data recipients, we've seen to that. We received the
correct ECMWF data. Sent sample files to Jim Mather for
verification. Seven tapes covering 199610-19904 were processed.
Updated data inventory pages.

SATELLITE DATA

AVHRR for the Nauru site

Agreement has been reached with Aeromet Inc., the company that operates
the satellite receiving station at the Missile Range on Kwajelein, to
provide AVHRR HRPT (1km) coverage of the Nauru site.  This should be in
operation in early June, in time for the start of the Nauru99 Expedition
on June 15, when the Japanese research ship "Mirai" arrives off Nauru.
Aeromet will supply the XDC with data on 4mm tapes, keeping back-up
copies at Kwajelein until they receive word from the XDC that the tapes have
arrived at BNL in  good shape.

Back-up AVHRR for Nauru99

Peter Minnett has a student participating in the Nauru99 cruise of the
"Mirai" (with NASA funding).  The ship has a TeraScan receiving station
on board and Minnett has arranged for copies of the archive tapes to be
made available.  This will serve as a backup source of AVHRR data should
there be teething problems with the Kwajelein system.

SSM/I data for Nauru99

Globally-gridded, daily SSM/I data and derived products (precipitable
water, liquid water content, rain rate and surface wind speed, available
over the oceans only) will be extracted from the ftp server of Remote
Sensing Systems Inc. in Santa Rosa, California.  At the XDC, areas
covering the TWP sites will be extracted and made available to the
science team.  Coverage can be extended back many years if required.
No requirement for the real-time provision of the data for Nauru99 has
been identified.

PNG satellite receiver

We recently received word that the long-awaited telephone line to the
modem in the computer of the TeraScan satellite receiver in Port
Moresby, Papua New Guinea, had been installed.  However, attempts to
dial in to the computer to diagnose the problems that are preventing
satellite data reception have not been successful.  All we get is the ringing
tone. SeaSpace are working on some diagnostics that can run by the PNG NWS
personnel to try to fix this problem.  The saga continues.

TOMS data

A procedure to access the columnar ozone data on the ftp server of the
TOMS (Total Ozone Mapper Spectrometer) on the NASA Earth Probe Satellite
was implemented.

   The following three new datastreams of Total Ozone Mapping
Spectrometer (TOMS) data were added to production.

        gectomsaerosolindexX1.00
        gectomsozoneX1.00
        gectomsreflX1.00

Note: gec = global earth coverage

Retrieved all backlog files of TOMS for 19970725-present.

The raw files contain aerosol index, total ozone and reflectivity.
The planned ingest will create a weekly file for each site containing
all three variables. There is more information available at the
TOMS web site http://jwocky.gsfc.nasa.gov

Continued to process twpgms5X1.00 data. Four tapes covering
    19990328 - 19990430 were processed. Updated data inventory pages.

Hovmuller diagrams of GOES8 data for 9811-9904 were generated after
    correcting the label mistake.

Hovmuller diagrams of twpgms data for 9902-9904 were generated.

PIF/CAR/DQR

We ported a snapshot of the PIFCARDQR database from Empress to Sybase in
order to facilitate the development and testing of the MDN. The port was
relatively painless requiring us to become more familiar with the
specifics of Sybase system management and required the modification of
some of the MDN scripts to conform more closely to the Sybase version of
SQL.

An analysis of many of the scripts that deal with the Empress version of
this database indicated that the scripts could easily be ported to
Sybase by using Sybperl. Report generation is still an issue.

INVENTORY DATABASE

The first pass at testing pointed out some bugs at the 256 character
boundary that databases impose on the length of strings that they
provide internal support for (functions, stored procedures, constraints,
searches etc.) A small amount of redesign was required and testing will
continue shortly.

WEB

Monitored and evaluated security risks to webserver, because of widely
publicized threat to all .gov webservers.

SURFACE CHARACTERIZATION

Received Landsat TM data over the SGP Central Facility for 19970607
and 19990309 from Bob Cahalan of NASA GSFC.

Began process to download monthly pacific rainfall data from the
University of Oklahoma. Check the following Web site to see all data
they have to date: http://www.evac.ou.edu/pacrain/

Determined that AVIRIS image dated 8/1/97 was not requested by ARM
nor "owed" to ARM for use of SGP site.  Ordered raw data for above date
that corresponds with the jpeg file we currently have.

Straightened out confusion between the NASA Pathfinder Global Land
Cover Test Site (GLCTS) data and the European Space Agency's Land
Surface Processes Interaction Mission.  Both have recently contacted ARM
to be a test site but they are otherwise unrelated projects.  A database
of contacts will be available via the XDC Web page to minimize future
confusions.

Delivered slightly larger area of Walnut River Watershed available
water capacity and soil depth for the first two soil layers to Marv
Wesely and Jie Song (ANL) along with land use/land cover data for the
same geographic area. Also sent the boundary of the Walnut River Watershed.

SYSTEM DEVELOPMENT

Installed IDL 5.2 on xdcd & sisg.

MAINTENANCE

Installed terascan patches to 2.6 since terascan 3.0 is not supported
(and does not install) on Solaris 2.6.  Also enabled NOAA-15
processing and downloaded all orbit information needed for NSA AVHRR
processing.

Currently evaluating quantitatively the output differences introduced
by those patches.

Patched all Solaris machines to a common patch-level (June 2).
 

WEB STATISTICS for May 1999

www.arm.gov
Accesses:  230,903
Distinct hosts served: 4,529
Data transferred:      1,427 Mbytes
46% requests from .gov
 7% requests from .es (unresolved numerical addresses)
13% requests from .edu
13% requests from .com
 7% requests from .net

Directories accessed
56% docs
24% root directory
15% general
 3% uav

www.xdc.arm.gov:
Accesses:  14,476
Distinct hosts served:    653
Data transferred:     348,957 kbytes
33% requests from .gov
41% requests from .com
 9% requests from .edu
 8% unresolved numerical addresses
 5% requests from .net

Directories accessed
26% data_viewers
60% data
 7% stats
 4% docs

www.db.arm.gov:
Accesses:    2,672
Distinct hosts served:    110
Data Transferred:     7,251 Kbytes
47% requests from .gov
16% requests from .com
13% unresolved numerical addresses
 9% requests from .edu
 4% requests from .net

Directories accessed:
 4% Publist
38% emp-bin
23% PIFCARDQR
14% MDS

SYSTEM PERFORMANCE AND STATISTICS

More details on the status and statistics for the BNL work is
available from http://www.db.arm.gov/or http://www.xdc.arm.gov