STScI Logo

Reference Data for Calibration and Tools

The process of creating quality reference files starts with the Instrument Teams who are responsible for the various forms of calibration data pertinent to them. Following a delivery protocol, the teams create, validate, test, and submit the reference files to the INS Reference Data for Calibration and Tools (ReDCaT) Management Team, which in the process of preparation for delivery to the Archive, Operations and other analysis tools, performs additional validation. The end result is the ingest of the reference files into the Calibration Reference Data System (CRDS) or the Exposure Time Calculators (ETC) and the Python Synthetic Photometry Package (pysynphot) repositories, the HST's ground system reduction pipeline (OPUS), their archiving in the Data Archiving and Distribution System (DADS), and their inclusion in the STScI on-line archives.

The team currently uses CRDS to manage Calibration Pipeline reference files. In the case of pysynphot and ETC reference data, the ReDCaT Management Team is currently developing the Tools Reference Data System (TRDS).

CRDS is the replacement of the Calibration Database System (CDBS) at STScI. CRDS is a metadata based system that maps datasets to data using mapping rules. The reference files are used for pre-archive processing, calibration, and reprocessing of archival data. They can also be retrieved from the HST archive for recalibration at a user's home site.

TRDS on the other hand, provides the adequate configuration management for the data used by STScI developed tools. In its current state, it is a set of databases to support tracking of the reference data for tools like ETC and Pysynphot. It will soon include software to handle validation, delivery and archiving of the data.

This page details the protocols and procedures, and provides information for the reference files that have been delivered to CRDS or TRDS.

For questions, please email ReDCaT Team, at STScI. (Note that you need to change "_at_" part of the e-mail address to "@" before you send your message.)