NASA - National Aeronautics and Space Administration
Follow this link to skip to the main content
+ Site Help & Preferences
Go
ABOUT NASA LATEST NEWS MULTIMEDIA MISSIONS MyNASA WORK FOR NASA

+ NASA Home
+ IVV Home
Metrics Data Program
MDP HOME
WHAT IS THE MDP?
CONTACT THE MDP TEAM
PROJECT RECRUITING
REPOSITORY OVERVIEW
REPOSITORY LISTING ACCESS
MDP Banner

GLOSSARY AND DEFINITIONS
+ Top

Activity - The activity data indicates what high level task was occurring at the time a defect was discovered (e.g. "Testing"). This data is usually available at the time a defect record is opened.

+ Top

History Date - Date in which history event occurred or was recorded.

+ Top

Change Control Board - Change Control Board (CCB) information indicates the date of and notes for CCB meetings. The CCB makes decisions related to the implementation of changes.

+ Top

Code Review - The code review flag indicates whether or not a code review was conducted as a result of a defect. The value is either 'Y' indicating that a code review had occurred or 'N' indicating that a code review had not occurred.

+ Top

Class - A template from which objects can be created.

+ Top

Close Reason - The general reason for the closure of the error report. For instance: fixed, duplicate, obsolete or reject.

+ Top

Cost - Relative cost for the fix (i.e., high, medium, low)

+ Top

CSCI - Term applied to the design level incorporating products that often having similar functions or capabilities. The term CSCI can be synonymous with sub-system but the definition may vary from project to project.

+ Top

CSC - Computer Software Component. CSCIs are comprised of logical groups of CSCs. This design element generally is comprised of files, which make up an executable.

+ Top

Defect Close - This field identifies when a defect record was closed in a project's defect tracking system.

+ Top

Defect Data - The MDP repository contains defect data, which is the data, contained within a error report. Error reports describe the changes made to software due to a problem in the software. Defect data is also referred to as error data or problem data in MDP.

+ Top

Defect History - Defect history refers to the attributes of a defect that represent the dynamic qualities of a defect record throughout its life cycle. The defect history can be used to identify a defect's state changes (open,close,etc.) as well as other information gathered about a defect during these states. Defect history attributes typically have associations to dates.

+ Top

Defect Open - This field identifies when a defect record was originally added to a project's defect tracking system. Sometimes synonymous with New and Submitted.

+ Top

Defect State Change - A defect record can go though a variety of different states throughout its life cycle. These state change behaviors can vary from project to project.

Typical Defect States
  • New - Indicates when a defect record was submitted to a project's defect tracking system.
  • Open - Indicates when a defect record essentially becomes active in a defect tracking system. Usually occurs after the New or Submitted state.
  • Approved - Indicates when an authorized individual or group approves a defect record for further investigation.
  • Work In Progress - Indicates when the investigation and resolution process for defect record began.
  • Resolved - Indicates when a defect had been resolved. Resolution could indicate that a defect necessitated a change or that the conditions under which a defect became apparent no longer exist.
  • Verified - Indicates when an authorized individual or group has investigated and verified the steps taken to a defect's resolution.
  • Closed - Indicates when the life cycle of a defect essentially ends. Defects are most often closed after a successful resolution was found and verification was performed.

+ Top

Defect Status - Defect status indicates the state of a defect record at the time it was stored in the data repository. In most cases the value will be 'C' indicating that a defect was closed for one reason or another.

+ Top

Defect Type - The defect type classifies a defect. In most cases a defect type will be something like "sw-bug" or "Software Bug". Defect type data is usually available in the latter portion of a defect's life cycle (Resolution through Close).

+ Top

Deferred on - The date the error report was deferred. However, the date is not so important as it is an indicator that a deferral occurred.

+ Top

Design Level - Design levels indicate a product's role in the product hierarchy. Design level can vary from project to project based upon a project's definition of each level in the product hierarchy. CSCI is one example of a design level.

+ Top

Design Review - The design review flag indicates whether or not a design review was conducted as a result of a defect. The value is either 'Y' indicating that a design review had occurred or 'N' indicating that a design review had not occurred.

+ Top

Est-Fix-Hours - The number of man hours it took to implement the fix. The quality of this data varies by project.

+ Top

Est-SLOC-Count - The number of SLOC involved in the fix. This can include changed SLOC or new SLOC.

+ Top

Fix-Hours - The actual number of man hours the fix took to implement.

+ Top

How Found - The phase in which, the error was found. For instance: Inspection, Test, Operations, etc.

+ Top

IV&V - An acronym for Independent Verification & Validation.

+ Top

Language - Language refers to the programming language used to generate the source code.

+ Top

LOC - An acronym for Lines Of Code.

+ Top

Metrics - Metrics are measurements of software attributes. For example, Total Lines of Code is a measurement of the number of lines of code (executable statements, comments and blank lines) for a given module.

+ Top

Mode - The mode the system was operating in. For instance, Development, Operations, Test

+ Top

Module - Term applied to the lowest level functional unit from which metrics can be generated. In most cases this refers to code specific items such as functions but the real world implementation can vary between projects and programming languages (e.g. functions, modules, subroutines).

+ Top

ODC - Orthogonal Defect Classification

  • Activity - Describes the task performed when a defect was uncovered.
  • Age - Describes the age of the defect.
  • Impact - Describes the customer's perception of the consequence of the defect if it was discovered in the field.
  • Qualifier - Describes the nature of the defect discovered (ie. Missing, Incorrect, Extraneous, etc.)
  • Source - Describes the location that the defective code was produced at.
  • Target - Describes the high-level classification of the deliverable fixed.
  • Trigger - Describes the environment or condition that had to exist in order for the defect to surface.
  • Type - Describes the corrections made to resolve the defect.

+ Top

Priority - This value quantifies the necessity for this defect to be resolved where 1 has the highest priority (critical) to 3 for lowest priority. For example, priority 1 generally means that there is a critical need for the resolution of a defect where priority 3 generally means that the development or maintenance can delay the change.

+ Top

Problem-Type - Specific reason for closure of error report.

+ Top

Product - A product is an entity to which defect data and metrics data can be associated. In most cases products will be synonymous with code related items such as functions and systems/sub-systems.

+ Top

Product Hierarchy - A product hierarchy is the relationship between different design levels of products. Product hierarchies may differ between projects and programming languages as the levels at which different levels of products are defined differently for different projects and different programming languages. An example of a product hierarchy would be the relationship exhibited by a C++ class owning different functions where the class would be defined as a higher design level than the functions.

+ Top

Project - The Metrics Data Program gathers and generates its repository data on a per-project basis. Each project in the database consists of product data, product metrics data and the associated error data. A project as it exists in the repository may represent either an entire set of data from a real world project or a subset of such data. Current the projects in the MDP database are as follows:

  • CM1 - Data available for this project is from a science instrument. It is written in C Code with approximately 20 KSLOC. All associated error data based on change reports is available. Additional software artifacts including software requirement specification, software design documentation and traceability information may be requested by contacting the Metrics Data Program directly.
  • JM1 - This is a real time C project which has approximately 315 KSLOC.  There are eight years of error data associated with the metrics.  The changes to the modules are based on the changes reported within the problem reports.
  • KC1 - This is a single CSCI within a large ground system.  It is made up of 43 KSLOC of C++ code.  Error data for this code has been collected since the beginning of the project but that data can only be associated to the module (method) back to five years.
  • KC3 - KC3 is an effort that has been coded in 18 KLOC of java. The purpose of the code is the collection, processing and delivery of satellite metadata.
  • KC4 - KC4 is a ground-based subscription server consisting of 25 KLOC of Perl code.
  • MC1 - MC1 is a combustion experiment that is designed to fly on the space shuttle. This project consists of more than 63 KLOC of C & C++ code.
  • MC2 - MC2 is software designed to run a video guidance system. This project consists of more than 6 KLOC of C code with associated error data.
  • MW1 - MW1 is the software from a zero gravity experiment related to combustion. The experiment is complete. It is comprised of 8000 lines of C code.
  • PC1 - PC1 is flight software from an earth orbiting satellite that is no longer operational. It consists of 40 KLOC of C code.
  • PC2 - PC2 is dynamic simulator for attitude control systems. It consists of 26 KLOC of C code.
  • PC3 - PC3 is flight software from an earth orbiting satellite that is currently operational. It consists of 40 KLOC of C code.
  • PC4 - PC4 is flight software from an earth orbiting satellite that is currently operational. It consists of 36 KLOC of C code.
  • PC5 - PC5 is a cockpit upgrade that has a series of safety enhancements designed to improve crew situational awareness while reducing flight crew workload, resulting in the execution of more accurate and timely decisions. The upgrades include: improved instrumentation displays, situation monitoring, and trajectory assessments. It consists of 164 KLOC of C++ code.

+ Top

Requirement - A statement of the required functionality of a software component.

+ Top

Requirements/Products Relationship Report - This report lists product ids and any requirement ids that the products are associated to.

+ Top

Severity - This value quantifies the impact of a defect on functionality with 1 being most severe to 5 being least severe. For example, severity 1 generally means that a defect caused an loss of functionality without a workaround where severity 5 generally means that the impact is superficial and did not cause any major disruptions to functionality.

+ Top

SLOC-Count - The actual number of SLOC changed or added.

+ Top

Static Defect Data - The term static defect data applies to defect attributes that do not have associations to specific dates in the repository.

+ Top

Target Products - Target products are products that may have caused a defect or have been changed as a result of a defect. The MDP repository uses the target product data to make a direct association between a defect record and modules. Target product data is typically available in the latter portion of a defect's life cycle (Resolution through Close).

+ Top


Metric value descriptions:

Error Related Metrics:

+ Top

Halstead Metrics:

+ Top

Line of Code Metrics:

+ Top

McCabe Software Metrics:

+ Top

Object Oriented Metrics:

+ Top

Requirement Metrics:

+ Top


+ Freedom of Information Act
+ Budgets, Strategic Plans and Accountability Reports
+ The President's Management Agenda
+ Privacy Policy and Important Notices
+ Inspector General Hotline
+ Equal Employment Opportunity Data Posted Pursuant to the No Fear Act
+ Information-Dissemination Priorities and Inventories
+ USA.gov
+ ExpectMore.gov
NASA
Editor: Jay Long
NASA Official: Lisa Montgomery
Last Updated: June 10, 2008
+ Contact IV&V
+ Contact Tools Lab
+ Metrics Data Program Usage Policy