Software Quality Assurance (SQA) | COG: A High Fidelity Multi-Particle Transport Code

Table I. SQA Elements and Corresponding Documents

SQA Element	SQA Documents
1. Software Project Management and Quality Planning	COG Software Quality Assurance Plan, CSAM15-049, Rev. 1 COG Software Safety Plan Checklist, CSAM11-030
2. Software Risk Management	COG Risk Consequence Report COG Process/Development Environment Risk Report
3. Software Configuration Management	COG Software Configuration Management Plan, CSAM15-046, Rev. 1 Safety Software Verification and Validation, CS-P-005
4. Procurement and Supplier Management	Memorandum of Record License (use) agreements (LLNL, NEA, RSICC, etc.)
5. Software Requirements Identification Management	Software Requirements Specification for COG11.1, CSAM11-126, Rev. 1 COG Strategic (R&D) Plan, CSAM 20-010 Identification, Documentation, Control, and Maintenance of 830 Software Inventory, PRO-0110 Application for Inclusion on the LLNL 830 Software Inventory Websites, FRM-3127 COG11.1 Software Package for RSICC Distribution, CSAM15-034 LLNL 830 Software Inventory
6. Software Design and Implementation	COG Software Architecture Design Description Document, LLNL-TR-652073
7. Software Safety	Assessment Report for Lawrence Livermore National Laboratory COG Software Quality Assurance, LLNL-AR-480798 Other software qualified for use (MCNP, SCALE) Other R&D software (MERCURY, TART, VIM)
8. Verification and Validation	Software Verification and Validation Plan (SVVP), CSAM 19-042 Safety Software Verification and Validation, CS-P-005 Test, Verification, and Validation Suites (see Table II) Installation Verification Summary, FRM-3128, for LOON and TODY Major Revision/Update Qualification Package Checklist (Major DC), ISQA-FRM-014-Rev1 Validation records for LOON (HEU, PU)
9. Problem Reporting and Corrective Action	SQA Gap Analysis for COG, CSAM14-083 Closure of SQA Gaps for COG, MCNP and SCALE, CSAM15-055 Issues Tracking System (ITS) Software Change Request Form, CS-P-005, App. A Software Error/Corrective Action Report Form, CS-P-005, App. B
10. Training of Personnel in the Design, Development, Use and Evaluation of Safety Software	http://cog.llnl.gov Training and Qualification, CS-P-006 NCSD Computer Platforms, CSG-TM-002 COG Software, CSG-TM-016 Software Quality Assurance Awareness, CA0750-W 830 Software Quality Engineering Practices, CA0760 Software Risk Grading, CA0780 Fundamentals of Software Licensing, XG5008 COG10 Manual COG11 Manual Supplement COG11.1 Manual Supplement
11. Model Validation and Evaluation	Three Analytic Benchmarks in COG, LLNL-TR-648225 Alpha Transport in COG, LLNL-TR-655365 Delayed Fission Gammas, LLNL-PRES-470895 Photonuclear Benchmarks with a Comparison of COG and MCNPX Results, UCRL-CONF-200552 Thermal Scattering Law Data: Implementation and Testing Using the Monte Carlo Neutron Transport Code COG, MCNP and TART, UCRL-ID-153656

Table II. Test, Verification, and Validation Suites

Test, Verification, or Validation Suite	Type	Number of Cases	Documentation
Regression tests	Test	11 cases
NRF tests	Test	3 cases
Analytic benchmarks	Verification	107 cases	LLNL-TR-648225
β-eff benchmarks	Validation	32 cases	LLNL-TR-843852
SINBAD shielding benchmarks	Validation	9 cases	UCRL-TR-202654
Baikal-1 skyshine experiment	Validation	3 cases	LLNL-TR-843853
Bramblett and Czirr Self-Shielded Fission Rates or ²³⁵U: Physical and Analytic Benchmark	Validation	6 cases	LLNL-TR-851689
KSU Co-60 silo skyshine shielding benchmarks	Validation	27 cases	LLNL-TR-838835
KSU Cs-137 air-over-ground/concrete shielding benchmarks	Validation	9 cases	LLNL-TR-838615
SILENE activation benchmarks Unreflected Reflected by Cd-lined CH2 Reflected by Pb	Validation	11 cases	ORNL/TM-2015/426 Rev. 1 ORNL/TM-2016/317 ORNL/TM-2016/316
Photonuclear benchmarks	Validation	16 cases	UCRL-CONF-200552
²⁵²Cf spectrum average cross sections and spectral indices	Validation	16 cases 11 cases	LLNL-TR-836050
BR-1 reactor spectral indices benchmarks	Validation	38 cases	LLNL-TR-838379
Spectral Indices Benchmarks for Nine Los Alamos Fast Critical Assemblies	Validation	60 cases	LLNL-TR-839692
ICSBEP criticality benchmarks	Validation	3,395 cases	LLNL-CONF-838004 LLNL-MI-838253