​"AAP Response"
In order to collect, analyze, track, and report reliability and maintainability failure information (e.g., MTBF, MTBCF, MTTR), recommend you modify the contract (see ref 12) to require the contractor to provide this information for the COTS-based space environmental monitoring system. Here are some recommended steps to consider:
Develop a performance work statement (PWS, ref 15) that requires the contractor to use a Failure Reporting and Corrective Action System (FRACAS, see ref 2) to collect, analyze, and track reliability and maintainability failure information (e.g., MTBF, MTBCF, MTTR). Be specific on what data is required and how it will be measured/calculated (see refs 9 and 13).
The PWS must include a Contract Data Requirements List which requires the contractor to deliver this information in a specific format and when (CDRL, see item 17) along with a Data Item Description (DID, see refs 4 and 17) which addresses the content and data to be included in the deliverable. The Life Cycle Logistician should work closely with the Contracting Officer and Engineer on this.
Alternative: As an alternative to incorporating a specific deliverable into the contract/PWS for delivery of FRACAS reports, you can require the contractor to establish/maintain a Logistics Product Database (e.g., ref 18) which allows the exchange of logistics product data between the contractors' LPD database (i.e., ref 8) and the government's LPD database (i.e., ref 7).
Other:
MIL-HDBK-217F Reliability Prediction of Electronic Equipment (i.e., ref 1) is used to estimate initial baseline reliability predictions for electronic equipment (i.e., COTS). These predictions would later be replaced by actual FRACAS data.
References 10, 16 and 19 provide background information on how to set up a Diminishing Manufacturing Sources and Materiel Shortages (DMSMS) program to manage obsolescence issues which is a major problem with COTS-based systems.
Reference 11 provides information on how to set up a Reliability Growth program to improve system reliability.
1. MIL-HDBK-217F Reliability Prediction of Electronic Equipment is a reference for predicting reliability metrics (i.e., MTBF) for use as a starting point, later to be validated by actual metrics. http://quicksearch.dla.mil/qsDocDetails.aspx?ident_number=207200
2. MIL-HDBK-2155 Failure Reporting and Corrective Action System (FRACAS) which can be provided/referenced in the contract as guidance only for establishment/adherence to a failure data collection, reporting and corrective action system/tool.
3. http://quicksearch.dla.mil/qsDocDetails.aspx?ident_number=53939
4. DID DI-SESS-81315A FAILURE ANALYSIS AND CORRECTIVE ACTION REPORT (SUPERSEDING DI-SESS-81315) which you can purchase for $12 on the ASME site http://www.asmestandard.com/did-di-sess-81315a
5. SAE GEIA-STD-0007 Logistics Product Database (LPD) provides a standard that enables exchange of data from one compliant Logistics Product Database to another compliant Logistics Product database to another http://quicksearch.dla.mil/qsDocDetails.aspx?ident_number=280431
6. SAE website for purchasing GEIA-STD-0007 Logistics Product Data 7. US Army Materiel Command Logistics Support Activity (LOGSA) Tools Suite Link (including the Powerlog Logistics Product Database which is compliant with SAE-GEIA-STD-0007). https://www.dau.mil/tools/t/US-Army-Materiel-Command-Logistics-Support-Activity-(LOGSA)-Tools-Suite
8. SLICWAVE Commercial Tool for Supportability Analysis https://www.isscorp.com/slicwave.html, 1-800-528-9185.
9. Performance Based Logistics Guidebook, Appendix F contains PBL metrics information including MTBF, MTBR, MTBM and MTTR. https://www.dau.mil/guidebooks/Shared%20Documents%20HTML/PBL%20Guidebook.aspx#toc201 or https://shortcut.dau.mil/JST/pbl-guidebook
10. Obsolescence Management ACQuipedia article https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=d3f23881-7a0e-4a3f-83cd-a157e5969666
11. Reliability Growth ACQuipedia article https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=6804019f-5d0a-43ce-b0e6-f6a8801e8616
12. Commercial Contracting ACQuipedia article https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=e9e92f63-bf31-4658-a40c-0361cd06eebf
13. CLE 301 Reliability and Maintainability http://icatalog.dau.mil/onlinecatalog/courses.aspx?crs_id=275
14. Commercial-Off-The-Shelf (COTS) Acquisition for Program Managers http://icatalog.dau.mil/onlinecatalog/courses.aspx?crs_id=304
15. CLM 031 Improved Statement of Work http://icatalog.dau.mil/onlinecatalog/courses.aspx?crs_id=305
16. DMSMS SD-22 Guidebook https://shortcut.dau.mil/JST/dmsms-guidebook
17. Product Support Contract Data Requirements List (CDRL) and Data Item Description (DID) https://www.dau.mil/acquipedia/Pages/ArticleManage.aspx?aid=f98fe36b-d7be-49cd-a8bb-ca6a1e3682a7
18. Logistics Product Data (LPD) https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=6fdf33a2-f344-45d3-9820-76080f359ef9
19. The Government-Industry Data Exchange Program (GIDEP) ACQuipedia Article https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=f1ed1fb9-4cb2-496b-a22e-89ccbcedf775