Skip Ribbon Commands
Skip to main content
 
Menu

Operating Status

FULLY OPERATIONAL   

OPERATING STATUS

FULLY OPERATIONAL  

Acquisition
Community
Connection

Contribute

 

Browse by Subject

 

Browse by Category

Contribute

  

Subject

  

Category
      

Skip Navigation LinksTopic

Started: 5/18/2018 11:54 AM
Picture: JILL GARCIA
JILL GARCIA
Best way to track failure rates for COTS product (AAP)

What is the best way to track maintenance related data (i.e. MTBF, MTBCF, MTTR, etc.) for a COTS product? Is there a class for this?

Background: I work on a space environmental monitoring system that is 100% COTS. The system is fielded and maintained by a contractor and they do not currently track failure rates of the system. There are other users of this COTS product but it is a very specialized piece of equipment and there is no maintenance data available on the internet or from the manufacturer for things like MTBF, MTBCF, MTTR, etc... I would like to start tracking this data but I'm not sure how to go about it.


Picture: JILL GARCIA
  • JILL GARCIA
http://myad.dau.mil:80/User%20Photos/Profile%20Pictures/jgarcia_MThumb.jpg?t=63617952036" alt="Picture: JILL GARCIA" />
JILL GARCIA

What is the best way to track maintenance related data (i.e. MTBF, MTBCF, MTTR, etc.) for a COTS product? Is there a class for this?

Background: I work on a space environmental monitoring system that is 100% COTS. The system is fielded and maintained by a contractor and they do not currently track failure rates of the system. There are other users of this COTS product but it is a very specialized piece of equipment and there is no maintenance data available on the internet or from the manufacturer for things like MTBF, MTBCF, MTTR, etc... I would like to start tracking this data but I'm not sure how to go about it.


15/18/2018 11:54 AM5/18/2018 11:54 AMNoAsk the Community
26.4269705830397
10/12/2004 6:10 PM
Posted: 5/21/2018 1:42 PM
Picture Placeholder: KARREN CARRUTHERS
KARREN CARRUTHERS

​"AAP Response" 

In order to collect, analyze, track, and report reliability and maintainability failure information (e.g., MTBF, MTBCF, MTTR), recommend you modify the contract (see ref 12) to require the contractor to provide this information for the COTS-based space environmental monitoring system.  Here are some recommended steps to consider:

 

 Develop a performance work statement (PWS, ref 15) that requires the contractor to use a Failure Reporting and Corrective Action System (FRACAS, see ref 2) to collect, analyze, and track reliability and maintainability failure information (e.g., MTBF, MTBCF, MTTR).  Be specific on what data is required and how it will be measured/calculated (see refs 9 and 13). 

 

 The PWS must include a Contract Data Requirements List which requires the contractor to deliver this information in a specific format and when (CDRL, see item 17) along with a Data Item Description (DID, see refs 4 and 17) which addresses the content and data to be included in the deliverable. The Life Cycle Logistician should work closely with the Contracting Officer and Engineer on this.

 

Alternative: As an alternative to incorporating a specific deliverable into the contract/PWS for delivery of FRACAS reports, you can require the contractor to establish/maintain a Logistics Product Database (e.g., ref 18) which allows the exchange of logistics product data between the contractors' LPD database (i.e., ref 8) and the government's LPD database (i.e., ref 7).

 

 Other:

MIL-HDBK-217F Reliability Prediction of Electronic Equipment (i.e., ref 1) is used to estimate initial baseline reliability predictions for electronic equipment (i.e., COTS).  These predictions would later be replaced by actual FRACAS data.

 

References 10, 16 and 19 provide background information on how to set up a Diminishing Manufacturing Sources and Materiel Shortages (DMSMS) program to manage obsolescence issues which is a major problem with COTS-based systems.

 

Reference 11 provides information on how to set up a Reliability Growth program to improve system reliability.

 

1.  MIL-HDBK-217F Reliability Prediction of Electronic Equipment is a reference for predicting reliability metrics (i.e., MTBF) for use as a starting point, later to be validated by actual metrics. http://quicksearch.dla.mil/qsDocDetails.aspx?ident_number=207200

2.  MIL-HDBK-2155 Failure Reporting and Corrective Action System (FRACAS) which can be provided/referenced in the contract as guidance only for establishment/adherence to a failure data collection, reporting  and corrective action system/tool.

3.  http://quicksearch.dla.mil/qsDocDetails.aspx?ident_number=53939

4.  DID DI-SESS-81315A FAILURE ANALYSIS AND CORRECTIVE ACTION REPORT (SUPERSEDING DI-SESS-81315) which you can purchase for $12 on the ASME site http://www.asmestandard.com/did-di-sess-81315a

5.  SAE GEIA-STD-0007 Logistics Product Database (LPD) provides a standard that enables exchange of data from one compliant Logistics Product Database to another compliant Logistics Product database to another http://quicksearch.dla.mil/qsDocDetails.aspx?ident_number=280431

6.  SAE website for purchasing GEIA-STD-0007 Logistics Product Data 7.  US Army Materiel Command Logistics Support Activity (LOGSA) Tools Suite Link (including the Powerlog Logistics Product Database which is compliant with SAE-GEIA-STD-0007). https://www.dau.mil/tools/t/US-Army-Materiel-Command-Logistics-Support-Activity-(LOGSA)-Tools-Suite

8.  SLICWAVE Commercial Tool for Supportability Analysis https://www.isscorp.com/slicwave.html, 1-800-528-9185.

9.  Performance Based Logistics Guidebook, Appendix F contains PBL metrics information including MTBF, MTBR, MTBM and MTTR. https://www.dau.mil/guidebooks/Shared%20Documents%20HTML/PBL%20Guidebook.aspx#toc201 or https://shortcut.dau.mil/JST/pbl-guidebook

10.  Obsolescence Management ACQuipedia article https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=d3f23881-7a0e-4a3f-83cd-a157e5969666

11.  Reliability Growth ACQuipedia article https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=6804019f-5d0a-43ce-b0e6-f6a8801e8616

12.  Commercial Contracting ACQuipedia article https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=e9e92f63-bf31-4658-a40c-0361cd06eebf

13.  CLE 301 Reliability and Maintainability http://icatalog.dau.mil/onlinecatalog/courses.aspx?crs_id=275

14.  Commercial-Off-The-Shelf (COTS) Acquisition for Program Managers http://icatalog.dau.mil/onlinecatalog/courses.aspx?crs_id=304

 15.  CLM 031 Improved Statement of Work http://icatalog.dau.mil/onlinecatalog/courses.aspx?crs_id=305

 16.  DMSMS SD-22 Guidebook  https://shortcut.dau.mil/JST/dmsms-guidebook

 17.  Product Support Contract Data Requirements List (CDRL) and Data Item Description (DID) https://www.dau.mil/acquipedia/Pages/ArticleManage.aspx?aid=f98fe36b-d7be-49cd-a8bb-ca6a1e3682a7

 18.  Logistics Product Data (LPD) https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=6fdf33a2-f344-45d3-9820-76080f359ef9

 19.  The Government-Industry Data Exchange Program (GIDEP) ACQuipedia Article https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=f1ed1fb9-4cb2-496b-a22e-89ccbcedf775

 

Picture Placeholder: KARREN CARRUTHERS
  • KARREN CARRUTHERS
/_layouts/15/images/person.gif" alt="Picture Placeholder: KARREN CARRUTHERS" />
KARREN CARRUTHERS

​"AAP Response" 

In order to collect, analyze, track, and report reliability and maintainability failure information (e.g., MTBF, MTBCF, MTTR), recommend you modify the contract (see ref 12) to require the contractor to provide this information for the COTS-based space environmental monitoring system.  Here are some recommended steps to consider:

 

 Develop a performance work statement (PWS, ref 15) that requires the contractor to use a Failure Reporting and Corrective Action System (FRACAS, see ref 2) to collect, analyze, and track reliability and maintainability failure information (e.g., MTBF, MTBCF, MTTR).  Be specific on what data is required and how it will be measured/calculated (see refs 9 and 13). 

 

 The PWS must include a Contract Data Requirements List which requires the contractor to deliver this information in a specific format and when (CDRL, see item 17) along with a Data Item Description (DID, see refs 4 and 17) which addresses the content and data to be included in the deliverable. The Life Cycle Logistician should work closely with the Contracting Officer and Engineer on this.

 

Alternative: As an alternative to incorporating a specific deliverable into the contract/PWS for delivery of FRACAS reports, you can require the contractor to establish/maintain a Logistics Product Database (e.g., ref 18) which allows the exchange of logistics product data between the contractors' LPD database (i.e., ref 8) and the government's LPD database (i.e., ref 7).

 

 Other:

MIL-HDBK-217F Reliability Prediction of Electronic Equipment (i.e., ref 1) is used to estimate initial baseline reliability predictions for electronic equipment (i.e., COTS).  These predictions would later be replaced by actual FRACAS data.

 

References 10, 16 and 19 provide background information on how to set up a Diminishing Manufacturing Sources and Materiel Shortages (DMSMS) program to manage obsolescence issues which is a major problem with COTS-based systems.

 

Reference 11 provides information on how to set up a Reliability Growth program to improve system reliability.

 

1.  MIL-HDBK-217F Reliability Prediction of Electronic Equipment is a reference for predicting reliability metrics (i.e., MTBF) for use as a starting point, later to be validated by actual metrics. http://quicksearch.dla.mil/qsDocDetails.aspx?ident_number=207200

2.  MIL-HDBK-2155 Failure Reporting and Corrective Action System (FRACAS) which can be provided/referenced in the contract as guidance only for establishment/adherence to a failure data collection, reporting  and corrective action system/tool.

3.  http://quicksearch.dla.mil/qsDocDetails.aspx?ident_number=53939

4.  DID DI-SESS-81315A FAILURE ANALYSIS AND CORRECTIVE ACTION REPORT (SUPERSEDING DI-SESS-81315) which you can purchase for $12 on the ASME site http://www.asmestandard.com/did-di-sess-81315a

5.  SAE GEIA-STD-0007 Logistics Product Database (LPD) provides a standard that enables exchange of data from one compliant Logistics Product Database to another compliant Logistics Product database to another http://quicksearch.dla.mil/qsDocDetails.aspx?ident_number=280431

6.  SAE website for purchasing GEIA-STD-0007 Logistics Product Data 7.  US Army Materiel Command Logistics Support Activity (LOGSA) Tools Suite Link (including the Powerlog Logistics Product Database which is compliant with SAE-GEIA-STD-0007). https://www.dau.mil/tools/t/US-Army-Materiel-Command-Logistics-Support-Activity-(LOGSA)-Tools-Suite

8.  SLICWAVE Commercial Tool for Supportability Analysis https://www.isscorp.com/slicwave.html, 1-800-528-9185.

9.  Performance Based Logistics Guidebook, Appendix F contains PBL metrics information including MTBF, MTBR, MTBM and MTTR. https://www.dau.mil/guidebooks/Shared%20Documents%20HTML/PBL%20Guidebook.aspx#toc201 or https://shortcut.dau.mil/JST/pbl-guidebook

10.  Obsolescence Management ACQuipedia article https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=d3f23881-7a0e-4a3f-83cd-a157e5969666

11.  Reliability Growth ACQuipedia article https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=6804019f-5d0a-43ce-b0e6-f6a8801e8616

12.  Commercial Contracting ACQuipedia article https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=e9e92f63-bf31-4658-a40c-0361cd06eebf

13.  CLE 301 Reliability and Maintainability http://icatalog.dau.mil/onlinecatalog/courses.aspx?crs_id=275

14.  Commercial-Off-The-Shelf (COTS) Acquisition for Program Managers http://icatalog.dau.mil/onlinecatalog/courses.aspx?crs_id=304

 15.  CLM 031 Improved Statement of Work http://icatalog.dau.mil/onlinecatalog/courses.aspx?crs_id=305

 16.  DMSMS SD-22 Guidebook  https://shortcut.dau.mil/JST/dmsms-guidebook

 17.  Product Support Contract Data Requirements List (CDRL) and Data Item Description (DID) https://www.dau.mil/acquipedia/Pages/ArticleManage.aspx?aid=f98fe36b-d7be-49cd-a8bb-ca6a1e3682a7

 18.  Logistics Product Data (LPD) https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=6fdf33a2-f344-45d3-9820-76080f359ef9

 19.  The Government-Industry Data Exchange Program (GIDEP) ACQuipedia Article https://www.dau.mil/acquipedia/Pages/ArticleDetails.aspx?aid=f1ed1fb9-4cb2-496b-a22e-89ccbcedf775

 

JILL GARCIA4405/21/2018 1:42 PM5/21/2018 1:42 PM

 
false,false,2
Bot Image