U.S. flag

An official website of the United States government

Dot gov

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Https

Secure .gov websites use HTTPS
A lock () or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Breadcrumb

  1. Home
  2. Communities of Practice
  3. Test and Evaluation Community
CommentCommunity

Test and Evaluation Community

Welcome to the Test & Evaluation (T&E) Community of Practice. T&E is the process by which a system or components are exercised and results analyzed to provide performance-related information. The purpose of this site is simple - to provide T&E practitioners with up to date T&E policy and guidance information as issued by the Department of Defense and Components. Users will find information on general policy for Developmental T&E and Operational T&E, as well as more specific T&E topics such as cybersecurity, reliability, and interoperability. The site also points users to sources of T&E training and certification.

34
Members

Views

Community Contacts

No content available.

Feed / Test and Evaluation Community

OSD T&E discuss cyber T&E policy and guidance
0 Replies
View Discussion

Cyber T&E policy and guidance are being modernized to keep pace with the U.S. Department of Defense (DoD) acquisition objectives. This webinar training will provide a brief introduction to the DoD’s iterative cyber T&E approach superseding the six phases. It covers the following topics: Iterative Cyber T&E Methodology, Cyber T&E Strategy and the Integrated Decision Support Key (IDSK) Activities for Scoping Iterative Cyber T&E, Cyber Requirements, Mission-Based Cyber Risk Assessments, Threat Characterization, Attack Surface Characterization, and Using Cyber T&E Security Verification, Cooperative, and Adversarial Testing.

https://www.youtube.com/embed/vj5Yi5eGUK8

What the heck is going on here?
2 Replies
View Discussion

Has anyone else noticed the horrible quality of the courses? Many of the exam questions are not filled in (one or two answers are simply "distractor"), there are spelling and grammar errors on almost every slide, and my personal favorite: one of the examples did not make sense, I looked it up; IT IS A COPY AND PASTE OF A CAPTION OF A STOCK PHOTO!!!

I don't know who writes these courses, but they are obviously not proof-read before release.

Does anyone know who I can contact about errata in the courses?

DT Adequacy
0 Replies
View Discussion

 

Question 1:  Who/what organization provides the DT sufficiency assessment?

 

Question 2: In my situation, does ATEC provide the DT sufficiency evaluation?

I am working on a program (UIPE FoS GP) as the Chief Developmental Tester which has been recently upgraded from ACAT II to ACAT 1C and is on the DOT&E Oversight list and is approaching a Milestone C Decision Review.  The Honorable Douglas R. Bush  (Assistant Secretary of the Army for Acquisition, Logistics and Technology)  is the MDA.  

 

it appears the DoD I 5000.89 identifies the process for MDAPs as well as those programs on DOT&E oversight.

While UIPE FoS GP is not a “MDAP” it is on DOT&E oversight so it meets 1 of the criteria within DoD I 5000.89. 

Per below extract from DoD I 5000.89, the senior official within the Army w/ responsibility for DT provides the DT&E sufficiency assessment when the MDA is the CAE/AAE. 

SECTION 5.3 

(2) DT&E Sufficiency Assessments.

In accordance with Sections 2366b(c)(l) and 2366c(a)(4) of Title 10, U.S.C., when the USD(A&S) is the MDA, the USD(R&E) will conduct DT&E sufficiency assessments for MDAPs to be included in MS B and MS C brief summary reports provided to the congressional defense committees. When the Service or the Component acquisition executive is the MDA, the senior official within the Military Department, Defense Agency, or DoD Field Activity with responsibility for DT will conduct DT&E sufficiency assessments for MDAPs to be included in

MS B and MS C brief summary reports provided to the congressional defense committees.

The Adaptive Acquisition Framework Document Identification (AAFDID) tool also states that the Component DT&E Official for ACAT 1B / 1C programs is the approval authority for DT&E sufficiency assessments.

Also I found the DT&E sufficiency assessment for the Army’s Mobile Protected Firepower Vehicle (MPFV), an ACAT 1B, and US Army Evaluation Command signed its DT&E sufficiency assessment at MS C.  Mr. Barrett actually signed it.

GOTS Software
0 Replies
View Discussion

My team is about to go TRL 7/operational with our GOTS product.  We are conducting an acceptance test as part of a TEMP but would like feedback on what other discussions and artifacts are important considerations prior to an Operational Test Readiness Review.  Are there other acquisition items that can aid our team in a successful launch that we can use the MCA Lifecycle Chart for?

Discussions / Test and Evaluation Community

OSD T&E discuss cyber T&E policy and guidance
0 Replies
View Discussion
February 26, 2024 - 02:49pm
QUESTION

Cyber T&E policy and guidance are being modernized to keep pace with the U.S. Department of Defense (DoD) acquisition objectives. This webinar training will provide a brief introduction to the DoD’s iterative cyber T&E approach superseding the six phases. It covers the following topics: Iterative Cyber T&E Methodology, Cyber T&E Strategy and the Integrated Decision Support Key (IDSK) Activities for Scoping Iterative Cyber T&E, Cyber Requirements, Mission-Based Cyber Risk Assessments, Threat Characterization, Attack Surface Characterization, and Using Cyber T&E Security Verification, Cooperative, and Adversarial Testing.

https://www.youtube.com/embed/vj5Yi5eGUK8

SCENARIO
COMMENTS
What the heck is going on here?
2 Replies
View Discussion
December 19, 2023 - 04:47pm
QUESTION

Has anyone else noticed the horrible quality of the courses? Many of the exam questions are not filled in (one or two answers are simply "distractor"), there are spelling and grammar errors on almost every slide, and my personal favorite: one of the examples did not make sense, I looked it up; IT IS A COPY AND PASTE OF A CAPTION OF A STOCK PHOTO!!!

I don't know who writes these courses, but they are obviously not proof-read before release.

Does anyone know who I can contact about errata in the courses?

SCENARIO
COMMENTS
Swinney, David February 7, 2024 - 07:40pm

Not sure which course is the buggy one, but I can get you to the right person.

Respond here, or contact me david.swinney at dau.edu

Anderson, Larr… February 14, 2024 - 03:23pm

Hello,

I encountered the same issues in various courses.  My solution is to create a comment resolution matrix (CMR) and then submit it to the the DAU Course representation.  I received a response that adjudicated elements would be addresses during the next course update.

DT Adequacy
0 Replies
View Discussion
October 25, 2023 - 03:16pm
QUESTION

 

Question 1:  Who/what organization provides the DT sufficiency assessment?

 

Question 2: In my situation, does ATEC provide the DT sufficiency evaluation?

SCENARIO

I am working on a program (UIPE FoS GP) as the Chief Developmental Tester which has been recently upgraded from ACAT II to ACAT 1C and is on the DOT&E Oversight list and is approaching a Milestone C Decision Review.  The Honorable Douglas R. Bush  (Assistant Secretary of the Army for Acquisition, Logistics and Technology)  is the MDA.  

 

it appears the DoD I 5000.89 identifies the process for MDAPs as well as those programs on DOT&E oversight.

While UIPE FoS GP is not a “MDAP” it is on DOT&E oversight so it meets 1 of the criteria within DoD I 5000.89. 

Per below extract from DoD I 5000.89, the senior official within the Army w/ responsibility for DT provides the DT&E sufficiency assessment when the MDA is the CAE/AAE. 

SECTION 5.3 

(2) DT&E Sufficiency Assessments.

In accordance with Sections 2366b(c)(l) and 2366c(a)(4) of Title 10, U.S.C., when the USD(A&S) is the MDA, the USD(R&E) will conduct DT&E sufficiency assessments for MDAPs to be included in MS B and MS C brief summary reports provided to the congressional defense committees. When the Service or the Component acquisition executive is the MDA, the senior official within the Military Department, Defense Agency, or DoD Field Activity with responsibility for DT will conduct DT&E sufficiency assessments for MDAPs to be included in

MS B and MS C brief summary reports provided to the congressional defense committees.

The Adaptive Acquisition Framework Document Identification (AAFDID) tool also states that the Component DT&E Official for ACAT 1B / 1C programs is the approval authority for DT&E sufficiency assessments.

Also I found the DT&E sufficiency assessment for the Army’s Mobile Protected Firepower Vehicle (MPFV), an ACAT 1B, and US Army Evaluation Command signed its DT&E sufficiency assessment at MS C.  Mr. Barrett actually signed it.

COMMENTS
GOTS Software
0 Replies
View Discussion
October 23, 2023 - 06:32pm
QUESTION

My team is about to go TRL 7/operational with our GOTS product.  We are conducting an acceptance test as part of a TEMP but would like feedback on what other discussions and artifacts are important considerations prior to an Operational Test Readiness Review.  Are there other acquisition items that can aid our team in a successful launch that we can use the MCA Lifecycle Chart for?

SCENARIO
COMMENTS
Digital Engineering and T&E Connect the Dots Workshop June 27-29,2023
0 Replies
View Discussion
May 15, 2023 - 03:03pm
QUESTION

​https://sites.mitre.org/connect-the-dots/

Sponsored by OUSD(R&E) DTE&A a view into the future of  T&E supported by digital engineering, aligned to the capability lifecycle and show how each program's work fits into the larger digital engineering practice. 

Register to attend virtually, or in-person at the Institue of Defense Analysis (IDA) Alexandria, VA.







SCENARIO
COMMENTS
Human Systems Integration (HSI) is a key enabler to executing T&E processes
0 Replies
View Discussion
July 22, 2022 - 06:28pm
QUESTION


Integrating human performance considerations into the defense acquisition system can present substantial challenges for Human Systems Integration (HSI) practitioners and stakeholders. 

The DAU HSI Community of Practice (CoP) provides a unique resource in this pursuit, offering a convenient platform to share knowledge aimed at achieving effective and relevant HSI practice across government, industry, and academia. 

Learn more about HSI as a Specialty Engineering discipline (described within DODI 5000.88) and for incorporating human needs during test and evaluation per DODI 5000.89 at the following resources:

DAU HSI COP

OUSD(R&E) HSI website:


SCENARIO
COMMENTS
EMI Testing
1 Replies
View Discussion
February 3, 2022 - 10:28am
QUESTION

​Hello, my product has a requirement to test against MIL-STD-461 and 464.  Does anyone know where I can download a copy of each of these Mil standards.  Thank you.

SCENARIO
COMMENTS
Content Author… July 5, 2022 - 09:58pm

The ASSIST website is the authoritative source for Military standards and specifications.

MIL STD 461 - https://quicksearch.dla.mil/qsDocDetails.aspx?ident_number=35789

MIL STD 464 -https://quicksearch.dla.mil/qsDocDetails.aspx?ident_number=35794

Events / Test and Evaluation Community

No content available.

Announcements / Test and Evaluation Community

Community Announcement / Test and Evaluation Community
Welcome!
View Announcement

Welcome to the new DAU T&E Community! We hope you find this site useful and we welcome your input to making it better. Our primary focus at this time is policy and workforce, but please feel free to suggest topics that would be of interest to the greater Acquisition T&E community​

Resources / Test and Evaluation Community

Community Resource / Test and Evaluation Community
TEWF_Policy

klipartz.com (2).png​Test & Evaluation Policy & Guidance

CREATED:
BY:
Content Author No Reply
LAST MODIFIED:
BY:
Content Author No Reply
View Resource
Community Resource / Test and Evaluation Community
T&E Workforce

Defense Acquisition Workforce Improvement Act (DAWIA)

The Defense Acquisition Workforce Improvement Act (1990) requires the Department of Defense to establish education and training standards, requirements, and courses for the civilian and military workforce. Statutory language covering the Defense Acquisition Workforce is contained in United States Code (USC), Title 10, Chapter 87.

T&E Certification Standards

The links below connect to the DAU Certification Standards (the acquisition training, functional training, education requirements, and experience required for DAWIA certification)  and Core Plus Development (desired training, education, and experience) pages.

T&E Competency Model

T&E Courses

Defense Acquisition Career Management

Key Leadership Positions (KLPs)

Major Defense Acquisition Programs (MDAP) and Major Automated Information System (MAIS) (Acquisition Category (ACAT) I and lA) programs are required to fill selected positions (KLPs) with properly qualified members of the Armed Forces or full-time employees of the Department of Defense (DoD).  KLPs have tenure obligations, require Defense Acquisition Corps membership, and Level III Certification.  KLPs are filled by O-5/O-6 military personnel or GS-14/15 (or higher) civilian personnel.  The Chief Developmental Tester (CDT) is the program T&E position designated as a KLP.

The T&E KLP Qualification Board is chaired by the DASD(DT&E).  Test and Evaluation Executives from the Services and Defense Agencies will evaluate each KLP Qualification Board applicant and determine whether the candidate is deemed qualified to serve in a KLP as a CDT.  Applicants must meet the minimum education, training, and experience requirements set forth by the OUSD(AT&L) memo, Key Leadership Positions and Qualification Criteria, November 8. 2013.  Additionally, applicants must meet CDT Specific Functional Requirements.  Although, candidates may be deemed qualified by the board, it does not approve personnel for particular positions nor guarantee job placement; rather it creates a pool of qualified personnel for Acquisition leadership to consider in talent management and succession planning.

The call for applications is typically made in August and the board convenes in December.  Contact your Defense Acquisition Career Management (DACM) office if you are interested in applying.

Additional KLP information can be found on the DoD Human Capital Initiatives website - HCI.mil

Navy Total Training Catalog

CREATED:
BY:
Content Author No Reply
LAST MODIFIED:
BY:
Content Author No Reply
View Resource
Community Resource / Test and Evaluation Community
Test and Evaluation Resources

Resource ManagementTest Resource Management Center (TRMC)

The Test Resource Management Center is responsible for maintaining the MRTFB.

 This includes:

  • T&E Range Oversight
  • T&E Science and Technology Development Program 
  • Test Capabilities Development: Central Test & Evaluation Investment Program (CTEIP)
  • Interoperability: Joint Mission Environment Test Capability (JMETC)
  • The National Cyber Range (NCR)

 MRTFB

Air Force ​Army ​Navy ​Other
​Western Range (30th Space Wing) Aberdeen Test Center Naval Undersea Warfare Center (NUWC) - Newport JITC

Eastern Range (45th Space Wing)

​​Electronic Proving Ground Naval Undersea Warfare Center (NUWC) - Keyport
​96th Test Wing Reagan Test Site, Kwajalein Atoll ​Naval Air Warfare Center-Aircraft Division, Patuxent River
412th Test Wing West Desert Test Center Naval Air Warfare Center-Weapons Division, China Lake and Point Mugu
​Arnold Engineering Development Center ​White Sands Test Center Pacific Missile Range Facility
Nevada Test and Training Range Yuma Proving Ground (Yuma Test Center, Tropics Regions Test Center, Cold Regions Test Center)
Utah Test and Training Range

 

T&E Executive Board of Directors

The T&E Executive Board of Directors (BOD) mission is to:

  1. Provide corporate recommendations on T&E infrastructure management, standards, policy, configuration and investments or divestments that affect more than one Military Service or Defense Agency.
  2. Manage the T&E Reliance Process, established in 1994, to ensure cost effective investments are made at test facilities and ranges best suited to support required customer testing requirements without regard to Military Service or Defense Agency ownership.
  3. Provide a T&E Executive level forum for the discussion of any issues that affect the T&E capability of more than one Military Service or Defense Agency.

Scientific Test & Analysis Techniques (STAT)

STAT Center of Excellence (Air Force Institute of Technology) - The Center of Excellence works with acquisition program managers and the program's Chief Developmental Tester to improve test effectiveness and ensure efficient use of scarce resources. Utilizing a combination of rigorous scientific methods and lessons learned, the COE determines where test designs can be improved and efficiencies gained, and then applies this knowledge to the program's T& E strategy development.

CREATED:
BY:
Content Author No Reply
LAST MODIFIED:
BY:
Content Author No Reply
View Resource
Community Resource / Test and Evaluation Community
TEWF_Training

klipartz.com.pngTest and Evaluation Training Links and Information

CREATED:
BY:
Content Author No Reply
LAST MODIFIED:
BY:
Content Author No Reply
View Resource
Community Resource / Test and Evaluation Community
Policies
View Resource
Community Resource / Test and Evaluation Community
Test and Evaluation Community Homepage
View Resource
Community Resource / Test and Evaluation Community
Education and Training
View Resource
Community Resource / Test and Evaluation Community
Communities

pngwave (24).png Communities of Practice (CoP): Connect; Share; Learn. 

Here is a list of other communities of practice that are related to the Test & Evaluation field. You can share your knowledge across the acquisition workforce in these other communities, as well as let them know this one is here!

Let's collaborate!


CREATED:
BY:
Content Author No Reply
LAST MODIFIED:
BY:
Content Author No Reply
View Resource

Documents / Test and Evaluation Community

Air Force T&E Guidebook
Document Type:
Document
Modified: Changed by Content Author No Reply on
Summary

This document contains guidance, best practices, and lessons learned relevant to Air Force test and evaluation (T&E). It is a “living” guide that reflects information compiled from many sources based on most recent collective test community experiences. Although this guide supplements and expands on HQ USAF/TE policy, is not directive nor prescriptive in nature. It mirrors AFI 99-103’s broad applicability across multiple areas and complements policies and best practices encompassing a range of test communities and functions.

Cybersecurity Test and Evaluation Guidebook, Version 2, Change 1
Document Type:
Document
Modified: Changed by Content Author No Reply on
Summary

Update to Version 2 (6 Feb 2020)

Cybersecurity Test and Evaluation of Department of Defense Systems Hosted on Commercial Cloud Service Offerings (Dec 2019)
Document Type:
Document
Modified: Changed by Content Author No Reply on
Summary

Guidance for Cybersecurity T&E of DoD Systems Hosted on Commercial Cloud Service Offerings

Cybersecurity T&E Overview
Document Type:
Document
Modified: Changed by Content Author No Reply on
Summary

Provides guidance for conducting Cybersecurity DT&E and OT&E. Includes information on the TEMP and DEF.

DoD Cyber Table Top Guidebook v1
Document Type:
Document
Modified: Changed by Content Author No Reply on
Summary

This document explains to PMs, testers, and engineers how to conduct a Cyber Table Top exercise.

Interoperability T&E Overview
Document Type:
Document
Modified: Changed by Content Author No Reply on
Summary

Primer on Interoperability T&E practices.

T&E Acquisition Workforce Competency Model
Document Type:
Document
Modified: Changed by Content Author No Reply on
Summary

Provides a listing of the compentencies that the T&E Acquisition Workforce should possess.

Incorporating TE into DoD Acquisition Contracts Guidebook
Document Type:
Document
Modified: Changed by Content Author No Reply on
Summary

This guide is designed to help the Department of Defense (DoD) and industry test and evaluation (T&E) professionals identify T&E items to consider for inclusion when drafting a statement of objectives (SOO), a statement of work (SOW), and a request for proposal (RFP), and during solicitation and contract execution.

To participate in this community, you must be registered. Join Now