Software Test & Evaluation Specialist

Work Role ID: 673  |  Workforce Element: Software Engineering

What does this work role do? Plans, prepares, and performs testing, evaluation, verification, and validation of software to evaluate results against specifications, requirements, and operational need.

CORE KSATs
KSAT ID Description KSAT
22 * Knowledge of computer networking concepts and protocols, and network security methodologies. Knowledge
108 * Knowledge of risk management processes (e.g., methods for assessing and mitigating risk). Knowledge
1157 * Knowledge of national and international laws, regulations, policies, and ethics as they relate to cybersecurity. Knowledge
1158 * Knowledge of cybersecurity principles. Knowledge
1159 * Knowledge of cyber threats and vulnerabilities. Knowledge
6900 * Knowledge of specific operational impacts of cybersecurity lapses. Knowledge
6935 * Knowledge of cloud computing service models Software as a Service (SaaS), Infrastructure as a Service (IaaS), and Platform as a Service (PaaS). Knowledge
6938 * Knowledge of cloud computing deployment models in private, public, and hybrid environment and the difference between on-premises and off-premises environments. Knowledge
ADDITIONAL KSATs
KSAT ID Description KSAT
16 Knowledge of capabilities and requirements analysis. Knowledge
40 Knowledge of organization’s evaluation and validation requirements. Knowledge
53 Knowledge of the Security Assessment and Authorization process. Knowledge
81A Knowledge of network protocols such as TCP/IP, Dynamic Host Configuration, Domain Name System (DNS), and directory services. Knowledge
83 Knowledge of network hardware devices and functions. Knowledge
130 Knowledge of systems testing and evaluation methods. Knowledge
130A Knowledge of systems security testing and evaluation methods. Knowledge
144 Knowledge of the systems engineering process. Knowledge
169 Skill in conducting test events. Skill
176 Skill in designing a data analysis structure (i.e., the types of data your test must generate and how to analyze those data). Skill
182 Skill in determining an appropriate level of test rigor for a given system. Skill
190 Skill in developing operations-based testing scenarios. Skill
220 Skill in systems integration testing. Skill
238A Skill in writing code in a currently supported programming language (e.g., Java, C++). Skill
239 Skill in writing test plans. Skill
393A Administer test bed(s), and test and evaluate applications, hardware infrastructure, rules/signatures, access controls, and configurations of platforms managed by service provider(s). Task
412A Analyze the results of software, hardware, or interoperability testing. Task
414 Analyze user needs and software requirements to determine feasibility of design within time and cost constraints. Task
431A Build, assess, and modify product prototypes using working models or theoretical models. Task
452 Conduct functional and connectivity testing to ensure continuing operability. Task
508 Determine level of assurance of developed capabilities based on test results. Task
515A Develop software system testing and validation procedures, programming, and documentation. Task
550 Develop test plans to address specifications and requirements. Task
694 Make recommendations based on test results. Task
748A Perform developmental testing on systems under development. Task
757A Perform interoperability testing on systems exchanging electronic information with other systems. Task
761A Perform operational testing. Task
858A Test, evaluate, and verify hardware and/or software to determine compliance with defined specifications and requirements. Task
858B Record and manage test data. Task
874 Utilize models and simulations to analyze or predict system performance under different operating conditions. Task
904 Knowledge of interpreted and compiled computer languages. Knowledge
950 Skill in evaluating test plans for applicability and completeness. Skill
951 Determine scope, infrastructure, resources, and data sample size to ensure system requirements are adequately demonstrated. Task
965 Knowledge of organization’s risk tolerance and/or risk management approach. Knowledge
978A Knowledge of root cause analysis techniques. Knowledge
980A Skill in performing root cause analysis. Skill
1020A Skill in secure test plan design (e. g. unit, integration, system, acceptance). Skill
5650 Validate specifications and requirements for testability. Task
5866A Create or customize existing Test and Evaluation Master Plans (TEMPs) for systems. Task
5877A Develop possible solutions for technical risks and limitations of planned tests. Task
5910A Provide quality assurance of software products throughout their lifecycle. Task
5914 Report test and evaluation deficiencies and possible solutions to appropriate personnel. Task
5920A Test components to ensure they work as intended in a variety of scenarios for all aspects of the application. Task
5933 Conduct automated testing for acceptance testing, functional testing, integration testing, interoperability testing, load/stress testing, performance testing, regression testing, and unit testing. Task
5934 Develop and maintain a tool framework for automated test and evaluation. Task
5935 Perform usability surveys on operators/users of the system. Task
5936 Evaluate reliability, availability, and maintainability data. Task
5937 Assess the system’s effectiveness and suitability for meeting user need and based on test and evaluation results. Task
5938 Integrate digital engineering models and data into test designs. Task
6020 Ability to analyze test data. Ability
6060 Ability to collect, verify, and validate test data. Ability
6170 Ability to translate data and test results into evaluative conclusions. Ability
6430 Knowledge of Test & Evaluation processes. Knowledge
6500 Skill in conducting Test Readiness Reviews. Skill
6530 Skill in designing and documenting overall program Test & Evaluation strategies. Skill
6580 Skill in identifying Test & Evaluation infrastructure (people, ranges, tools, instrumentation) requirements. Skill
6600 Skill in managing test assets, test resources, and test personnel to ensure effective completion of test events. Skill
6630 Skill in preparing Test & Evaluation reports. Skill
6641 Skill in providing Test & Evaluation resource estimate. Skill
7003A Knowledge of security risks, threats, and vulnerabilities and potential risk mitigation solutions. Knowledge
7004A Knowledge of Test & Evaluation frameworks. Knowledge
7006A Knowledge of best practices from industry and academia in test design activities for verification and validation of systems. Knowledge
7009A Knowledge of coding and scripting in languages that support software development and use. Knowledge
7012A Knowledge of current test standards and safety standards that are applicable to software development. Knowledge
7025A Knowledge of how software solutions integrate with cloud or other IT infrastructure. Knowledge
7028A Knowledge of how to automate development, testing, security, and deployment of software to the DoD. Knowledge
7034A Knowledge of interactions and integration of DataOps, MLOps, and DevSecOps solution. Knowledge
7036A Knowledge of laws, regulations, and policies related to software development, cybersecurity, data security/privacy, and use of publicly procured data for government. Knowledge
7044 Knowledge of testing, evaluation, validation, and verification (T&E V&V) tools and procedures to ensure systems are working as intended. Knowledge
7054A Knowledge of tools for testing the robustness and resilience of software products and solutions. Knowledge
7070A Skill in integrating software Test & Evaluation frameworks into test strategies for specific projects. Skill
7077A Skill in translating operation requirements for systems into testing requirements. Skill
7083 Ability to understand technology, management, and leadership issues related to organization processes and problem solving. Ability
7084 Ability to evaluate user training and documentation update processes. Ability
7085 Knowledge of software environments (e.g., development, testing, integration, production, etc.) and appropriate T&E application in those environments. Knowledge
7086 Ability to construct, maintain, and conduct testing in various test environments. Ability