Overview
DecisionPoint seeks a Performance & Resilience Test Engineer to evaluate the scalability, stability, responsiveness, failover behavior, and recovery capabilities of mission-critical software supporting the USMEPCOM ENLIST program. This role develops regression, API, integration, load, stress, endurance, and resilience tests; creates realistic workload models; and produces reproducible evidence of system behavior under normal, peak, degraded, and recovery conditions.
The Performance & Resilience Test Engineer works with architects, software developers, API and integration engineers, infrastructure and cloud teams, database specialists, cybersecurity personnel, CI/CD engineers, operations teams, and Government stakeholders. The position identifies performance bottlenecks, validates failover and recovery procedures, and provides evidence-based recommendations supporting release readiness, capacity planning, and operational resilience.
This position is remote, with Chicago-area candidates preferred.
Note: By applying to this position, you acknowledge and consent to having your resume included in an active competitive government contract bid.
Duties & Responsibilities
The Performance & Resilience Test Engineer will:
- Develop and maintain performance, load, stress, spike, endurance, volume, scalability, failover, and recovery tests.
- Build automated regression, API, and integration tests supporting repeatable performance and resilience validation.
- Analyze mission workflows, usage patterns, transaction volumes, concurrency, data characteristics, interfaces, and operational objectives.
- Develop workload models that represent normal operations, peak demand, surge conditions, degraded environments, and recovery scenarios.
- Define test objectives, performance baselines, service thresholds, acceptance criteria, and measurable expected results.
- Develop test plans, scenarios, scripts, data, configurations, and execution schedules.
- Prepare representative test data for functional, high-volume, boundary, exception, failover, and recovery scenarios.
- Maintain repeatable processes for test-data creation, setup, refresh, reset, reconciliation, and cleanup.
- Execute tests in development, integration, test, staging, performance, or other Government-approved environments.
- Automate test execution through approved CI/CD pipelines where appropriate.
- Produce reproducible test results, logs, reports, metrics, graphs, and objective evidence.
- Measure and analyze response time, throughput, latency, concurrency, error rates, resource utilization, saturation, queue depth, and transaction completion.
- Establish performance baselines and compare results across builds, releases, configurations, environments, and infrastructure changes.
- Identify application, database, interface, network, cloud, infrastructure, configuration, or external-service bottlenecks.
- Correlate test results with application logs, infrastructure metrics, traces, events, and monitoring data.
- Work with technical teams to isolate root causes and recommend appropriate corrective actions.
- Validate failover behavior for applications, services, interfaces, databases, infrastructure components, and dependent capabilities.
- Test approved recovery procedures and confirm that services return to an acceptable operational state.
- Validate recovery sequencing, data consistency, transaction handling, dependency restoration, and post-recovery functionality.
- Evaluate behavior during component failures, network interruptions, service degradation, capacity constraints, and dependency outages.
- Verify that systems fail safely and provide appropriate errors, alerts, retries, timeouts, and recovery behavior.
- Support disaster-recovery, continuity, restoration, and operational-readiness exercises where applicable.
- Document performance defects, resilience gaps, capacity risks, recovery failures, and release impacts.
- Support defect triage, root-cause analysis, correction verification, and targeted regression testing.
- Coordinate with architects and engineering teams to evaluate scalability, capacity, extensibility, and recovery approaches.
- Coordinate with CI/CD engineers to integrate repeatable performance checks, thresholds, reports, and quality gates.
- Coordinate with operations teams to incorporate production observations and operational feedback into future testing.
- Support Government demonstrations, user acceptance testing, release testing, and operational validation.
- Provide performance and resilience results, residual risks, and release-readiness recommendations to technical and program stakeholders.
- Maintain test source code, scripts, configurations, data, and documentation in approved version-control repositories.
- Participate in sprint planning, backlog refinement, reviews, demonstrations, retrospectives, and release-readiness activities.
- Contribute to continuous improvement of performance engineering, workload modeling, observability, failover testing, and recovery validation.
Qualifications
Required Qualifications
Candidates must possess all the following:
- An active Secret clearance or higher.
- A bachelor’s degree in computer science, information technology, engineering, or a related field, or an equivalent permitted by the applicable labor category.
- At least six years of relevant professional experience.
- Experience designing and executing load and performance tests.
- Experience developing realistic workload models based on user behavior, transaction volumes, concurrency, or operational demand.
- Experience analyzing performance results and identifying application, integration, database, infrastructure, or network bottlenecks.
- Experience planning or executing failover tests.
- Experience validating system, application, service, or data recovery.
- Ability to build or maintain regression, API, integration, and automated test coverage.
- Ability to prepare and maintain representative test data.
- Ability to produce repeatable automated execution and reproducible test results.
- Ability to define measurable performance baselines, thresholds, acceptance criteria, and expected results.
- Ability to correlate test results with logs, metrics, traces, events, or other observability data.
- Ability to document performance defects, resilience gaps, capacity risks, recovery failures, and release impacts.
- CompTIA Security+ CE or another Government-approved certification satisfying the required IAT Level II qualification and applicable current DoD 8140 work-role requirements, when required for the assigned duties.
- Strong analytical, automation, troubleshooting, technical documentation, and communication skills.
- Ability to collaborate effectively with architects, developers, integration engineers, database specialists, infrastructure teams, cybersecurity personnel, CI/CD engineers, operations teams, and Government stakeholders.
Preferred Qualifications
The following qualifications are preferred:
- A recognized performance-testing, software-testing, cloud, or site-reliability certification.
- Experience supporting federal or Department of Defense software-development, modernization, testing, or continuity programs.
- Experience testing mission-critical, regulated, security-sensitive, high-volume, or high-availability systems.
- Experience with performance-testing tools such as LoadRunner, JMeter, Gatling, k6, NeoLoad, Locust, or comparable platforms.
- Experience developing test automation using Java, C#, Python, JavaScript, TypeScript, or another supported programming language.
- Experience testing APIs, web services, event-driven systems, message brokers, databases, batch interfaces, or cloud-native services.
- Experience with observability and monitoring tools such as Splunk, Dynatrace, AppDynamics, New Relic, CloudWatch, Azure Monitor, Grafana, Prometheus, or comparable platforms.
- Experience with AWS, Azure, containers, Kubernetes, serverless services, or hybrid cloud environments.
- Experience with CI/CD platforms such as Jenkins, GitHub Actions, GitLab CI/CD, Azure DevOps, AWS CodePipeline, or comparable solutions.
- Knowledge of site reliability engineering concepts, including service-level indicators, service-level objectives, error budgets, saturation, and capacity planning.
- Experience with disaster-recovery testing, continuity exercises, recovery-time objectives, or recovery-point objectives.
- Experience with resilience testing, controlled fault injection, or approved chaos-engineering practices.
- Experience using Jira, Azure DevOps, TestRail, Zephyr, Xray, Confluence, or comparable testing and collaboration tools.
- Familiarity with Agile, DevSecOps, secure software-development, configuration-management, and release-management practices.
Our Equal Employment Opportunity Policy
- EEO and Affirmative Action Policy: DecisionPoint Corporation is an Equal Employment Opportunity and Affirmative Action employer. It is the policy of DecisionPoint Corporation to provide equal employment opportunity in accordance with all applicable Equal Employment Opportunity/Affirmative Action laws, directives and regulations to all employees and qualified applicants without regard to race, ethnicity, color, religion, national origin, sex, age, disability status, pregnancy, sexual orientation, gender identity, genetic information, protected veteran status, or any other protected status under Federal, State or Local laws.
- Pay Transparency Policy: In accordance with Presidential Executive Order 13665, DecisionPoint Corporation will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information.
- Authorization to Share Resume and Personal Information: By expressing your interest and submitting your resume for this position, you authorize DecisionPoint Corporation to share your resume, as well as personal information included on the resume, with its subsidiaries, affiliates and teaming partners for the purpose of considering you for this position and other available positions requiring comparable skills, education and experience. Should DecisionPoint Corporation. or its affiliates and teaming partners wish to initiate pre-employment discussions, you will be asked to complete an employment application and related employment documents.