Skip to content

[Cleanup] Profile usage audit — 48 of 93 profiles (52%) have zero/near-zero usage in past year #700

@ericavella

Description

@ericavella

Profile Usage Audit -- Past 12 Months (Apr 2025 - Apr 2026)

Updated 2026-04-29: Removed EXAMPLE, EXECUTE-SCRIPT, GET-STARTED, and SETUP-FORMAT-DISKS profiles from removal list (intentional scaffolding/utility). Added note that GPU base profiles serve as templates for active GB300/GB200 hardware variants.

We analyzed all 93 VirtualClient profiles against Kusto telemetry (azurecrcworkloads cluster, WorkloadPerformance database) to identify unused workloads and dead code candidates.

Data source: dcount(ExperimentId) per ProfileName across both Vega (~80%) and Juno (~20%) execution systems.

Summary

Status Count Action
Active (>50 executions) 36 Keep
Low usage (21-50) 3 Monitor
Review (6-20) 6 Discuss
Near-zero (1-5) 6 Recommend removal
Zero usage (removable) 33 Recommend removal
Zero usage (excluded) 9 Keep (scaffolding/utility)
Up for removal 39 (42%)

Top 10 Most Active Profiles

Profile Executions Last Seen
PERF-CPU-PRIME95 75,738 Apr 2026
PERF-CPU-COREMARK 71,405 Apr 2026
PERF-CPU-GEEKBENCH 35,445 Apr 2026
PERF-MEM-STRESSAPPTEST 30,417 Apr 2026
MONITORS-COUNTERS 20,249 Apr 2026
PERF-NETWORK 11,716 Apr 2026
PERF-SPECCPU-INTRATE 8,911 Apr 2026
PERF-CPU-OPENSSL 4,843 Apr 2026
PERF-SPECCPU-FPRATE 3,254 Apr 2026
MONITORS-DEFAULT 3,192 Apr 2026

Near-Zero Usage (1-5 executions)

Profile Executions Last Seen
PERF-NETWORK-DEATHSTARBENCH 5 Oct 2025
QUAL-GPU-DCGMI 4 Jun 2025
PERF-NETWORK-2 2 Sep 2025
MONITORS-GPU-NVIDIA 1 Jul 2025
PERF-CPU-HPLINPACK-INTEL 1 Apr 2026
PERF-WEB-NGINX-WRK2 1 May 2025

Excluded from Removal (intentional scaffolding/utility)

EXAMPLE-CLIENT-SERVER-WORKLOAD-1/2/3, EXAMPLE-WORKLOAD, EXAMPLE-WORKLOAD-2, EXECUTE-SCRIPT, GET-ACCESS-TOKEN, GET-STARTED-REDIS, SETUP-FORMAT-DISKS

Zero-Usage Profiles (33) -- Recommended for Removal

Click to expand full list
Category Profiles
BOOTSTRAP (2) BOOTSTRAP-CERTIFICATE, BOOTSTRAP-PACKAGE
MONITORS (2) MONITORS-FILE-UPLOAD, MONITORS-GPU-AMD
PERF-CPU (4) PERF-CPU-EXAMPLE-AFFINITY, PERF-CPU-HPLINPACK-AMD, PERF-CPU-HPLINPACK-ARM, PERF-CPU-OPENSSL-TLS
PERF-GPU (8) PERF-GPU-3DMARK, PERF-GPU-BLENDER, PERF-GPU-FLOPS, PERF-GPU-SPECVIEW, PERF-GPU-SUPERBENCH, PERF-GPU-MLPERF (archived), PERF-GPU-MLPERF-NVIDIA (archived), PERF-GPU-MLPERF-TRAINING-NVIDIA (archived), PERF-GPU-SUPERBENCH-NVIDIA (archived)
PERF-HPC (1) PERF-HPC-NASPARALLELBENCH
PERF-IO (1) PERF-IO-FIO-OLTP
PERF-NETWORK (1) PERF-NETWORK-CTSTRAFFIC
PERF-WEB (6) PERF-WEB-ASPNET-BOMBARDIER, PERF-WEB-ASPNET-ORCHARD-WRK, PERF-WEB-ASPNET-WRK, PERF-WEB-ASPNET-WRK-AFFINITY, PERF-WEB-NGINX-WRK-RP, PERF-WEB-NGINX-WRK2-RP
POWER (3) POWER-SPEC30, POWER-SPEC50, POWER-SPEC100
SETUP (3) SETUP-GPU-AMD-MI25, SETUP-GPU-AMD-V620, SETUP-GPU-NVIDIA-A100
UPLOAD (1) UPLOAD-TELEMETRY

Dead Code Impact

Removing these 39 unused profiles would also allow cleanup of 36 C# component types exclusively referenced by unused profiles:

Metric Count
Dead source files ~50
Dead source lines 13,761
Dead test files 68
Dead test lines 13,632
Total removable lines 27,393 (23.6% of component codebase)
Biggest dead code areas by category
Category Dead Types Est. Lines (source + test)
Network (DeathStarBench, CtsTraffic, NTttcp2, CPS2, SockPerf2) 6 ~8,500
GPU (3DMark, Blender, DXFLOPS, SpecView, DCGMI, NvidiaSmi, AmdSmi) 7 ~5,000
Web (ASP.NET, Bombardier, Wrk2) 4 ~2,750
Infrastructure (CertificateInstallation, UploadTelemetry, etc.) 7 ~3,770
HPC (NASParallelBench) 1 ~990
Crypto (TLS OpenSSL client/server) 2 ~990

Note: PERF-GPU profiles are all unused directly, but note that the CRC-AIR-Workloads repo has active GB300/GB200 hardware variants that derive from similar base profiles.


Action Requested

Please comment below if any of the profiles listed for removal are needed for upcoming work. Include:

  1. Which profile(s) you need kept
  2. Expected timeline for use
  3. Whether the profile needs updates or can stay as-is

Profiles not claimed within 30 days will be moved to Archive/ via a follow-up PR.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions