Skip to content

Update load-testing skill: u2m auth and relax matrix requirements#196

Open
jennsun wants to merge 4 commits intodatabricks:mainfrom
jennsun:load-testing-rebase
Open

Update load-testing skill: u2m auth and relax matrix requirements#196
jennsun wants to merge 4 commits intodatabricks:mainfrom
jennsun:load-testing-rebase

Conversation

@jennsun
Copy link
Copy Markdown
Contributor

@jennsun jennsun commented Apr 21, 2026

Summary

Follow up from https://github.com/databricks-eng/universe/pull/1816018#discussion_r3112376990

  • Relax M2M OAuth requirement: U2M from databricks auth login is better for short tests (<1 hour). M2M only recommended for prolonged 1hr+ load testing. Reduces friction since creating a service principal requires workspace admin.
  • Shrink test matrix 8 → 6: Medium w2/w3/w4 + Large w6/w8/w10. Prior testing already narrowed the sweet spot.
  • Update estimated duration: 6 apps with defaults (~45 min) fits well under U2M token lifetime.
  • Update example commands: Quick test uses U2M by default (no --client-id/--client-secret), overnight examples keep M2M.

Test plan

  • Verify /load-testing skill works with U2M auth (no service principal) on a short test run
  • Verify M2M path still works for overnight runs
  • Review docs draft for accuracy against current scripts

jennsun and others added 2 commits April 20, 2026 17:34
…atrix, add docs draft

- M2M OAuth no longer required for short tests (<1hr) — U2M from `databricks auth login` works automatically
- Shrink recommended test matrix from 8 to 6 configs (Medium w2/w3/w4, Large w6/w8/w10)
- Update estimated duration: 6 apps ~45min with defaults, under U2M token lifetime
- Example commands: quick test uses U2M, overnight/multi-run examples keep M2M
- Add draft docs page for Databricks docs (agent-load-testing/docs/load-test-apps.md)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@jennsun jennsun changed the title Update load-testing skill: relax auth, shrink matrix, add docs draft Update load-testing skill: u2m auth and relax matrix requirements Apr 21, 2026
jennsun and others added 2 commits April 21, 2026 14:29
U2M via `databricks auth token --host` fails when multiple profiles
match the same host. Adding DATABRICKS_PROFILE to the instructions
ensures the scripts use the correct profile.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@jennsun jennsun requested review from bbqiu and dhruv0811 April 21, 2026 21:56
Copy link
Copy Markdown
Contributor

@dhruv0811 dhruv0811 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!!

Copy link
Copy Markdown
Contributor

@bbqiu bbqiu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

did you mean to check in the agent-load testing folder?

lgtm otherwise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants