SDK_CLI_test #3623

raghu-microsoft · 2025-06-20T06:45:22Z

Description

Checklist

I have read the contribution guidelines.
- General
- SDK
- CLI
I have coordinated with the docs team (mldocs@microsoft.com) if this PR deletes files or changes any file names or file extensions.
Pull request includes test coverage for the included changes.
This notebook or file is added to the CODEOWNERS file, pointing to the author or the author's team.

* Add grpo job example * Replace client info with generics * Add missing copyright * newline at end of aml_setup.py * Fix black formatting issues and reduce dataset * Update sdk/python/jobs/grpo/src/grpo_trainer_rewards.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update sdk/python/jobs/grpo/src/BldDemo_Reasoning_Train.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update sdk/python/jobs/grpo/src/BldDemo_Reasoning_Train.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Fix duplicated cell * Add to CODEOWNERS * Fix agenda image and dataset string * Replace demo with example * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Address deployment related comments * Add README * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Remove duplicated model info section * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Change dataset description --------- Co-authored-by: Sharvin Jondhale <shjondhale@microsoft.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com>

Co-authored-by: Mohd Javed Ansari <moansa@microsoft.com>

Add yeshwanth and harsha to code owners for GRPO

Changed Agenda to 'Plan of Action'

* Followup improvements to GRPO job example * Add more docs to the readme * Update sdk/python/jobs/grpo/README.md Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Update sdk/python/jobs/grpo/README.md Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Update README.md --------- Co-authored-by: Sharvin Jondhale <shjondhale@microsoft.com> Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com>

Co-authored-by: Mohd Javed Ansari <moansa@microsoft.com>

* fail sdk installation workflow temporarily

* Replace azureml-defaults with azureml-inference-server-http==1.4.0 in environment configuration files * update azureml-inference-server-http * update inference-schema and joblib in conda.yaml * Replace azureml-defaults with azureml-inference-server-http==1.4.0 in environment configuration files * update azureml-inference-server-http * update inference-schema and joblib in conda.yaml --------- Co-authored-by: Salman Arshad <v-saarshad@microsoft.com>

* Adding mcp server content * updating content * add more content to it * adding more details * adding pr details * formating * updating readme file * updating readme * formating the content * formatting * applying formatng * applying formating * applying formatting * adding more ocntent

* Add config for single node runs * Fix notebook metadata * Run black formatter --------- Co-authored-by: Sharvin Jondhale <shjondhale@microsoft.com>

* [Fix]: Add accuracy also and reword informative assertions

* remove responsibleai-vision notebooks and related workflows

github-advanced-security · 2025-06-24T07:00:55Z

This pull request sets up GitHub code scanning for this repository. Once the scans have completed and the checks have passed, the analysis results for this pull request branch will appear on this overview. Once you merge this pull request, the 'Security' tab will show more code scanning analysis results (for example, for the default branch). Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results. For more information about GitHub code scanning, check out the documentation.

sdk/python/jobs/grpo/aml_setup.py

+from azure.identity import InteractiveBrowserCredential, DefaultAzureCredential
+
+try:
+    credential = DefaultAzureCredential()


sdgilley

these changes will not break the docs builds.

* update rai-tabular environment version in rai tabular notebooks

* Update to use Python 3.12 * update * update * Update Dockerfiles and deployment configurations to use the latest minimal-py312-inference image * Update conda and environment configurations to use updated package versions --------- Co-authored-by: Salman Arshad <v-saarshad@microsoft.com> Co-authored-by: Arun <arunsu@microsoft.com>

* checking AZ CLI version in ml ext installation workflow * adding latest version of az cli * adding latest version of az cli via url

* Bump up version for tabular components * update * revert

Co-authored-by: Salman Arshad <v-saarshad@microsoft.com>

* Submitting a job in env with private python packages * basic sanity notebooks of SDK & CLI * black fixes * Task 4123398: Add sdk and cli notebooks and raise sev2 if sdk/cli is not installable (#3579) * Submitting a job in env with private python packages * basic sanity notebooks of SDK & CLI * black fixes * cron update to every 5 min & readme exclusion * Sanity monitor (#3581) * Submitting a job in env with private python packages * basic sanity notebooks of SDK & CLI * black fixes * cron update to every 5 min & readme exclusion * adding README.md for cli and sdk * Sanity monitor (#3583) * Submitting a job in env with private python packages * basic sanity notebooks of SDK & CLI * black fixes * cron update to every 5 min & readme exclusion * adding README.md for cli and sdk * fix README.md for cli and sdk (#3584) * Sanity monitor (#3586) * fix README.md for cli and sdk * fix README.md for sdk * fix README.md for sdk * Sanity monitor (#3587) * fix README.md for cli and sdk * fix README.md for sdk * fix README.md for sdk * fix exclusions and workflows * Sanity monitor (#3588) * fix README.md for cli and sdk * fix README.md for sdk * fix README.md for sdk * fix exclusions and workflows * fix sdk nb * fix nb and remove readme * fix nb for ws list * fail sdk installation workflow temporarily * Pass the failing workflow * Fail the workflow intentionally to test the monitor

Co-authored-by: Salman Arshad <v-saarshad@microsoft.com> Co-authored-by: Arun <arunsu@microsoft.com>

* [Feat]: Adding example for grpo pipeline job trigger * [update]: format with black

* Adding an example notebook for gpt-oss finetuning * black file formatting

- Demonstrates a multi-step pipeline with dummy inputs and outputs - Replicates the step sequence functionality available in AzureML SDK v1 - Serves as a reference for migrating pipelines from SDK v1 to SDK v2

* New Ubuntu image * update EOL images pt2

* Update online-endpoints-managed-identity-sai.ipynb * Update online-endpoints-managed-identity-uai.ipynb * update EOL images --------- Co-authored-by: kshitij-microsoft <kchawla@microsoft.com> Co-authored-by: Kshitij Chawla <166698309+kshitij-microsoft@users.noreply.github.com>

sharvin2187 and others added 16 commits May 28, 2025 14:40

update deployment env to ubuntu22.04 for automl notebook jobs (#3598)

920e2c5

Co-authored-by: Mohd Javed Ansari <moansa@microsoft.com>

Update CODEOWNERS (#3601)

7724e99

Add yeshwanth and harsha to code owners for GRPO

Update launch_grpo_command_job-med-mcqa-commented.ipynb (#3599)

539744e

Changed Agenda to 'Plan of Action'

Ignore warnings for Notebook test runs (#3603)

f6e39a4

Co-authored-by: Mohd Javed Ansari <moansa@microsoft.com>

fix deployment env image (#3606)

06204c0

Co-authored-by: Mohd Javed Ansari <moansa@microsoft.com>

fix broken link for SDK installation (#3605)

7f21365

Fail workflow of sdk install temporarily to test monitor (#3611)

794431a

* fail sdk installation workflow temporarily

Add config for single node runs (#3604)

047ef25

* Add config for single node runs * Fix notebook metadata * Run black formatter --------- Co-authored-by: Sharvin Jondhale <shjondhale@microsoft.com>

[Fix]: Add accuracy also and reword informative assertions (#3617)

642661c

* [Fix]: Add accuracy also and reword informative assertions

Create copilot-instructions.md (#3620)

7694c8c

Qunsong/remove image notebooks (#3621)

9473226

* remove responsibleai-vision notebooks and related workflows

remove rai-text notebooks and related workflows (#3622)

2cd3cb6

raghu-microsoft requested review from kingernupur, jayesh-tanna, achauhan-scc and imatiach-msft as code owners June 20, 2025 06:45

github-advanced-security bot found potential problems Jun 24, 2025

View reviewed changes

Spark upgrade (#3629)

65eceac

kshitij-microsoft requested review from a team, ahughes-msft, yunjie-hub and nemanjarajic as code owners June 27, 2025 09:15

sdgilley approved these changes Jun 30, 2025

View reviewed changes

qusongms and others added 2 commits July 3, 2025 11:09

update tabular env version 2 (#3636)

feebd26

* update rai-tabular environment version in rai tabular notebooks

Update sdk-deploy-and-test.ipynb (#3637)

eb107dc

salmanarshad97 and others added 16 commits July 8, 2025 22:29

Azure CLI install latest version in sanity workflows (#3642)

bc3c885

* checking AZ CLI version in ml ext installation workflow * adding latest version of az cli * adding latest version of az cli via url

Pass the failing workflow (#3612)

e18d623

Update CODEOWNERS (#3651)

704150c

Bump up version for tabular components (#3649)

cf36459

* Bump up version for tabular components * update * revert

Update Dockerfile (#3653)

73c78a3

Co-authored-by: Salman Arshad <v-saarshad@microsoft.com>

Pass the failing workflow (#3655)

958aac3

Update scipy version (#3654)

85e88b4

Co-authored-by: Salman Arshad <v-saarshad@microsoft.com> Co-authored-by: Arun <arunsu@microsoft.com>

Update spark runtime version (#3638)

87ddd59

[Feat]: Adding example for grpo pipeline job trigger (#3663)

9029297

* [Feat]: Adding example for grpo pipeline job trigger * [update]: format with black

fix cred scan issue (#3677)

82e1bca

Adding an example notebook for gpt-oss finetuning (#3678)

4df413c

* Adding an example notebook for gpt-oss finetuning * black file formatting

Sample Pipeline: StepSequence Migration SDK v1 to SDK v2 (#3667)

e5ed2b3

- Demonstrates a multi-step pipeline with dummy inputs and outputs - Replicates the step sequence functionality available in AzureML SDK v1 - Serves as a reference for migrating pipelines from SDK v1 to SDK v2

Updating EOL images in Notebooks (#3682)

76c34dd

* New Ubuntu image * update EOL images pt2

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

SDK_CLI_test #3623

SDK_CLI_test #3623

Uh oh!

raghu-microsoft commented Jun 20, 2025

Uh oh!

github-advanced-security bot commented Jun 24, 2025

Uh oh!

Check failure

sdgilley left a comment

Uh oh!

Uh oh!

SDK_CLI_test #3623

Are you sure you want to change the base?

SDK_CLI_test #3623

Uh oh!

Conversation

raghu-microsoft commented Jun 20, 2025

Description

Checklist

Uh oh!

github-advanced-security bot commented Jun 24, 2025

Uh oh!

Check failure

sdgilley left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!