Skip to content

[WIP] New Ray Serve tutorial #3709

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
crypdick wants to merge 23 commits into
base: main
Choose a base branch
from
+384 −4
Draft

[WIP] New Ray Serve tutorial #3709

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
ac21240
initial draft
Nov 14, 2025
b45b2cc
progress
Nov 17, 2025
0c1c18f
formatting
Nov 25, 2025
7f2e70a
bump Ray version
Dec 9, 2025
2b7b560
Create paired tutorial docs
Dec 9, 2025
9a64caa
ignore cursor configs
crypdick Dec 12, 2025
608aa19
add serve to docker reqs
crypdick Dec 12, 2025
9257827
Add completed ray serve tutorial
crypdick Dec 12, 2025
035d4f1
add tutorial to index
crypdick Dec 12, 2025
1f3e44e
unstage ipynb and md
crypdick Dec 12, 2025
6afcd3b
Merge branch 'pytorch:main' into ray-serve-tutorial
crypdick Dec 15, 2025
83e68e7
tmp checkpt
crypdick Dec 18, 2025
fa5d2e0
sync
Dec 18, 2025
7002920
ignore more data files; ignore intermediates
Dec 18, 2025
3d7a1f0
ignore more files
Dec 18, 2025
06378e2
edit gitignore for symlink
Dec 18, 2025
69dfe1c
finalize serving tutorial
Dec 18, 2025
0ac13d6
rm tutorial intermediates
Dec 18, 2025
aa881f3
minor fixes
Dec 18, 2025
091d9ca
clarify expanation of max_ongoing_requests and max_queued_requests
Jan 7, 2026
caa63f9
make linter happy
Jan 7, 2026
ae04c95
Merge branch 'main' into ray-serve-tutorial
crypdick Jan 7, 2026
4f38ddf
add grid cards for 'what you will learn' and prerequisites. Add fault…
Jan 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 5 additions & 2 deletions .ci/docker/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,8 @@ pytorch_sphinx_theme2==0.2.0
# Tutorial dependencies
tqdm==4.66.1
numpy==1.24.4
pydantic>=2.0
fastapi
matplotlib
librosa
torch==2.9
Expand All @@ -31,8 +33,8 @@ PyHamcrest
bs4
awscliv2==2.1.1
flask
spacy==3.4.1
ray[tune]==2.7.2
spacy>=3.7.0
ray[serve,tune]==2.52.1
tensorboard
jinja2==3.1.3
pytorch-lightning
Expand All @@ -59,6 +61,7 @@ sphinxcontrib.katex
boto3
pandas
requests
aiohttp
scikit-image
scipy==1.11.1
numba==0.57.1
Expand Down
22 changes: 20 additions & 2 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,8 +8,9 @@ prototype
/unstable
sg_execution_times.rst

#data things
# Datasets
_data/
data/
advanced_source/images/
advanced_source/data/
beginner_source/.data/
Expand Down Expand Up @@ -52,6 +53,7 @@ var/
*.egg-info/
.installed.cfg
*.egg
.git
Copy link
Author

@crypdick crypdick Dec 18, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Needed due to a bug in Ray; working on a PR

Copy link
Author

@crypdick crypdick Jan 7, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR here: ray-project/ray#59566


# PyInstaller
# Usually these files are written by a python script from a template
Expand Down Expand Up @@ -105,9 +107,11 @@ target/
celerybeat-schedule
# dotenv
.env
.envrc

# virtualenv
venv/
.venv/
ENV/

# Spyder project settings
Expand All @@ -124,11 +128,25 @@ cleanup.sh
# PyTorch things
*.pt

# VSCode
# IDEs
*.vscode
.cursor
.devtools/

# pyspelling
dictionary.dic

# linters
/.lintbin

# Intermediate tutorial files
beginner_source/*/*_tutorial.md
beginner_source/*/*_tutorial.ipynb
intermediate_source/*/*_tutorial.md
intermediate_source/*/*_tutorial.ipynb
advanced_source/*/*_tutorial.md
advanced_source/*/*_tutorial.ipynb
recipes_source/*/*_tutorial.md
recipes_source/*/*_tutorial.ipynb
prototype_source/*/*_tutorial.md
prototype_source/*/*_tutorial.ipynb
Loading