Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly
Appearance settings

[Feature Request] Native MAX Serving Support for parasail-ai/GritLM-7B-vllm (GRITLM Architecture) #6713

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Tharun-Kumar-McW wants to merge 7 commits into
base: main
Choose a base branch
Loading
from
Open

[Feature Request] Native MAX Serving Support for parasail-ai/GritLM-7B-vllm (GRITLM Architecture) #6713

Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
36bf68a
[Feature] Added the parasail-ai/GritLM-7B-vllm model to serve nativel…
Tharun-Kumar-McW Jun 23, 2026
35a5188
[Fix] resolve type errors and Bazel dependency issues
Tharun-Kumar-McW Jun 23, 2026
82eb2fd
[Fix] resolve type errors
Tharun-Kumar-McW Jun 23, 2026
4ff1eef
[Fix] resolve type errors
Tharun-Kumar-McW Jun 23, 2026
d8666d4
[Fix] ran bazel format to fix format issues
Tharun-Kumar-McW Jun 23, 2026
34e415d
[Fix] Removed the ARCHITECTURE = [] and synced the repo
Tharun-Kumar-McW Jun 24, 2026
d5c3cd7
[Fix] Added graph capture and overlap schedular in arch object
Tharun-Kumar-McW Jun 27, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
[Fix] resolve type errors
  • Loading branch information
@Tharun-Kumar-McW
Tharun-Kumar-McW committed Jul 16, 2026
commit 82eb2fd44570a38d3fdc459f7fe8aec23b481575
2 changes: 1 addition & 1 deletion 2 max/python/max/pipelines/architectures/gritlm/gritlm.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@


class GritLMTextModel(
Module[[Tensor, PagedCacheValues, Tensor, Tensor], tuple[Tensor, ...]]
Module[[Tensor, PagedCacheValues, Tensor, Tensor], tuple[Tensor | TensorValue, ...]]
):
"""GritLM decoder-only transformer (CausalLM path).

Expand Down
Morty Proxy This is a proxified and sanitized view of the page, visit original site.