mlflow
Add guide for tracing deepseek
#14826
Merged

Add guide for tracing deepseek #14826

B-Step62 merged 3 commits into mlflow:master from B-Step62:deepseek
B-Step62
B-Step6282 days ago (edited 82 days ago)
🛠 DevTools 🛠

Open in GitHub Codespaces

Install mlflow from this PR

# Use `%sh` to run this command on Databricks
OPTIONS=$(if pip freeze | grep -q 'mlflow @ git+https://github.com/mlflow/mlflow.git'; then echo '--force-reinstall --no-deps'; fi)
pip install $OPTIONS git+https://github.com/mlflow/mlflow.git@refs/pull/14826/merge

Checkout with GitHub CLI

gh pr checkout 14826

What changes are proposed in this pull request?

Add integration guide for MLflow Tracing with DeepSeek (through OpenAI SDK)

How is this PR tested?

  • Existing unit/integration tests
  • New unit/integration tests
  • Manual tests

Does this PR require documentation update?

  • No. You can skip the rest of this section.
  • Yes. I've updated:
    • Examples
    • API references
    • Instructions

Release Notes

Is this a user-facing change?

  • No. You can skip the rest of this section.
  • Yes. Give a description of this change to be included in the release notes for MLflow users.

Add guide for integrating MLflow Tracing with DeepSeek.

What component(s), interfaces, languages, and integrations does this PR affect?

Components

  • area/artifacts: Artifact stores and artifact logging
  • area/build: Build and test infrastructure for MLflow
  • area/deployments: MLflow Deployments client APIs, server, and third-party Deployments integrations
  • area/docs: MLflow documentation pages
  • area/examples: Example code
  • area/model-registry: Model Registry service, APIs, and the fluent client calls for Model Registry
  • area/models: MLmodel format, model serialization/deserialization, flavors
  • area/recipes: Recipes, Recipe APIs, Recipe configs, Recipe Templates
  • area/projects: MLproject format, project running backends
  • area/scoring: MLflow Model server, model deployment tools, Spark UDFs
  • area/server-infra: MLflow Tracking server backend
  • area/tracking: Tracking Service, tracking client APIs, autologging

Interface

  • area/uiux: Front-end, user experience, plotting, JavaScript, JavaScript dev server
  • area/docker: Docker use across MLflow's components, such as MLflow Projects and MLflow Models
  • area/sqlalchemy: Use of SQLAlchemy in the Tracking Service or Model Registry
  • area/windows: Windows support

Language

  • language/r: R APIs and clients
  • language/java: Java APIs and clients
  • language/new: Proposals for new client languages

Integrations

  • integrations/azure: Azure and Azure ML integrations
  • integrations/sagemaker: SageMaker integrations
  • integrations/databricks: Databricks integrations

How should the PR be classified in the release notes? Choose one:

  • rn/none - No description will be included. The PR will be mentioned only by the PR number in the "Small Bugfixes and Documentation Updates" section
  • rn/breaking-change - The PR will be mentioned in the "Breaking Changes" section
  • rn/feature - A new user-facing feature worth mentioning in the release notes
  • rn/bug-fix - A user-facing bug fix worth mentioning in the release notes
  • rn/documentation - A user-facing documentation change worth mentioning in the release notes

Should this PR be included in the next patch release?

Yes should be selected for bug fixes, documentation updates, and other small changes. No should be selected for new features and larger changes. If you're unsure about the release classification of this PR, leave this unchecked to let the maintainers decide.

What is a minor/patch release?
  • Minor release: a release that increments the second part of the version number (e.g., 1.2.0 -> 1.3.0).
    Bug fixes, doc updates and new features usually go into minor releases.
  • Patch release: a release that increments the third part of the version number (e.g., 1.2.0 -> 1.2.1).
    Bug fixes and doc updates usually go into patch releases.
  • Yes (this PR will be cherry-picked and included in the next patch release)
  • No (this PR will be included in the next minor release)
B-Step62 Add guide for tracing deepseek
999a104e
github-actions github-actions added area/docs
github-actions github-actions added rn/documentation
github-actions
github-actions82 days ago (edited 82 days ago)

Documentation preview for 42ab829 will be available when this CircleCI job
completes successfully. You may encounter a {"message":"not found"} error when reloading
a page. If so, add /index.html to the URL.

More info
xq-yin xq-yin requested a review from xq-yin xq-yin 82 days ago
xq-yin
xq-yin approved these changes on 2025-03-04
xq-yin82 days ago

LGTM!

harupy harupy requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 82 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2025-03-04
copilot-pull-request-reviewer82 days ago

Copilot reviewed 6 out of 6 changed files in this pull request and generated no comments.

B-Step62 B-Step62 enabled auto-merge 82 days ago
TomeHirata
TomeHirata approved these changes on 2025-03-04
TomeHirata82 days ago

LGTM

harupy
harupy commented on 2025-03-04
Conversation is marked as resolved
Show resolved
docs/docs/tracing/integrations/deepseek.mdx
3sidebar_label: DeepSeek
4---
5
6
import { APILink } from "@site/src/components/APILink";
7
import { Card, CardGroup, SmallLogoCard } from "@site/src/components/Card";
8
import TOCInline from "@theme/TOCInline";
9
import Tabs from "@theme/Tabs";
10
import TabItem from "@theme/TabItem";
harupy82 days ago

Do we need to import these?

B-Step6282 days ago

Not really, just copy-pasted

B-Step62
B-Step62 commented on 2025-03-04
Conversation is marked as resolved
Show resolved
docs/docs/tracing/integrations/deepseek.mdx
82
83## Streaming and Async Support
84
85
MLflow supports tracing for streaming and async DeepSeek APIs. Visit the [OpenAI Tracing documentation](../openai) for example code snippets for tracing streaming and async calls through OpenAI SDK.
B-Step6282 days ago
Suggested change
MLflow supports tracing for streaming and async DeepSeek APIs. Visit the [OpenAI Tracing documentation](../openai) for example code snippets for tracing streaming and async calls through OpenAI SDK.
MLflow supports tracing for streaming and async DeepSeek APIs. Visit the [OpenAI Tracing documentation](openai) for example code snippets for tracing streaming and async calls through OpenAI SDK.
B-Step62
B-Step62 commented on 2025-03-04
Conversation is marked as resolved
Show resolved
docs/docs/tracing/integrations/deepseek.mdx
2sidebar_position: 5
3sidebar_label: DeepSeek
4---
5
6
import { APILink } from "@site/src/components/APILink";
7
import { Card, CardGroup, SmallLogoCard } from "@site/src/components/Card";
8
import TOCInline from "@theme/TOCInline";
9
import Tabs from "@theme/Tabs";
10
import TabItem from "@theme/TabItem";
B-Step6282 days ago
Suggested change
import { APILink } from "@site/src/components/APILink";
import { Card, CardGroup, SmallLogoCard } from "@site/src/components/Card";
import TOCInline from "@theme/TOCInline";
import Tabs from "@theme/Tabs";
import TabItem from "@theme/TabItem";
B-Step62 Apply suggestions from code review
ab7a126d
harupy
harupy commented on 2025-03-04
Conversation is marked as resolved
Show resolved
docs/docs/tracing/integrations/deepseek.mdx
37(*1) Streaming support requires MLflow 2.15.0 or later.
38(*2) Async support requires MLflow 2.21.0 or later.
39
40
To request support for additional APIs, please open a [feature request](https://github.com/mlflow/mlflow/issues/new?assignees=&labels=enhancement&projects=&template=feature_request.yaml) on GitHub.
harupy82 days ago👍 1
Suggested change
To request support for additional APIs, please open a [feature request](https://github.com/mlflow/mlflow/issues/new?assignees=&labels=enhancement&projects=&template=feature_request.yaml) on GitHub.
To request support for additional APIs, please open a [feature request](https://github.com/mlflow/mlflow/issues/new?assignees=&labels=enhancement&projects=&template=feature_request_template.yaml) on GitHub.
B-Step62 Update docs/docs/tracing/integrations/deepseek.mdx
42ab829a
harupy
harupy approved these changes on 2025-03-04
harupy82 days ago❤ 1
B-Step62 B-Step62 merged b9b930f2 into master 82 days ago
B-Step62 B-Step62 deleted the deepseek branch 82 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone