Incorrect model versions in Code #138723
-
Select Topic AreaBug BodyFound some mistakes in the Marketplace ->Models -> Playground -> Python code. For example in this code: `"""Run this model in Python
> pip install azure-ai-inference
"""
import os
from azure.ai.inference import ChatCompletionsClient
from azure.ai.inference.models import SystemMessage
from azure.ai.inference.models import UserMessage
from azure.core.credentials import AzureKeyCredential
# To authenticate with the model you will need to generate a personal access token (PAT) in your GitHub settings.
# Create your PAT token by following instructions here: https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/managing-your-personal-access-tokens
client = ChatCompletionsClient(
endpoint="https://models.inference.ai.azure.com",
credential=AzureKeyCredential(os.environ["GITHUB_TOKEN"]),
)
response = client.complete(
messages=[
SystemMessage(content=""""""),
UserMessage(content="Can you explain the basics of machine learning?"),
],
model="Meta-Llama-3-1-405B-Instruct",
temperature=0.8,
max_tokens=4096,
top_p=0.1
)
print(response.choices[0].message.content) The correct model version is: model="Meta-Llama-3.1-405B-Instruct", Same here: model="Phi-3-5-vision-instruct"
# to
model="Phi-3.5-vision-instruct" |
Beta Was this translation helpful? Give feedback.
Replies: 3 comments
-
💬 Your Product Feedback Has Been Submitted 🎉 Thank you for taking the time to share your insights with us! Your feedback is invaluable as we build a better GitHub experience for all our users. Here's what you can expect moving forward ⏩
Where to look to see what's shipping 👀
What you can do in the meantime 💻
As a member of the GitHub community, your participation is essential. While we can't promise that every suggestion will be implemented, we want to emphasize that your feedback is instrumental in guiding our decisions and priorities. Thank you once again for your contribution to making GitHub even better! We're grateful for your ongoing support and collaboration in shaping the future of our platform. ⭐ |
Beta Was this translation helpful? Give feedback.
-
Thanks for flagging, we'll look at updating this |
Beta Was this translation helpful? Give feedback.
-
Same problem with |
Beta Was this translation helpful? Give feedback.
Thanks for flagging, we'll look at updating this