yangmao.ai · Python setup money page
SambaNova Python API Setup
Use this page when you need a working Python starting point for SambaNova, then validate quota and model names in the official console before production.
Quick verdict
- Free API: Free tier（永久免费）
- Rate limits: 30 RPM
- Best model starting point: Llama 3.1 405B
- Mainland China access: proxy/relay likely needed
Provider fit matrix
Production readiness checklist
Python setup snapshot
Start with the smallest possible chat completion, then move the key to your server-side secret manager before production.
from openai import OpenAI
client = OpenAI(
api_key="sn-your-sambanova-key",
base_url="https://api.sambanova.ai/v1"
)
# 使用 LLaMA 3.1 405B — 全球唯一免费 405B 模型
response = client.chat.completions.create(
model="Meta-Llama-3.1-405B-Instruct",
messages=[{"role": "user", "content": "用 Python 实现一个 LRU Cache"}],
)
print(response.choices[0].message.content)Free API and pricing notes
Free tier（永久免费）
Free API powered by custom RDU (Reconfigurable Dataflow Unit) chip, ultra-fast inference. API keys start with sn-. OpenAI-compatible format, base_url is https://api.sambanova.ai/v1. Key highlight: LLaMA 3.1 405B completely free — the only platform offering free 405B model access. Free tier has rate limits (30 RPM) but no total cap.
Access and production risk
Relay or proxy may be needed
Requires proxy in China. Use openllmapi.com as proxy.
How to set it up
Create or locate your provider API key in the official dashboard.
Install the OpenAI-compatible Python SDK or the provider-supported SDK.
Set the API key in an environment variable instead of hard-coding secrets.
Run a small SambaNova chat completion with Llama 3.1 405B.
Watch free credits, RPM/TPM limits, response shape, and error messages before scaling.
Credit-change alerts
Want to know when free credits, pricing, or availability changes? Subscribe first, then compare official providers, API gateways, and alternatives.
Subscribe → Get an OpenLLMAPI key → Compare API gateways →Related internal links
Source snapshot
Data source: yangmao.ai provider YAML tracker plus provider docs reviewed by the daily crawler. Official dashboards can change quota and pricing without notice; verify before production.
- yangmao.ai provider id
- sambanova
- Official source
- https://sambanova.ai
- Last updated
- 2026-06-05
- Free tier
- 30 RPM (no total cap)
- API credits
- Free tier（永久免费）
- Rate limit
- 30 RPM
- Access note
- Requires proxy in China. Use openllmapi.com as proxy.
FAQ
Does SambaNova have a free API?
Yes. Current yangmao.ai record: Free tier（永久免费）. Rate limit note: 30 RPM.
Is SambaNova OpenAI-compatible?
The recorded setup uses an OpenAI-compatible pattern or SDK-style call. Validate the latest base URL and model names in SambaNova docs.
Can I use SambaNova from mainland China?
SambaNova may need a proxy or relay from mainland China. Test latency and signup before production.
What should I do when SambaNova credits run out?
Compare the alternatives below, check /en/free-ai-api/, and shortlist official providers or API gateway options before production.