AWS has introduced two new OpenAI models with open weights, the gpt-oss-120b and gpt-oss-20b, available through Amazon Bedrock and Amazon SageMaker JumpStart. These models are designed for text generation and reasoning tasks, excelling in coding, scientific analysis, and mathematical reasoning, with performance comparable to leading alternatives. They support a context window of 128K and adjustable reasoning levels (low, medium, high). Users can access these models via an OpenAI-compatible endpoint in Bedrock, utilizing the OpenAI SDK or Bedrock APIs for integration.
To access the models in Amazon Bedrock, users must request access through the console and can evaluate them using the Chat/Test playground. The process for using the OpenAI SDK involves configuring the API endpoint and authentication with an Amazon Bedrock API key. Users can build AI agents using frameworks that support the Amazon Bedrock API or OpenAI API, with deployment facilitated by Amazon Bedrock AgentCore.
The OpenAI models are available in the US West (Oregon) region through Amazon Bedrock and in the US East (Ohio, N. Virginia) and Asia Pacific (Mumbai, Tokyo) regions via SageMaker JumpStart. Each model provides full chain-of-thought output capabilities for enhanced interpretability. They can be modified and customized to meet specific needs, and security measures are in place to ensure robust evaluation processes. Compatibility with the standard GPT-4 tokenizer is also included. For cost details, users can refer to the Amazon Bedrock and SageMaker AI pricing pages.