Level Up with AWS Bedrock Batch Inference to Reduce Token Cost
Towards AI
•
Generative AI
AI Research
AI Tools
Image by author Cut Costs, Keep Quality: Batch Processing with Claude on Bedrock We all know and love AWS Bedrock. It’s a one-stop-shop for all your AI needs. In this article I’ll show you how to get the most out of your Bedrock workflow. Previously, if I had a dataset that I wanted to make inferences on I would write a For-Loop in a SageMaker notebook. During each iteration I would call an AI tool from Bedrock using the AWS Python SDK and then save the output into a dictionary.