Deploy Meta Llama 3.1-8B on AWS Inferentia using Amazon EKS and vLLM
With the rise of large language models (LLMs) like Meta Llama 3.1, […]
Read moreCategory: Machine learning
Reducing hallucinations in large language models with custom intervention using Amazon Bedrock Agents
Hallucinations in large language models (LLMs) refer to the phenomenon where the […]
Read more
Enhanced observability for AWS Trainium and AWS Inferentia with Datadog
This post is co-written with Curtis Maher and Anjali Thatte from Datadog. […]
Read more
Using LLMs to fortify cyber defenses: Sophos’s insight on strategies for using LLMs with Amazon Bedrock and Amazon SageMaker
This post is co-written with Adarsh Kyadige and Salma Taoufiq from Sophos. […]
Read more
Read graphs, diagrams, tables, and scanned pages using multimodal prompts in Amazon Bedrock
Large language models (LLMs) have come a long way from being able […]
Read more
How Crexi achieved ML models deployment on AWS at scale and boosted efficiency
This post is co-written with Isaac Smothers and James Healy-Mirkovich from Crexi. […]
Read more
Rad AI reduces real-time inference latency by 50% using Amazon SageMaker
This post is co-written with Ken Kao and Hasan Ali Demirci from […]
Read more
Build a read-through semantic cache with Amazon OpenSearch Serverless and Amazon Bedrock
In the field of generative AI, latency and cost pose significant challenges. […]
Read more
Apply Amazon SageMaker Studio lifecycle configurations using AWS CDK
This post serves as a step-by-step guide on how to set up […]
Read more
Create a virtual stock technical analyst using Amazon Bedrock Agents
Stock technical analysis questions can be as unique as the individual stock […]
Read more