November 26, 2024Machine learning Unleash your Salesforce data using the Amazon Q Salesforce Online connector Thousands of companies worldwide use Salesforce to manage their sales, marketing, customer […] Read more
November 26, 2024Machine learning Serving LLMs using vLLM and Amazon EC2 instances with AWS AI chips The use of large language models (LLMs) and generative AI has exploded […] Read more
November 26, 2024Machine learning Deploy Meta Llama 3.1-8B on AWS Inferentia using Amazon EKS and vLLM With the rise of large language models (LLMs) like Meta Llama 3.1, […] Read more
November 26, 2024Machine learning Reducing hallucinations in large language models with custom intervention using Amazon Bedrock Agents Hallucinations in large language models (LLMs) refer to the phenomenon where the […] Read more
November 26, 2024Machine learning Enhanced observability for AWS Trainium and AWS Inferentia with Datadog This post is co-written with Curtis Maher and Anjali Thatte from Datadog. […] Read more
November 26, 2024Machine learning Using LLMs to fortify cyber defenses: Sophos’s insight on strategies for using LLMs with Amazon Bedrock and Amazon SageMaker This post is co-written with Adarsh Kyadige and Salma Taoufiq from Sophos. […] Read more
November 26, 2024Machine learning Read graphs, diagrams, tables, and scanned pages using multimodal prompts in Amazon Bedrock Large language models (LLMs) have come a long way from being able […] Read more
November 26, 2024Machine learning How Crexi achieved ML models deployment on AWS at scale and boosted efficiency This post is co-written with Isaac Smothers and James Healy-Mirkovich from Crexi. […] Read more
November 26, 2024Machine learning Rad AI reduces real-time inference latency by 50% using Amazon SageMaker This post is co-written with Ken Kao and Hasan Ali Demirci from […] Read more
November 26, 2024Machine learning Build a read-through semantic cache with Amazon OpenSearch Serverless and Amazon Bedrock In the field of generative AI, latency and cost pose significant challenges. […] Read more