1a:["$","circle","1mglay",{"cx":"12","cy":"12","r":"10"}] 1b:["$","path","mmk7yg",{"d":"M12 6v6l4 2"}] 1c:["$","span",null,{"className":"flex items-center gap-1 text-xs text-gray-500","children":[["$","svg",null,{"ref":"$undefined","xmlns":"http://www.w3.org/2000/svg","width":24,"height":24,"viewBox":"0 0 24 24","fill":"none","stroke":"currentColor","strokeWidth":2,"strokeLinecap":"round","strokeLinejoin":"round","className":"lucide lucide-thumbs-up h-3.5 w-3.5","aria-hidden":"true","children":[["$","path","emmmcr",{"d":"M15 5.88 14 10h5.83a2 2 0 0 1 1.92 2.56l-2.33 8A2 2 0 0 1 17.5 22H4a2 2 0 0 1-2-2v-8a2 2 0 0 1 2-2h2.76a2 2 0 0 0 1.79-1.11L12 2a3.13 3.13 0 0 1 3 3.88Z"}],["$","path","1qc93n",{"d":"M7 10v12"}],"$undefined"]}],"0"," 投票"]}] 1d:["$","h1",null,{"className":"text-2xl font-bold text-gray-900 leading-snug","children":"Parallelize speculative decoding with P-EAGLE on Amazon SageMaker AI"}] 1e:["$","div",null,{"className":"prose prose-sm prose-gray max-w-none","dangerouslySetInnerHTML":{"__html":"

This post walks you through how to use P-EAGLE directly within Amazon SageMaker AI. It will demonstrate how to select a compatible model from the SageMaker JumpStart catalog, configure the parallel drafting specifications, and deploy a highly optimized real-time SageMaker AI endpoint to accelerate your generative AI applications.

延伸阅读

\n"}}] 1f:["$","a",null,{"href":"https://aws.amazon.com/blogs/machine-learning/parallelize-speculative-decoding-with-p-eagle-on-amazon-sagemaker-ai","target":"_blank","rel":"noopener noreferrer","className":"inline-flex items-center gap-2 rounded-xl bg-gray-900 hover:bg-gray-800 px-5 py-2.5 text-sm font-medium text-white transition-all","children":[["$","svg",null,{"ref":"$undefined","xmlns":"http://www.w3.org/2000/svg","width":24,"height":24,"viewBox":"0 0 24 24","fill":"none","stroke":"currentColor","strokeWidth":2,"strokeLinecap":"round","strokeLinejoin":"round","className":"lucide lucide-external-link h-4 w-4","aria-hidden":"true","children":[["$","path","1q9fwt",{"d":"M15 3h6v6"}],["$","path","gplh6r",{"d":"M10 14 21 3"}],["$","path","a6xqqp",{"d":"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"}],"$undefined"]}],"查看原文"]}]

Parallelize speculative decoding with P-EAGLE on Amazon SageMaker AI

延伸阅读

相关资讯