Amazon Nova 配方 - 亚马逊 SageMaker AI
Amazon Web Services 文档中描述的 Amazon Web Services 服务或功能可能因区域而异。要查看适用于中国区域的差异,请参阅 中国的 Amazon Web Services 服务入门 (PDF)

本文属于机器翻译版本。若本译文内容与英语原文存在差异,则一律以英文原文为准。

Amazon Nova 配方

你可以从食谱库中获取 Amazon Nova SageMaker HyperPod 食谱。Nova 配方是一个 YAML 配置文件,它向 SageMaker AI 提供了有关如何运行模型自定义作业的详细信息。它提供基本模型名称、设置训练超参数、定义优化设置,并且包括成功微调或训练模型所需的任何其他选项。

你也可以通过 Amazon SageMaker Studio 和 Amazon Uni SageMaker fied Studio 访问 Nova 食谱,方法是导航到 JumpStart 模型中心Amazon,选择并浏览 Amazon Nova 模型以查找其相关食谱。Amazon SageMaker Studio 和 Amazon SageMaker Unified Studio 都为每个食谱提供了示例笔记本,其中包括修改配方和使用 SageMaker 人工智能训练作业或亚马逊 SageMaker HyperPod 环境运行自定义任务的所有必要步骤。

要访问 Amazon SageMaker Studio 中的食谱页面,执行角色必须具有以下权限。

JSON
{ "Version":"2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "s3:GetObject" ], "Resource": [ "arn:aws:s3:::*model-customization-recipes*" ] } ] }

要在 SageMaker 训练作业上执行示例笔记本 SageMaker HyperPod,请使用以下 SageMaker 分发映像版本之一:2.7.1+2.8.0+3.2.1+3.3.0+。这适用于亚马逊 SageMaker Studio 和亚马逊 SageMaker 联合工作室。

获取 Amazon Nova 配方

要获取基本的 Amazon Nova 配方,请运行以下命令克隆SageMaker HyperPod 配方存储库。

git clone https://github.com/aws/sagemaker-hyperpod-recipes.git

可通过 recipes_collection/recipes/ 获得基本配方。

cd recipes_collection/recipes/

Amazon Nova 自定义配方位于以下文件夹中。

食谱类型 Folder
SFT(全秩和 PEFT)、PPO、DPO(全秩和 PEFT) fine-tuning/nova
评估 evaluation/nova
CPT training/nova

可用的模型和算法

下表汇总了 Amazon Nova 机型的自定义功能以及支持的 SageMaker AI 算法。

模型名称

模型 ID

微调

注意

Amazon Nova Micro

亚马逊。 nova-micro-v1:0:128 k

对于 SFT、DPO 和 RFT,此模型接受文本作为输入,仅生成文本作为输出。

Amazon Nova Lite

亚马逊。 nova-lite-v1:0300 k

  • SFT-接受文本 and/or 图像或文本 and/or 视频作为输入并生成文本作为输出。单个作业不能在同一次运行中合并文本、图像和视频。

  • DPO:接受文本和图像作为输入,并生成文本作为输出。

  • RFT-接受文本和图像作为单回合对话的输入,并生成文本作为输出。

Amazon Nova Pro

亚马逊。 nova-pro-v1:0300 k

  • SFT-接受文本 and/or 图像或文本 and/or 视频作为输入并生成文本作为输出。单个作业不能在同一次运行中合并文本、图像和视频。

  • DPO:接受文本和图像作为输入,并生成文本作为输出。

  • RFT-接受文本和图像作为单回合对话的输入,并生成文本作为输出。

亚马逊 Nova Lite 2.0

亚马逊。 nova-lite-v2:0300 k

  • SFT-接受文本 and/or 图像或文本 and/or 视频作为输入并生成文本作为输出。单个作业不能在同一次运行中合并文本、图像和视频。

  • DPO:接受文本和图像作为输入,并生成文本作为输出。

  • RFT-接受文本和图像作为单回合对话的输入,并生成文本作为输出。改进了奖励优化功能。

Amazon Nova 配方参考

下表列出了 Amazon Nova 食谱参考的详细信息。

下表列出了 Amazon Nova Lite 食谱参考的详细信息。

模型 类别/子类别 方法 食谱名称 图片 URI(训练作业) 图片 URI (HyperPod) 计算实例
Nova Lite 训练/微调

监督式微调(LoRA)

nova_lite_p5_gpu_lora_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-V2-latest ml.p5.48xlarge
Nova Lite 训练/微调

监督式微调(全秩)

nova_lite_p5_gpu_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-V2-latest ml.p5.48xlarge
Nova Lite 训练/微调

直接偏好优化(全秩)

nova_lite_p5_gpu_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-V2-latest ml.p5.48xlarge
Nova Lite 训练/微调

直接偏好优化(LoRA)

nova_lite_p5_gpu_lora_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-V2-latest ml.p5.48xlarge
Nova Lite 训练/强化学习

钢筋微调 (RFT)

nova_lite_rft.yaml 不适用 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest ml.p5.48xlarge
Nova Lite 训练/持续预训练 持续预训练(基本模型) nova_lite_gpu_p5x16_pretrain.yaml 不适用 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest ml.p5.48xlarge
Nova Lite 评估/评估 标准文本基准测试 nova_lite_p5_48xl_general_text_benchmark_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Lite 评估/评估

自定义数据集评估

nova_lite_p5_48xl_bring_your_own_dataset_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Lite 评估/评估

多模态基准测试

nova_lite_p5_48_general_multi_modal_benchmark_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Lite 评估/评估

LLM-as-a-Judge

nova_lite_p5_48xl_llm_judge_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Lite 训练/微调

监督式微调(LoRA)

nova_lite_g5_g6_12x_gpu_lora_sft.yaml nova_lite_g5_g6_48x_gpu_lora_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-V2-latest 不适用 ml.g5.12xlarge, ml.g6.12xlarge, ml.g5.48xlarge, ml.g6.48xlarge
Nova Lite 训练/微调 DPO (LoRa) nova_lite_g5_g6_48x_gpu_lora_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-V2-latest 不适用 ml.g5.48xlarge, ml.g6.48xlarge

下表列出了 Nova 2.0 Lite 配方参考的详细信息。

模型 类别/子类别 方法 食谱名称 图片 URI(训练作业) 图片 URI (HyperPod) 计算实例
新星 2.0 精简版 训练 继续预训练 nova_lite_2_0_p5x8_gpu_pretrain.yaml 不适用 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-CPT-V2-latest ml.p5.48xlarge, ml.p5en.48xlarge
新星 2.0 精简版 参数高效微调 微调 nova_lite_2_0_p5_gpu_lora_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-V2-latest ml.p5.48xlarge, ml.p5en.48xlarge
新星 2.0 精简版 全等级微调 微调 nova_lite_2_0_p5_gpu_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-V2-latest ml.p5.48xlarge, ml.p5en.48xlarge
新星 2.0 精简版 参数高效的 RFT 微调 nova_lite_v2_smtj_p5_p5en_gpu_lora_rft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-RFT-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-RFT-TRAIN-V2-latest ml.p5.48xlarge, ml.p5en.48xlarge
新星 2.0 精简版 满级 RFT 微调 nova_lite_v2_smtj_p5en_gpu_rft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-RFT-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-RFT-TRAIN-V2-latest ml.p5.48xlarge, ml.p5en.48xlarge
新星 2.0 精简版 自带数据 评估 nova_lite_2_0_p5_48xl_gpu_bring_your_own_dataset_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-V2-latest ml.p5.48xlarge, ml.p5en.48xlarge
新星 2.0 精简版 通用文本基准 评估 nova_lite_2_0_p5_48xl_gpu_general_text_benchmark_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-V2-latest ml.p5.48xlarge, ml.p5en.48xlarge
新星 2.0 精简版 RFT 评估 评估 nova_lite_2_0_p5_48xl_gpu_rft_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-V2-latest ml.p5.48xlarge, ml.p5en.48xlarge
新星 2.0 精简版 法学硕士专栏评委 评估 nova_lite_2_0_p5_48xl_gpu_rubric_llm_judge_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-V2-latest ml.p5.48xlarge, ml.p5en.48xlarge

下表列出了 Amazon Nova Micro 食谱参考的详细信息。

模型 类别/子类别 方法 食谱名称 图片 URI(训练作业) 图片 URI (HyperPod) 计算实例
Nova Micro 训练/微调

监督式微调(LoRA)

nova_micro_g5_gpu_lora_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-V2-latest 不适用 ml.g5.12xlarge
Nova Micro 训练/微调

监督式微调(LoRA)

nova_micro_p5_gpu_lora_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-V2-latest ml.p5.48xlarge
Nova Micro 训练/微调

监督式微调(全秩)

nova_micro_p5_gpu_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-V2-latest ml.p5.48xlarge
Nova Micro 训练/微调

直接偏好优化(全秩)

nova_micro_p5_gpu_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-V2-latest ml.p5.48xlarge
Nova Micro 训练/微调

直接偏好优化(LoRA)

nova_micro_p5_gpu_lora_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-V2-latest ml.p5.48xlarge
Nova Micro 训练/强化学习

钢筋微调 (RFT)

nova_micro_rft.yaml 不适用 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest ml.p5.48xlarge
Nova Micro 训练/持续预训练 持续预训练(基本模型) nova_micro_gpu_p5x8_pretrain.yaml 不适用 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest ml.p5.48xlarge
Nova Micro 评估/评估 一般文本基准测试 nova_micro_p5_48xl_general_text_benchmark_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Micro 评估/评估

自带数据集(gen_qa)基准测试

nova_micro_p5_48xl_bring_your_own_dataset_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Micro 评估/评估

LLM-as-a-Judge

nova_micro_p5_48xl_llm_judge_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Micro 训练/微调

监督式微调(LoRA)

nova_micro_g5_g6_12x_gpu_lora_sft.yaml nova_micro_g5_g6_48x_gpu_lora_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-V2-latest 不适用 ml.g5.12xlarge, ml.g6.12xlarge, ml.g5.48xlarge, ml.g6.48xlarge
Nova Micro 训练/微调

监督微调 (FFT)

nova_micro_g5_g6_48x_gpu_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-V2-latest 不适用 ml.g5.48xlarge, ml.g6.48xlarge
Nova Micro 训练/微调 DPO (LoRa) nova_micro_g5_g6_12x_gpu_lora_dpo.yaml nova_micro_g5_g6_48x_gpu_lora_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-V2-latest 不适用 ml.g5.12xlarge, ml.g6.12xlarge, ml.g5.48xlarge, ml.g6.48xlarge

下表列出了亚马逊 Nova Pro 食谱参考的详细信息。

模型 类别/子类别 方法 食谱名称 图片 URI(训练作业) 图片 URI (HyperPod) 计算实例
Nova Pro 训练/微调

监督式微调(LoRA)

nova_pro_p5_gpu_lora_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-V2-latest ml.p5.48xlarge
Nova Pro 训练/微调

监督式微调(全秩)

nova_pro_p5_gpu_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-V2-latest ml.p5.48xlarge
Nova Pro 训练/微调

直接偏好优化(全秩)

nova_pro_p5_gpu_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-V2-latest ml.p5.48xlarge
Nova Pro 训练/微调

直接偏好优化(LoRA)

nova_pro_p5_gpu_lora_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-V2-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-V2-latest ml.p5.48xlarge
Nova Pro 训练/强化学习

钢筋微调 (RFT)

nova_pro_rft.yaml 不适用 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest ml.p5.48xlarge
Nova Pro 训练/持续预训练 持续预训练(基本模型) nova_pro_gpu_p5x24_pretrain.yaml 不适用 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest ml.p5.48xlarge
Nova Pro 训练/数据增强 针对后训练的模型蒸馏 nova_pro_r5_cpu_distill.yaml 不适用 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-distillation-repo:SM-TJ-DISTILL-LATEST ml.r5.24xlarge
Nova Pro 评估/评估 标准文本基准测试 nova_pro_p5_48xl_general_text_benchmark_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Pro 评估/评估 自定义数据集评估 nova_pro_p5_48xl_bring_your_own_dataset_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Pro 评估/评估 多模态基准测试 nova_pro_p5_48xl_general_multi_modal_benchmark_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Pro 评估/评估 LLM-as-a-Judge nova_pro_p5_48xl_llm_judge_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge

下表列出了亚马逊 Nova Premier 食谱参考的详细信息。

模型 类别/子类别 方法 食谱名称 图片 URI(训练作业) 图片 URI (SageMaker HyperPod) 计算实例
Nova Premier 训练 针对后训练的模型蒸馏

nova_premier_r5_cpu_distill.yaml

708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-distillation-repo:SM-TJ-DISTILL-LATEST 不适用 ml.r5.24xlarge