pub struct Llama2Template;Expand description
Llama 2 chat template.
<s>[INST] <<SYS>>
{system}
<</SYS>>
{user} [/INST] {assistant} </s><s>[INST] {user_2} [/INST]Like Mistral, Llama 2 has no system role - the system prompt lives in a
<<SYS>> block inside the first instruction - so format() is implemented
directly while the per-message hooks are token-representative.
Trait Implementations§
Source§impl ChatTemplate for Llama2Template
impl ChatTemplate for Llama2Template
Source§fn format(
&self,
system_prompt: &str,
messages: &[Message],
tools: &[ToolSchema],
) -> String
fn format( &self, system_prompt: &str, messages: &[Message], tools: &[ToolSchema], ) -> String
Format a complete prompt from system prompt, messages, and tools.
Source§fn format_system(&self, system_prompt: &str, tools: &[ToolSchema]) -> String
fn format_system(&self, system_prompt: &str, tools: &[ToolSchema]) -> String
Format the system block (system prompt + tool definitions).
Source§fn format_message(&self, message: &Message) -> String
fn format_message(&self, message: &Message) -> String
Wrap a single conversation message in template markers.
Returns empty string for system messages (handled by
format_system).Source§fn assistant_prefix(&self) -> &str
fn assistant_prefix(&self) -> &str
The string appended after all messages to open the assistant’s turn.
Auto Trait Implementations§
impl Freeze for Llama2Template
impl RefUnwindSafe for Llama2Template
impl Send for Llama2Template
impl Sync for Llama2Template
impl Unpin for Llama2Template
impl UnsafeUnpin for Llama2Template
impl UnwindSafe for Llama2Template
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more