All models
Text generation Google

Functiongemma 270M It

Google FunctionGemma 270M instruction-tuned function-calling model for local inference.

functiongemma-270m-it

Make it part of your app.

One model. Your language.

main.rs
use xybrid::ModelLoader;
use xybrid::ir::{Envelope, EnvelopeKind};

// LLMs need the llama.cpp backend: features = ["llm-llamacpp"]
let model = ModelLoader::from_registry("functiongemma-270m-it").load()?;

// Run text generation
let input = Envelope::new(EnvelopeKind::Text("Explain quantum computing in simple terms.".into()));
let result = model.run(&input, None)?;

println!("{}", result.text().unwrap_or(""));
Built with Xybrid Quickstart

Available variants

VariantFormatQuantizationSize
universalDEFAULTGGUFq8_0278.1 MB