What transformers version can this be deployed with?
I tried deploying this model on AWS SageMaker however it seems like the transformers library doesn't have an update to date version to yet to handle gemma 3.
How can this be deployed?
To use Gemma-3 models, you need the latest development version of the Transformers library (4.50.0.dev0). You can install it directly from the GitHub branch using: pip install git+https://github.com/huggingface/[email protected] as mentioned here.
Ok thanks. The issue that I am having though is that in order to deploy on sagemaker, I have to put which transformers version and there hasn't been a new release with Gemma 3 yet. I also tried extending a Deep learning container by installing the (4.50.0.dev0) but ran into some compatibility issues.
What would be the easiest way for me to deploy this on sagemaker?