The pickles drive me crazy.

Tensorflow saved models are a great way to solve the problem... Save the computation graph and weights, and drop all the crusty code dependencies. I think ONNX models are similar. I expect there should be a Jax equivalent at some point, as Jax is basically perfectly designed for this (everything is expressed in lax operations, which allows changing implementations for cpu/gpu/tpu freely... So just save the list of lax ops).

I'm surprised that some of the cutting edge AI work is not being done in pure Rust. Why even have a binding layer?

Python seems to have won over the Data / ML world.

So I’d wager they use what they and their intended audience know.

Someone implemented llama on Go recently, https://github.com/gotzmann/llama.go

Wouldn't discard a rust implementation of some LLM architecture at some point

Hi! I'm a maintainer of https://github.com/rustformers/llama-rs. We're planning to expand our model support soon.

There’s also ggml, which is quite impressive considering they get whisper and other models to run on a phone.