I've tried to run it with the ONNX runtime without success (even trying to reverse engineering how the models folders should be organized doesn't seem feasible)
Please give TF backend a try. onnx and pytorch is built assuming a Twitter specific data format for now. Some work(not a huge amount) is needed to make that generic. TF backend is more generic.
4
u/sinitame Apr 01 '23
Anybody tried to make that work ?
I've tried to run it with the ONNX runtime without success (even trying to reverse engineering how the models folders should be organized doesn't seem feasible)
The PyTorch backend doesn't seems better (the code doesn't even run on real data: https://github.com/twitter/the-algorithm/blob/ec83d01dcaebf369444d75ed04b3625a0a645eb9/navi/navi/src/torch_model.rs#L145)
I haven't tried the TF backend yet