Try out your own prompts here.

Set up a python environment and run pip install -r requirements.txt

papermill Translation.ipynb out.ipynb -p input_lang fr -p target_lang zh

papermill Cloze.ipynb out.ipynb -p target_lang fr

For your convenience, we also provide some precomputed latents on huggingface. Here are some preliminary steering experiments using the precomputed latents.

Starting point of this repo was Nina Rimsky's Llama-2 wrapper.

@article{wendler2024llamas,
  title={Do Llamas Work in English? On the Latent Language of Multilingual Transformers},
  author={Wendler, Chris and Veselovsky, Veniamin and Monea, Giovanni and West, Robert},
  journal={arXiv preprint arXiv:2402.10588},
  year={2024}
}