can we take each triangle of a mesh - bake it to a image each + it's adjacent triangles and have a 'hintmap' rendered too it -> then style transfer vs this image -> transfer it and bake to a uv image in blender

I have had good results without it being seamless - but this seems like it could enable you to transfer image styles onto 3d models.
https://www.youtube.com/watch?v=bhVAXoPBheE