Is it possible to create a lens shader with EEVEE/Cycles ?
I'd like to have the control over the camera position and the ray direction per sample. This allows to simulate various conventional lens distortions (which I'm not interested in) and other deforming effects. Houdini and Arnold supports a camera lens shader, someone also used it to run across the objects and bake textures.
Some other ideas include run a particle simulation, and assign each particle to a pixel in the image as if it were a camera looking from that particle. Or you can just use an ordinary object to sample the space around. You can mix perspective and orthographic in different parts of the image, blending between them, or even zoom only part of the image. This thread shows how to set it up and one possible use that this kind of level of control gives you.
https://www.sidefx.com/tutorials/lens-shaders-for-gamedev/
I insist that I'm not trying to replicate this specific effect, I'm looking for this level of control per pixel.