oh mlx kernels I heavily underestimated your willingness to cooperate
grateful bc has been interesting learning how to profile a kernel
jk i did not consider quantization in this
already running into an issue with supporting int4 quantized models
back to the drawing board