things i want to do
September 28, 2024.
research
-
abliteration; probing; what makes a model good?
-
entropix
code
-
more open source contributions. but what projects? i want to write c++, torch, and jax.
-
cuda; gpu programming.
-
jaxshard_map
.xmap
andpmap
which i've used extensively are deprecated, let's learn modern spmd -
implement deepseek mla. why hasn't this caught on yet?
-
evaluate contextual retrieval on mindex. use local oss model for context. prompt caching on local models?
-
colpali to handle pdfs in mindex.
life
-
go on a ski trip to italy or france with my friends.
-
hike norwegian mountains with my girlfriend.
-
scuba dive. mexico? caribbean?