programasweights/programasweights-python

ProgramAsWeights: compile English function descriptions into neural programs that run locally [R]

ProgramAsWeights: describe an AI function in English, compile it once, and run it locally on CPU

ProgramAsWeights: describe an AI function in English, compile it once, and run it locally on CPU

Hosted inference is available too, if you prefer not to download a model. Inference remotely takes ~150 ms: Local inference is optional, so you can choose where your inputs are processed.

I increasingly think future software will combine code for control flow with small neural programs for "fuzzy" judgments. That's what I've been exploring with ProgramAsWeights, which answers the…