BPT adjustments: batched embedding API, normalized vectors, resource limits, lint/type/test gate (#3)

added caches

added embedding endpoints

made tailing / optional

additional tasks

additional tasks

initial commit

initial commit