This MR helps address meta#61 (closed) by using an external API hosted on RunPod which has access to GPUs to speed up generating embeddings. Companion MR to ots/mediawiki/semantic-search!3 (merged)
Define the following in .env.local with an OpenAI-compatible API and key:
EMBEDDING_MODEL=Snowflake/snowflake-arctic-embed-m-v1.5
EMBEDDING_API_BASE=
EMBEDDING_API_KEY=make runUse the API console to make an embedding request.