Load balancers for Node, including the power of two choices algorithm
A round-robin scheduler, compatible with the abstract-scheduler interface.
Load balancing algorithms using Node.js
A small service package allowing to perform load balancing of LLM prompts between models, regions and model hosting platforms