- [ ] Avoid string based lookups - [ ] Scale embeddings once after vocab read and use the scaled vocab.