Application Code and Model Data
Python project (PyCharm™, PyTorch™) to learn multiplication and test the model
Playground
Listed below are models exported into XLSX files. Calculator is located on the first tab. Type your numbers and verify result.
You may want to open any other tab and examine every matrix in place.
🧮 Standard Transformer XLSX (15.6 MB)
🧮 Transformer ended by Binary Decoder XLSX (781 KB)
🧮 B-Dec Transformer with TANH XLSX (16.1 MB)
Project notes:
This is NOT a general purpose LLM! It knows nothing about Shakespeare. It knows only table of multiplication learned at school.
The model doesn't know about zero. If you try to nullify something, the model will report wrong answer.
Microsoft® Excel is required to play with exported model.
CUDA™ and Excel™ crunch numbers differently. You may find noticeable mismatches at every tab versus binary model.
Positional encoder isn't implemented.
Analytical tabs in the XLSX use 3rd party plugin. These tabs are optional.
All provided materials are covered by MIT license.
This is a work in progress. No warranties provided, of any sort.
Sections
Software
Publications