Steps of Strassen’s matrix multiplication: Divide the matrices A and B into smaller submatrices of the size n/2xn/2. Using the formula of scalar additions and subtractions compute smaller matrices of size n/2. Recursively compute the seven matrix products Pi=AiBi for i=1,2,…7. Now comp...
Procedure of Strassen matrix multiplication There are some procedures: Divide a matrix of order of 2*2 recursively till we get the matrix of 2*2. Use the previous set of formulas to carry out 2*2 matrix multiplication. In this eight multiplication and four additions, subtraction are performed....
python3 train.py --quant_mode 2 --max_epochs 20 --decay_when 0.5 --nbr_mul 1.0 --out_nbr_mul 2000 --learning_rate 0.2 --epochs_pre 20 --learning_rate_pre 2 to train a Strassen language model. To change the multiplication budget, adapt --nbr_mul (budget of all but the last ...