Microsoft India
en (10K h), hi (10K h), ta (1K h), gu (1.3K h)
enc - 6 layer lstm (1024)
dec - 2 layer lstm (1024)
70-110M
Google
hi (16M u), mr (4M), bn (3.9M), te (2.4 M), gu (2.2M), ta (1.8M), ml (1.5M), kn (1.2 M), ur (0.44M)
enc - 8 layer lstm (2048)
dec - 2 layer lstm (2048)
120M - 140M (2.5M params per language adapter)